Dec 06 12:35:58 user nova-compute[75247]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75247) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 06 12:35:58 user nova-compute[75247]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75247) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 06 12:35:58 user nova-compute[75247]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75247) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 06 12:35:58 user nova-compute[75247]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Dec 06 12:35:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:35:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:35:59 user nova-compute[75247]: INFO nova.virt.driver [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] Loading compute driver 'libvirt.LibvirtDriver'
Dec 06 12:35:59 user nova-compute[75247]: INFO nova.compute.provider_config [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] Acquiring lock "singleton_lock" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] Acquired lock "singleton_lock" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] Releasing lock "singleton_lock" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] Full set of CONF: {{(pid=75247) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ******************************************************************************** {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] Configuration options gathered from: {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ================================================================================ {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] allow_resize_to_same_host      = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] arq_binding_timeout            = 300 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] backdoor_port                  = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] backdoor_socket                = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] block_device_allocate_retries  = 300 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] block_device_allocate_retries_interval = 5 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cert                           = self.pem {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] compute_monitors               = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] config_dir                     = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] config_drive_format            = iso9660 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] config_source                  = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] console_host                   = user {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] control_exchange               = nova {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cpu_allocation_ratio           = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] daemon                         = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] debug                          = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] default_access_ip_network_name = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] default_availability_zone      = nova {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] default_ephemeral_format       = ext4 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] default_green_pool_size        = 1000 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] default_schedule_zone          = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] disk_allocation_ratio          = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] enable_new_services            = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] enabled_apis                   = ['osapi_compute'] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] enabled_ssl_apis               = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] flat_injected                  = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] force_config_drive             = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] force_raw_images               = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] graceful_shutdown_timeout      = 5 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] heal_instance_info_cache_interval = 60 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] host                           = user {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] instance_build_timeout         = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] instance_delete_interval       = 300 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] instance_format                = [instance: %(uuid)s]  {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] instance_name_template         = instance-%08x {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] instance_usage_audit           = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] instance_usage_audit_period    = month {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] internal_service_availability_zone = internal {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] key                            = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] live_migration_retry_count     = 30 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] log_config_append              = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] log_dir                        = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] log_file                       = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] log_options                    = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] log_rotate_interval            = 1 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] log_rotate_interval_type       = days {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] log_rotation_type              = none {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] long_rpc_timeout               = 1800 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] max_concurrent_builds          = 10 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] max_concurrent_live_migrations = 1 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] max_concurrent_snapshots       = 5 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] max_local_block_devices        = 3 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] max_logfile_count              = 30 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] max_logfile_size_mb            = 200 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] maximum_instance_delete_attempts = 5 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] metadata_listen                = 0.0.0.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] metadata_listen_port           = 8775 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] metadata_workers               = 3 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] migrate_max_retries            = -1 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] mkisofs_cmd                    = genisoimage {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] my_ip                          = 10.0.0.210 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] network_allocate_retries       = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] osapi_compute_listen_port      = 8774 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] osapi_compute_unique_server_name_scope =  {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] osapi_compute_workers          = 3 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] password_length                = 12 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] periodic_enable                = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] periodic_fuzzy_delay           = 60 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] pointer_model                  = ps2mouse {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] preallocate_images             = none {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] publish_errors                 = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] pybasedir                      = /opt/stack/nova {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ram_allocation_ratio           = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] rate_limit_burst               = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] rate_limit_except_level        = CRITICAL {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] rate_limit_interval            = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] reboot_timeout                 = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] reclaim_instance_interval      = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] record                         = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] reimage_timeout_per_gb         = 60 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] report_interval                = 120 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] rescue_timeout                 = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] reserved_host_cpus             = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] reserved_host_disk_mb          = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] reserved_host_memory_mb        = 512 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] reserved_huge_pages            = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] resize_confirm_window          = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] resize_fs_using_block_device   = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] resume_guests_state_on_host_boot = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] rpc_response_timeout           = 60 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] run_external_periodic_tasks    = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] running_deleted_instance_action = reap {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] running_deleted_instance_poll_interval = 1800 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] running_deleted_instance_timeout = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] scheduler_instance_sync_interval = 120 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] service_down_time              = 720 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] servicegroup_driver            = db {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] shelved_offload_time           = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] shelved_poll_interval          = 3600 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] shutdown_timeout               = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] source_is_ipv6                 = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ssl_only                       = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] state_path                     = /opt/stack/data/nova {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] sync_power_state_interval      = 600 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] sync_power_state_pool_size     = 1000 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] syslog_log_facility            = LOG_USER {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] tempdir                        = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] timeout_nbd                    = 10 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] transport_url                  = **** {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] update_resources_interval      = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] use_cow_images                 = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] use_eventlog                   = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] use_journal                    = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] use_json                       = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] use_rootwrap_daemon            = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] use_stderr                     = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] use_syslog                     = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vcpu_pin_set                   = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vif_plugging_is_fatal          = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vif_plugging_timeout           = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] virt_mkfs                      = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] volume_usage_poll_interval     = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] watch_log_file                 = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] web                            = /usr/share/spice-html5 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_concurrency.disable_process_locking = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api.auth_strategy              = keystone {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api.compute_link_prefix        = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api.dhcp_domain                = novalocal {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api.enable_instance_password   = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api.glance_link_prefix         = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api.instance_list_per_project_cells = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api.list_records_by_skipping_down_cells = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api.local_metadata_per_cell    = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api.max_limit                  = 1000 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api.metadata_cache_expiration  = 15 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api.neutron_default_tenant_id  = default {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api.use_forwarded_for          = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api.use_neutron_default_nets   = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api.vendordata_dynamic_targets = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api.vendordata_jsonfile_path   = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.backend                  = dogpile.cache.memcached {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.backend_argument         = **** {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.config_prefix            = cache.oslo {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.dead_timeout             = 60.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.debug_cache_backend      = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.enable_retry_client      = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.enable_socket_keepalive  = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.enabled                  = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.expiration_time          = 600 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.hashclient_retry_attempts = 2 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.memcache_dead_retry      = 300 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.memcache_password        =  {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.memcache_pool_maxsize    = 10 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.memcache_sasl_enabled    = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.memcache_username        =  {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.proxies                  = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.retry_attempts           = 2 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.retry_delay              = 0.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.socket_keepalive_count   = 1 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.socket_keepalive_idle    = 1 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.socket_keepalive_interval = 1 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.tls_allowed_ciphers      = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.tls_cafile               = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.tls_certfile             = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.tls_enabled              = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cache.tls_keyfile              = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cinder.auth_section            = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cinder.auth_type               = password {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cinder.cafile                  = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cinder.certfile                = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cinder.collect_timing          = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cinder.cross_az_attach         = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cinder.debug                   = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cinder.endpoint_template       = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cinder.http_retries            = 3 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cinder.insecure                = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cinder.keyfile                 = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cinder.os_region_name          = RegionOne {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cinder.split_loggers           = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cinder.timeout                 = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] compute.cpu_dedicated_set      = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] compute.cpu_shared_set         = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] compute.image_type_exclude_list = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] compute.max_concurrent_disk_ops = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] compute.max_disk_devices_to_attach = -1 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] compute.resource_provider_association_refresh = 300 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] compute.shutdown_retry_interval = 10 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] conductor.workers              = 3 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] console.allowed_origins        = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] console.ssl_ciphers            = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] console.ssl_minimum_version    = default {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] consoleauth.token_ttl          = 600 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cyborg.cafile                  = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cyborg.certfile                = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cyborg.collect_timing          = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cyborg.connect_retries         = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cyborg.connect_retry_delay     = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cyborg.endpoint_override       = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cyborg.insecure                = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cyborg.keyfile                 = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cyborg.max_version             = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cyborg.min_version             = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cyborg.region_name             = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cyborg.service_name            = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cyborg.service_type            = accelerator {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cyborg.split_loggers           = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cyborg.status_code_retries     = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cyborg.status_code_retry_delay = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cyborg.timeout                 = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] cyborg.version                 = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] database.backend               = sqlalchemy {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] database.connection            = **** {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] database.connection_debug      = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] database.connection_parameters =  {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] database.connection_recycle_time = 3600 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] database.connection_trace      = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] database.db_inc_retry_interval = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] database.db_max_retries        = 20 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] database.db_max_retry_interval = 10 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] database.db_retry_interval     = 1 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] database.max_overflow          = 50 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] database.max_pool_size         = 5 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] database.max_retries           = 10 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] database.mysql_wsrep_sync_wait = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] database.pool_timeout          = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] database.retry_interval        = 10 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] database.slave_connection      = **** {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] database.sqlite_synchronous    = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api_database.backend           = sqlalchemy {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api_database.connection        = **** {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api_database.connection_debug  = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api_database.connection_parameters =  {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api_database.connection_recycle_time = 3600 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api_database.connection_trace  = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api_database.db_inc_retry_interval = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api_database.db_max_retries    = 20 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api_database.db_max_retry_interval = 10 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api_database.db_retry_interval = 1 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api_database.max_overflow      = 50 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api_database.max_pool_size     = 5 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api_database.max_retries       = 10 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api_database.pool_timeout      = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api_database.retry_interval    = 10 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api_database.slave_connection  = **** {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] api_database.sqlite_synchronous = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] devices.enabled_mdev_types     = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ephemeral_storage_encryption.enabled = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.api_servers             = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.cafile                  = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.certfile                = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.collect_timing          = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.connect_retries         = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.connect_retry_delay     = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.debug                   = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.default_trusted_certificate_ids = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.enable_certificate_validation = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.enable_rbd_download     = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.endpoint_override       = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.insecure                = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.keyfile                 = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.max_version             = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.min_version             = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.num_retries             = 3 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.rbd_ceph_conf           =  {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.rbd_connect_timeout     = 5 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.rbd_pool                =  {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.rbd_user                =  {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.region_name             = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.service_name            = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.service_type            = image {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.split_loggers           = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.status_code_retries     = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.status_code_retry_delay = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.timeout                 = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.verify_glance_signatures = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] glance.version                 = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] guestfs.debug                  = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] hyperv.config_drive_cdrom      = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] hyperv.config_drive_inject_password = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] hyperv.enable_instance_metrics_collection = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] hyperv.enable_remotefx         = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] hyperv.instances_path_share    =  {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] hyperv.iscsi_initiator_list    = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] hyperv.limit_cpu_features      = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] hyperv.power_state_check_timeframe = 60 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] hyperv.use_multipath_io        = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] hyperv.volume_attach_retry_count = 10 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] hyperv.vswitch_name            = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] mks.enabled                    = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] image_cache.manager_interval   = 2400 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] image_cache.precache_concurrency = 1 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] image_cache.remove_unused_base_images = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] image_cache.subdirectory_name  = _base {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ironic.api_max_retries         = 60 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ironic.api_retry_interval      = 2 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ironic.auth_section            = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ironic.auth_type               = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ironic.cafile                  = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ironic.certfile                = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ironic.collect_timing          = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ironic.conductor_group         = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ironic.connect_retries         = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ironic.connect_retry_delay     = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ironic.endpoint_override       = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ironic.insecure                = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ironic.keyfile                 = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ironic.max_version             = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ironic.min_version             = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ironic.peer_list               = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ironic.region_name             = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ironic.serial_console_state_timeout = 10 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ironic.service_name            = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ironic.service_type            = baremetal {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ironic.split_loggers           = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ironic.status_code_retries     = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ironic.status_code_retry_delay = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ironic.timeout                 = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ironic.version                 = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] key_manager.fixed_key          = **** {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] barbican.barbican_api_version  = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] barbican.barbican_endpoint     = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] barbican.barbican_endpoint_type = public {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] barbican.barbican_region_name  = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] barbican.cafile                = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] barbican.certfile              = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] barbican.collect_timing        = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] barbican.insecure              = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] barbican.keyfile               = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] barbican.number_of_retries     = 60 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] barbican.retry_delay           = 1 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] barbican.send_service_user_token = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] barbican.split_loggers         = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] barbican.timeout               = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] barbican.verify_ssl            = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] barbican.verify_ssl_path       = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] barbican_service_user.auth_section = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] barbican_service_user.auth_type = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] barbican_service_user.cafile   = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] barbican_service_user.certfile = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] barbican_service_user.collect_timing = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] barbican_service_user.insecure = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] barbican_service_user.keyfile  = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] barbican_service_user.split_loggers = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] barbican_service_user.timeout  = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vault.approle_role_id          = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vault.approle_secret_id        = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vault.cafile                   = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vault.certfile                 = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vault.collect_timing           = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vault.insecure                 = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vault.keyfile                  = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vault.kv_mountpoint            = secret {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vault.kv_path                  = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vault.kv_version               = 2 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vault.namespace                = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vault.root_token_id            = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vault.split_loggers            = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vault.ssl_ca_crt_file          = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vault.timeout                  = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vault.use_ssl                  = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] keystone.auth_section          = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] keystone.auth_type             = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] keystone.cafile                = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] keystone.certfile              = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] keystone.collect_timing        = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] keystone.connect_retries       = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] keystone.connect_retry_delay   = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] keystone.endpoint_override     = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] keystone.insecure              = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] keystone.keyfile               = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] keystone.max_version           = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] keystone.min_version           = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] keystone.region_name           = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] keystone.service_name          = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] keystone.service_type          = identity {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] keystone.split_loggers         = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] keystone.status_code_retries   = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] keystone.status_code_retry_delay = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] keystone.timeout               = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] keystone.version               = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.connection_uri         =  {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.cpu_mode               = custom {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: WARNING oslo_config.cfg [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.cpu_power_governor_high = performance {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.cpu_power_governor_low = powersave {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.cpu_power_management   = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.device_detach_attempts = 8 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.device_detach_timeout  = 20 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.disk_cachemodes        = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.disk_prefix            = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.enabled_perf_events    = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.file_backed_memory     = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.gid_maps               = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.hw_disk_discard        = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.hw_machine_type        = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.images_rbd_glance_store_name =  {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.images_rbd_pool        = rbd {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.images_type            = default {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.images_volume_group    = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.inject_key             = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.inject_partition       = -2 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.inject_password        = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.iscsi_iface            = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.iser_use_multipath     = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.live_migration_bandwidth = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.live_migration_downtime = 500 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.live_migration_inbound_addr = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.live_migration_permit_post_copy = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.live_migration_scheme  = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.live_migration_timeout_action = abort {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.live_migration_tunnelled = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: WARNING oslo_config.cfg [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Dec 06 12:35:59 user nova-compute[75247]: live_migration_uri is deprecated for removal in favor of two other options that
Dec 06 12:35:59 user nova-compute[75247]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Dec 06 12:35:59 user nova-compute[75247]: and ``live_migration_inbound_addr`` respectively.
Dec 06 12:35:59 user nova-compute[75247]: ).  Its value may be silently ignored in the future.
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.live_migration_with_native_tls = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.max_queues             = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.migration_inbound_addr = 10.0.0.210 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.nfs_mount_options      = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.num_memory_encrypted_guests = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.num_pcie_ports         = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.pmem_namespaces        = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.quobyte_client_cfg     = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.rbd_secret_uuid        = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.rbd_user               = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.remote_filesystem_transport = ssh {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.rescue_image_id        = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.rescue_kernel_id       = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.rescue_ramdisk_id      = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.rx_queue_size          = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.smbfs_mount_options    =  {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.snapshot_compression   = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.snapshot_image_format  = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.sparse_logical_volumes = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.swtpm_enabled          = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.swtpm_group            = tss {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.swtpm_user             = tss {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.sysinfo_serial         = unique {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.tb_cache_size          = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.tx_queue_size          = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.uid_maps               = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.use_virtio_for_bridges = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.virt_type              = kvm {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.volume_clear           = zero {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.volume_clear_size      = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.volume_use_multipath   = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.vzstorage_cache_path   = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.vzstorage_mount_user   = stack {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.auth_section           = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.auth_type              = password {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.cafile                 = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.certfile               = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.collect_timing         = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.connect_retries        = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.connect_retry_delay    = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.default_floating_pool  = public {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.endpoint_override      = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.extension_sync_interval = 600 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.http_retries           = 3 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.insecure               = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.keyfile                = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.max_version            = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.min_version            = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.ovs_bridge             = br-int {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.physnets               = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.region_name            = RegionOne {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.service_metadata_proxy = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.service_name           = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.service_type           = network {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.split_loggers          = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.status_code_retries    = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.status_code_retry_delay = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.timeout                = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] neutron.version                = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] notifications.bdms_in_notifications = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] notifications.default_level    = INFO {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] notifications.notification_format = unversioned {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] notifications.notify_on_state_change = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] pci.alias                      = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] pci.device_spec                = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] pci.report_in_placement        = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.auth_section         = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.auth_type            = password {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.cafile               = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.certfile             = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.collect_timing       = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.connect_retries      = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.connect_retry_delay  = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.default_domain_id    = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.default_domain_name  = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.domain_id            = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.domain_name          = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.endpoint_override    = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.insecure             = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.keyfile              = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.max_version          = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.min_version          = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.password             = **** {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.project_domain_id    = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.project_domain_name  = Default {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.project_id           = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.project_name         = service {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.region_name          = RegionOne {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.service_name         = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.service_type         = placement {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.split_loggers        = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.status_code_retries  = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.status_code_retry_delay = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.system_scope         = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.timeout              = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.trust_id             = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.user_domain_id       = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.user_domain_name     = Default {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.user_id              = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.username             = placement {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] placement.version              = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] quota.cores                    = 20 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] quota.count_usage_from_placement = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] quota.injected_file_content_bytes = 10240 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] quota.injected_file_path_length = 255 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] quota.injected_files           = 5 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] quota.instances                = 10 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] quota.key_pairs                = 100 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] quota.metadata_items           = 128 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] quota.ram                      = 51200 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] quota.recheck_quota            = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] quota.server_group_members     = 10 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] quota.server_groups            = 10 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] rdp.enabled                    = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] scheduler.image_metadata_prefilter = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] scheduler.max_attempts         = 3 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] scheduler.max_placement_results = 1000 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] scheduler.query_placement_for_image_type_support = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] scheduler.workers              = 3 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] filter_scheduler.host_subset_size = 1 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] filter_scheduler.isolated_hosts = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] filter_scheduler.isolated_images = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] filter_scheduler.pci_in_placement = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] filter_scheduler.track_instance_changes = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] metrics.required               = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] metrics.weight_multiplier      = 1.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] metrics.weight_setting         = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] serial_console.enabled         = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] serial_console.port_range      = 10000:20000 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] serial_console.serialproxy_port = 6083 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] service_user.auth_section      = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] service_user.auth_type         = password {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] service_user.cafile            = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] service_user.certfile          = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] service_user.collect_timing    = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] service_user.insecure          = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] service_user.keyfile           = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] service_user.send_service_user_token = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] service_user.split_loggers     = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] service_user.timeout           = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] spice.agent_enabled            = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] spice.enabled                  = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] spice.html5proxy_port          = 6082 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] spice.image_compression        = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] spice.jpeg_compression         = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] spice.playback_compression     = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] spice.server_listen            = 127.0.0.1 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] spice.streaming_mode           = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] spice.zlib_compression         = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] upgrade_levels.baseapi         = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] upgrade_levels.compute         = auto {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] upgrade_levels.conductor       = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] upgrade_levels.scheduler       = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vendordata_dynamic_auth.auth_section = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vendordata_dynamic_auth.auth_type = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vendordata_dynamic_auth.cafile = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vendordata_dynamic_auth.certfile = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vendordata_dynamic_auth.insecure = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vendordata_dynamic_auth.keyfile = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vendordata_dynamic_auth.timeout = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vmware.api_retry_count         = 10 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vmware.ca_file                 = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vmware.cache_prefix            = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vmware.cluster_name            = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vmware.connection_pool_size    = 10 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vmware.console_delay_seconds   = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vmware.datastore_regex         = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vmware.host_ip                 = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vmware.host_password           = **** {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vmware.host_port               = 443 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vmware.host_username           = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vmware.insecure                = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vmware.integration_bridge      = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vmware.maximum_objects         = 100 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vmware.pbm_default_policy      = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vmware.pbm_enabled             = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vmware.pbm_wsdl_location       = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vmware.serial_port_proxy_uri   = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vmware.serial_port_service_uri = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vmware.task_poll_interval      = 0.5 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vmware.use_linked_clone        = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vmware.vnc_keymap              = en-us {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vmware.vnc_port                = 5900 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vmware.vnc_port_total          = 10000 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vnc.auth_schemes               = ['none'] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vnc.enabled                    = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vnc.novncproxy_port            = 6080 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vnc.server_listen              = 0.0.0.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vnc.vencrypt_ca_certs          = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vnc.vencrypt_client_cert       = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vnc.vencrypt_client_key        = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] workarounds.disable_rootwrap   = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] workarounds.enable_numa_live_migration = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] workarounds.libvirt_disable_apic = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] wsgi.client_socket_timeout     = 900 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] wsgi.default_pool_size         = 1000 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] wsgi.keep_alive                = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] wsgi.max_header_line           = 16384 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] wsgi.ssl_ca_file               = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] wsgi.ssl_cert_file             = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] wsgi.ssl_key_file              = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] wsgi.tcp_keepidle              = 600 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] zvm.ca_file                    = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] zvm.cloud_connector_url        = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] zvm.reachable_timeout          = 300 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_policy.enforce_new_defaults = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_policy.enforce_scope      = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_policy.policy_default_rule = default {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_policy.policy_file        = policy.yaml {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] profiler.connection_string     = messaging:// {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] profiler.enabled               = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] profiler.es_doc_type           = notification {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] profiler.es_scroll_size        = 10000 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] profiler.es_scroll_time        = 2m {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] profiler.filter_error_trace    = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] profiler.hmac_keys             = **** {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] profiler.sentinel_service_name = mymaster {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] profiler.socket_timeout        = 0.1 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] profiler.trace_requests        = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] profiler.trace_sqlalchemy      = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] profiler_jaeger.process_tags   = {} {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] profiler_jaeger.service_name_prefix = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] profiler_otlp.service_name_prefix = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] remote_debug.host              = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] remote_debug.port              = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.ssl      = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_notifications.retry = -1 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_messaging_notifications.transport_url = **** {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_limit.auth_section        = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_limit.auth_type           = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_limit.cafile              = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_limit.certfile            = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_limit.collect_timing      = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_limit.connect_retries     = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_limit.connect_retry_delay = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_limit.endpoint_id         = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_limit.endpoint_override   = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_limit.insecure            = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_limit.keyfile             = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_limit.max_version         = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_limit.min_version         = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_limit.region_name         = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_limit.service_name        = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_limit.service_type        = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_limit.split_loggers       = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_limit.status_code_retries = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_limit.status_code_retry_delay = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_limit.timeout             = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_limit.valid_interfaces    = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_limit.version             = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_reports.file_event_handler = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] oslo_reports.log_dir           = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vif_plug_ovs_privileged.group  = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] vif_plug_ovs_privileged.user   = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] os_vif_linux_bridge.flat_interface = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] os_vif_ovs.isolate_vif         = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] os_vif_ovs.per_port_bridge     = False {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] os_brick.lock_path             = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] privsep_osbrick.capabilities   = [21] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] privsep_osbrick.group          = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] privsep_osbrick.helper_command = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] privsep_osbrick.user           = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] nova_sys_admin.group           = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] nova_sys_admin.helper_command  = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] nova_sys_admin.user            = None {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG oslo_service.service [None req-d74cd9dd-d93c-47d0-a4a0-21cd28d0291f None None] ******************************************************************************** {{(pid=75247) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Dec 06 12:35:59 user nova-compute[75247]: INFO nova.service [-] Starting compute node (version 0.0.0)
Dec 06 12:35:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Connecting to libvirt: qemu:///system {{(pid=75247) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fd74824a500> {{(pid=75247) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Dec 06 12:35:59 user nova-compute[75247]: libvirt:  error : internal error: could not initialize domain event timer
Dec 06 12:35:59 user nova-compute[75247]: WARNING nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Dec 06 12:35:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fd74824a500> {{(pid=75247) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Starting native event thread {{(pid=75247) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Starting green dispatch thread {{(pid=75247) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Dec 06 12:35:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Starting connection event dispatch thread {{(pid=75247) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Dec 06 12:35:59 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Connection event '1' reason 'None'
Dec 06 12:35:59 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Dec 06 12:35:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.mount [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Initialising _HostMountState generation 0 {{(pid=75247) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Dec 06 12:36:07 user nova-compute[75247]: INFO nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Libvirt host capabilities <capabilities>
Dec 06 12:36:07 user nova-compute[75247]:   <host>
Dec 06 12:36:07 user nova-compute[75247]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Dec 06 12:36:07 user nova-compute[75247]:     <cpu>
Dec 06 12:36:07 user nova-compute[75247]:       <arch>x86_64</arch>
Dec 06 12:36:07 user nova-compute[75247]:       <model>IvyBridge-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <vendor>Intel</vendor>
Dec 06 12:36:07 user nova-compute[75247]:       <microcode version='1070'/>
Dec 06 12:36:07 user nova-compute[75247]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Dec 06 12:36:07 user nova-compute[75247]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature name='ss'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature name='vmx'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature name='pcid'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature name='osxsave'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature name='hypervisor'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature name='arat'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature name='tsc_adjust'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature name='md-clear'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature name='stibp'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature name='arch-capabilities'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature name='ssbd'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature name='invtsc'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature name='rsba'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature name='skip-l1dfl-vmentry'/>
Dec 06 12:36:07 user nova-compute[75247]:       <pages unit='KiB' size='4'/>
Dec 06 12:36:07 user nova-compute[75247]:       <pages unit='KiB' size='2048'/>
Dec 06 12:36:07 user nova-compute[75247]:     </cpu>
Dec 06 12:36:07 user nova-compute[75247]:     <power_management>
Dec 06 12:36:07 user nova-compute[75247]:       <suspend_mem/>
Dec 06 12:36:07 user nova-compute[75247]:       <suspend_disk/>
Dec 06 12:36:07 user nova-compute[75247]:       <suspend_hybrid/>
Dec 06 12:36:07 user nova-compute[75247]:     </power_management>
Dec 06 12:36:07 user nova-compute[75247]:     <iommu support='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     <migration_features>
Dec 06 12:36:07 user nova-compute[75247]:       <live/>
Dec 06 12:36:07 user nova-compute[75247]:       <uri_transports>
Dec 06 12:36:07 user nova-compute[75247]:         <uri_transport>tcp</uri_transport>
Dec 06 12:36:07 user nova-compute[75247]:         <uri_transport>rdma</uri_transport>
Dec 06 12:36:07 user nova-compute[75247]:       </uri_transports>
Dec 06 12:36:07 user nova-compute[75247]:     </migration_features>
Dec 06 12:36:07 user nova-compute[75247]:     <topology>
Dec 06 12:36:07 user nova-compute[75247]:       <cells num='2'>
Dec 06 12:36:07 user nova-compute[75247]:         <cell id='0'>
Dec 06 12:36:07 user nova-compute[75247]:           <memory unit='KiB'>8140616</memory>
Dec 06 12:36:07 user nova-compute[75247]:           <pages unit='KiB' size='4'>2035154</pages>
Dec 06 12:36:07 user nova-compute[75247]:           <pages unit='KiB' size='2048'>0</pages>
Dec 06 12:36:07 user nova-compute[75247]:           <distances>
Dec 06 12:36:07 user nova-compute[75247]:             <sibling id='0' value='10'/>
Dec 06 12:36:07 user nova-compute[75247]:             <sibling id='1' value='20'/>
Dec 06 12:36:07 user nova-compute[75247]:           </distances>
Dec 06 12:36:07 user nova-compute[75247]:           <cpus num='6'>
Dec 06 12:36:07 user nova-compute[75247]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Dec 06 12:36:07 user nova-compute[75247]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Dec 06 12:36:07 user nova-compute[75247]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Dec 06 12:36:07 user nova-compute[75247]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Dec 06 12:36:07 user nova-compute[75247]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Dec 06 12:36:07 user nova-compute[75247]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Dec 06 12:36:07 user nova-compute[75247]:           </cpus>
Dec 06 12:36:07 user nova-compute[75247]:         </cell>
Dec 06 12:36:07 user nova-compute[75247]:         <cell id='1'>
Dec 06 12:36:07 user nova-compute[75247]:           <memory unit='KiB'>8255100</memory>
Dec 06 12:36:07 user nova-compute[75247]:           <pages unit='KiB' size='4'>2063775</pages>
Dec 06 12:36:07 user nova-compute[75247]:           <pages unit='KiB' size='2048'>0</pages>
Dec 06 12:36:07 user nova-compute[75247]:           <distances>
Dec 06 12:36:07 user nova-compute[75247]:             <sibling id='0' value='20'/>
Dec 06 12:36:07 user nova-compute[75247]:             <sibling id='1' value='10'/>
Dec 06 12:36:07 user nova-compute[75247]:           </distances>
Dec 06 12:36:07 user nova-compute[75247]:           <cpus num='6'>
Dec 06 12:36:07 user nova-compute[75247]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Dec 06 12:36:07 user nova-compute[75247]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Dec 06 12:36:07 user nova-compute[75247]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Dec 06 12:36:07 user nova-compute[75247]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Dec 06 12:36:07 user nova-compute[75247]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Dec 06 12:36:07 user nova-compute[75247]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Dec 06 12:36:07 user nova-compute[75247]:           </cpus>
Dec 06 12:36:07 user nova-compute[75247]:         </cell>
Dec 06 12:36:07 user nova-compute[75247]:       </cells>
Dec 06 12:36:07 user nova-compute[75247]:     </topology>
Dec 06 12:36:07 user nova-compute[75247]:     <cache>
Dec 06 12:36:07 user nova-compute[75247]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Dec 06 12:36:07 user nova-compute[75247]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Dec 06 12:36:07 user nova-compute[75247]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Dec 06 12:36:07 user nova-compute[75247]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Dec 06 12:36:07 user nova-compute[75247]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Dec 06 12:36:07 user nova-compute[75247]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Dec 06 12:36:07 user nova-compute[75247]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Dec 06 12:36:07 user nova-compute[75247]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Dec 06 12:36:07 user nova-compute[75247]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Dec 06 12:36:07 user nova-compute[75247]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Dec 06 12:36:07 user nova-compute[75247]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Dec 06 12:36:07 user nova-compute[75247]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Dec 06 12:36:07 user nova-compute[75247]:     </cache>
Dec 06 12:36:07 user nova-compute[75247]:     <secmodel>
Dec 06 12:36:07 user nova-compute[75247]:       <model>apparmor</model>
Dec 06 12:36:07 user nova-compute[75247]:       <doi>0</doi>
Dec 06 12:36:07 user nova-compute[75247]:     </secmodel>
Dec 06 12:36:07 user nova-compute[75247]:     <secmodel>
Dec 06 12:36:07 user nova-compute[75247]:       <model>dac</model>
Dec 06 12:36:07 user nova-compute[75247]:       <doi>0</doi>
Dec 06 12:36:07 user nova-compute[75247]:       <baselabel type='kvm'>+64055:+108</baselabel>
Dec 06 12:36:07 user nova-compute[75247]:       <baselabel type='qemu'>+64055:+108</baselabel>
Dec 06 12:36:07 user nova-compute[75247]:     </secmodel>
Dec 06 12:36:07 user nova-compute[75247]:   </host>
Dec 06 12:36:07 user nova-compute[75247]:   <guest>
Dec 06 12:36:07 user nova-compute[75247]:     <os_type>hvm</os_type>
Dec 06 12:36:07 user nova-compute[75247]:     <arch name='alpha'>
Dec 06 12:36:07 user nova-compute[75247]:       <wordsize>64</wordsize>
Dec 06 12:36:07 user nova-compute[75247]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>clipper</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='qemu'/>
Dec 06 12:36:07 user nova-compute[75247]:     </arch>
Dec 06 12:36:07 user nova-compute[75247]:     <features>
Dec 06 12:36:07 user nova-compute[75247]:       <cpuselection/>
Dec 06 12:36:07 user nova-compute[75247]:       <deviceboot/>
Dec 06 12:36:07 user nova-compute[75247]:       <disksnapshot default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     </features>
Dec 06 12:36:07 user nova-compute[75247]:   </guest>
Dec 06 12:36:07 user nova-compute[75247]:   <guest>
Dec 06 12:36:07 user nova-compute[75247]:     <os_type>hvm</os_type>
Dec 06 12:36:07 user nova-compute[75247]:     <arch name='armv6l'>
Dec 06 12:36:07 user nova-compute[75247]:       <wordsize>32</wordsize>
Dec 06 12:36:07 user nova-compute[75247]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>integratorcp</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>borzoi</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>spitz</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>nuri</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>musca-b1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>versatileab</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>kzm</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>musca-a</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>smdkc210</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>sx1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>z2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>tosa</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>sabrelite</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>realview-eb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>n810</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>n800</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>versatilepb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>terrier</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mainstone</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>midway</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>musicpal</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>microbit</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>cubieboard</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>verdex</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>netduino2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>raspi2b</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>cheetah</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>highbank</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>akita</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>connex</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>collie</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>raspi0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='qemu'/>
Dec 06 12:36:07 user nova-compute[75247]:     </arch>
Dec 06 12:36:07 user nova-compute[75247]:     <features>
Dec 06 12:36:07 user nova-compute[75247]:       <cpuselection/>
Dec 06 12:36:07 user nova-compute[75247]:       <deviceboot/>
Dec 06 12:36:07 user nova-compute[75247]:       <disksnapshot default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     </features>
Dec 06 12:36:07 user nova-compute[75247]:   </guest>
Dec 06 12:36:07 user nova-compute[75247]:   <guest>
Dec 06 12:36:07 user nova-compute[75247]:     <os_type>hvm</os_type>
Dec 06 12:36:07 user nova-compute[75247]:     <arch name='armv7l'>
Dec 06 12:36:07 user nova-compute[75247]:       <wordsize>32</wordsize>
Dec 06 12:36:07 user nova-compute[75247]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>integratorcp</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>borzoi</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>spitz</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>nuri</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>musca-b1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>versatileab</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>kzm</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>musca-a</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>smdkc210</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>sx1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>z2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>tosa</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>sabrelite</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>realview-eb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>n810</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>n800</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>versatilepb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>terrier</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mainstone</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>midway</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>musicpal</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>microbit</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>cubieboard</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>verdex</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>netduino2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>raspi2b</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>cheetah</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>highbank</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>akita</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>connex</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>collie</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>raspi0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='qemu'/>
Dec 06 12:36:07 user nova-compute[75247]:     </arch>
Dec 06 12:36:07 user nova-compute[75247]:     <features>
Dec 06 12:36:07 user nova-compute[75247]:       <cpuselection/>
Dec 06 12:36:07 user nova-compute[75247]:       <deviceboot/>
Dec 06 12:36:07 user nova-compute[75247]:       <disksnapshot default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     </features>
Dec 06 12:36:07 user nova-compute[75247]:   </guest>
Dec 06 12:36:07 user nova-compute[75247]:   <guest>
Dec 06 12:36:07 user nova-compute[75247]:     <os_type>hvm</os_type>
Dec 06 12:36:07 user nova-compute[75247]:     <arch name='aarch64'>
Dec 06 12:36:07 user nova-compute[75247]:       <wordsize>64</wordsize>
Dec 06 12:36:07 user nova-compute[75247]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>integratorcp</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>borzoi</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>spitz</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>nuri</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>musca-b1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>versatileab</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>kzm</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>musca-a</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>smdkc210</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>sx1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>z2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>tosa</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>sabrelite</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>realview-eb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>sbsa-ref</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>n810</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>n800</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>versatilepb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>terrier</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mainstone</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>midway</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>musicpal</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>microbit</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>raspi3ap</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>cubieboard</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>verdex</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>netduino2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>raspi3b</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>raspi2b</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>cheetah</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>highbank</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>akita</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>connex</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>collie</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>raspi0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='qemu'/>
Dec 06 12:36:07 user nova-compute[75247]:     </arch>
Dec 06 12:36:07 user nova-compute[75247]:     <features>
Dec 06 12:36:07 user nova-compute[75247]:       <acpi default='on' toggle='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:       <cpuselection/>
Dec 06 12:36:07 user nova-compute[75247]:       <deviceboot/>
Dec 06 12:36:07 user nova-compute[75247]:       <disksnapshot default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     </features>
Dec 06 12:36:07 user nova-compute[75247]:   </guest>
Dec 06 12:36:07 user nova-compute[75247]:   <guest>
Dec 06 12:36:07 user nova-compute[75247]:     <os_type>hvm</os_type>
Dec 06 12:36:07 user nova-compute[75247]:     <arch name='cris'>
Dec 06 12:36:07 user nova-compute[75247]:       <wordsize>32</wordsize>
Dec 06 12:36:07 user nova-compute[75247]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>axis-dev88</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='qemu'/>
Dec 06 12:36:07 user nova-compute[75247]:     </arch>
Dec 06 12:36:07 user nova-compute[75247]:     <features>
Dec 06 12:36:07 user nova-compute[75247]:       <cpuselection/>
Dec 06 12:36:07 user nova-compute[75247]:       <deviceboot/>
Dec 06 12:36:07 user nova-compute[75247]:       <disksnapshot default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     </features>
Dec 06 12:36:07 user nova-compute[75247]:   </guest>
Dec 06 12:36:07 user nova-compute[75247]:   <guest>
Dec 06 12:36:07 user nova-compute[75247]:     <os_type>hvm</os_type>
Dec 06 12:36:07 user nova-compute[75247]:     <arch name='i686'>
Dec 06 12:36:07 user nova-compute[75247]:       <wordsize>32</wordsize>
Dec 06 12:36:07 user nova-compute[75247]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-artful</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>x-remote</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>isapc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-disco</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-impish</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-focal</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>microvm</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='qemu'/>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='kvm'/>
Dec 06 12:36:07 user nova-compute[75247]:     </arch>
Dec 06 12:36:07 user nova-compute[75247]:     <features>
Dec 06 12:36:07 user nova-compute[75247]:       <pae/>
Dec 06 12:36:07 user nova-compute[75247]:       <nonpae/>
Dec 06 12:36:07 user nova-compute[75247]:       <acpi default='on' toggle='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:       <apic default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:       <cpuselection/>
Dec 06 12:36:07 user nova-compute[75247]:       <deviceboot/>
Dec 06 12:36:07 user nova-compute[75247]:       <disksnapshot default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     </features>
Dec 06 12:36:07 user nova-compute[75247]:   </guest>
Dec 06 12:36:07 user nova-compute[75247]:   <guest>
Dec 06 12:36:07 user nova-compute[75247]:     <os_type>hvm</os_type>
Dec 06 12:36:07 user nova-compute[75247]:     <arch name='m68k'>
Dec 06 12:36:07 user nova-compute[75247]:       <wordsize>32</wordsize>
Dec 06 12:36:07 user nova-compute[75247]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mcf5208evb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>an5206</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>virt-6.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>q800</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>virt-6.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>next-cube</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>virt-6.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='qemu'/>
Dec 06 12:36:07 user nova-compute[75247]:     </arch>
Dec 06 12:36:07 user nova-compute[75247]:     <features>
Dec 06 12:36:07 user nova-compute[75247]:       <cpuselection/>
Dec 06 12:36:07 user nova-compute[75247]:       <deviceboot/>
Dec 06 12:36:07 user nova-compute[75247]:       <disksnapshot default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     </features>
Dec 06 12:36:07 user nova-compute[75247]:   </guest>
Dec 06 12:36:07 user nova-compute[75247]:   <guest>
Dec 06 12:36:07 user nova-compute[75247]:     <os_type>hvm</os_type>
Dec 06 12:36:07 user nova-compute[75247]:     <arch name='microblaze'>
Dec 06 12:36:07 user nova-compute[75247]:       <wordsize>32</wordsize>
Dec 06 12:36:07 user nova-compute[75247]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>petalogix-ml605</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='qemu'/>
Dec 06 12:36:07 user nova-compute[75247]:     </arch>
Dec 06 12:36:07 user nova-compute[75247]:     <features>
Dec 06 12:36:07 user nova-compute[75247]:       <cpuselection/>
Dec 06 12:36:07 user nova-compute[75247]:       <deviceboot/>
Dec 06 12:36:07 user nova-compute[75247]:       <disksnapshot default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     </features>
Dec 06 12:36:07 user nova-compute[75247]:   </guest>
Dec 06 12:36:07 user nova-compute[75247]:   <guest>
Dec 06 12:36:07 user nova-compute[75247]:     <os_type>hvm</os_type>
Dec 06 12:36:07 user nova-compute[75247]:     <arch name='microblazeel'>
Dec 06 12:36:07 user nova-compute[75247]:       <wordsize>32</wordsize>
Dec 06 12:36:07 user nova-compute[75247]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>petalogix-ml605</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='qemu'/>
Dec 06 12:36:07 user nova-compute[75247]:     </arch>
Dec 06 12:36:07 user nova-compute[75247]:     <features>
Dec 06 12:36:07 user nova-compute[75247]:       <cpuselection/>
Dec 06 12:36:07 user nova-compute[75247]:       <deviceboot/>
Dec 06 12:36:07 user nova-compute[75247]:       <disksnapshot default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     </features>
Dec 06 12:36:07 user nova-compute[75247]:   </guest>
Dec 06 12:36:07 user nova-compute[75247]:   <guest>
Dec 06 12:36:07 user nova-compute[75247]:     <os_type>hvm</os_type>
Dec 06 12:36:07 user nova-compute[75247]:     <arch name='mips'>
Dec 06 12:36:07 user nova-compute[75247]:       <wordsize>32</wordsize>
Dec 06 12:36:07 user nova-compute[75247]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='16'>malta</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mipssim</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='qemu'/>
Dec 06 12:36:07 user nova-compute[75247]:     </arch>
Dec 06 12:36:07 user nova-compute[75247]:     <features>
Dec 06 12:36:07 user nova-compute[75247]:       <cpuselection/>
Dec 06 12:36:07 user nova-compute[75247]:       <deviceboot/>
Dec 06 12:36:07 user nova-compute[75247]:       <disksnapshot default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     </features>
Dec 06 12:36:07 user nova-compute[75247]:   </guest>
Dec 06 12:36:07 user nova-compute[75247]:   <guest>
Dec 06 12:36:07 user nova-compute[75247]:     <os_type>hvm</os_type>
Dec 06 12:36:07 user nova-compute[75247]:     <arch name='mipsel'>
Dec 06 12:36:07 user nova-compute[75247]:       <wordsize>32</wordsize>
Dec 06 12:36:07 user nova-compute[75247]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='16'>malta</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mipssim</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='qemu'/>
Dec 06 12:36:07 user nova-compute[75247]:     </arch>
Dec 06 12:36:07 user nova-compute[75247]:     <features>
Dec 06 12:36:07 user nova-compute[75247]:       <cpuselection/>
Dec 06 12:36:07 user nova-compute[75247]:       <deviceboot/>
Dec 06 12:36:07 user nova-compute[75247]:       <disksnapshot default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     </features>
Dec 06 12:36:07 user nova-compute[75247]:   </guest>
Dec 06 12:36:07 user nova-compute[75247]:   <guest>
Dec 06 12:36:07 user nova-compute[75247]:     <os_type>hvm</os_type>
Dec 06 12:36:07 user nova-compute[75247]:     <arch name='mips64'>
Dec 06 12:36:07 user nova-compute[75247]:       <wordsize>64</wordsize>
Dec 06 12:36:07 user nova-compute[75247]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='16'>malta</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mipssim</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>pica61</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>magnum</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='qemu'/>
Dec 06 12:36:07 user nova-compute[75247]:     </arch>
Dec 06 12:36:07 user nova-compute[75247]:     <features>
Dec 06 12:36:07 user nova-compute[75247]:       <cpuselection/>
Dec 06 12:36:07 user nova-compute[75247]:       <deviceboot/>
Dec 06 12:36:07 user nova-compute[75247]:       <disksnapshot default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     </features>
Dec 06 12:36:07 user nova-compute[75247]:   </guest>
Dec 06 12:36:07 user nova-compute[75247]:   <guest>
Dec 06 12:36:07 user nova-compute[75247]:     <os_type>hvm</os_type>
Dec 06 12:36:07 user nova-compute[75247]:     <arch name='mips64el'>
Dec 06 12:36:07 user nova-compute[75247]:       <wordsize>64</wordsize>
Dec 06 12:36:07 user nova-compute[75247]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='16'>malta</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='16'>loongson3-virt</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mipssim</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>pica61</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>magnum</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='16'>boston</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>fuloong2e</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='qemu'/>
Dec 06 12:36:07 user nova-compute[75247]:     </arch>
Dec 06 12:36:07 user nova-compute[75247]:     <features>
Dec 06 12:36:07 user nova-compute[75247]:       <cpuselection/>
Dec 06 12:36:07 user nova-compute[75247]:       <deviceboot/>
Dec 06 12:36:07 user nova-compute[75247]:       <disksnapshot default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     </features>
Dec 06 12:36:07 user nova-compute[75247]:   </guest>
Dec 06 12:36:07 user nova-compute[75247]:   <guest>
Dec 06 12:36:07 user nova-compute[75247]:     <os_type>hvm</os_type>
Dec 06 12:36:07 user nova-compute[75247]:     <arch name='ppc'>
Dec 06 12:36:07 user nova-compute[75247]:       <wordsize>32</wordsize>
Dec 06 12:36:07 user nova-compute[75247]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>g3beige</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mac99</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='32'>ppce500</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>pegasos2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>sam460ex</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>bamboo</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>40p</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>ref405ep</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>taihu</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='qemu'/>
Dec 06 12:36:07 user nova-compute[75247]:     </arch>
Dec 06 12:36:07 user nova-compute[75247]:     <features>
Dec 06 12:36:07 user nova-compute[75247]:       <cpuselection/>
Dec 06 12:36:07 user nova-compute[75247]:       <deviceboot/>
Dec 06 12:36:07 user nova-compute[75247]:       <disksnapshot default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     </features>
Dec 06 12:36:07 user nova-compute[75247]:   </guest>
Dec 06 12:36:07 user nova-compute[75247]:   <guest>
Dec 06 12:36:07 user nova-compute[75247]:     <os_type>hvm</os_type>
Dec 06 12:36:07 user nova-compute[75247]:     <arch name='ppc64'>
Dec 06 12:36:07 user nova-compute[75247]:       <wordsize>64</wordsize>
Dec 06 12:36:07 user nova-compute[75247]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2048'>powernv9</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>taihu</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2048'>powernv10</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='32'>ppce500</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>40p</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>pegasos2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>bamboo</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>g3beige</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mac99</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>sam460ex</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>ref405ep</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2048'>powernv8</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='qemu'/>
Dec 06 12:36:07 user nova-compute[75247]:     </arch>
Dec 06 12:36:07 user nova-compute[75247]:     <features>
Dec 06 12:36:07 user nova-compute[75247]:       <cpuselection/>
Dec 06 12:36:07 user nova-compute[75247]:       <deviceboot/>
Dec 06 12:36:07 user nova-compute[75247]:       <disksnapshot default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     </features>
Dec 06 12:36:07 user nova-compute[75247]:   </guest>
Dec 06 12:36:07 user nova-compute[75247]:   <guest>
Dec 06 12:36:07 user nova-compute[75247]:     <os_type>hvm</os_type>
Dec 06 12:36:07 user nova-compute[75247]:     <arch name='ppc64le'>
Dec 06 12:36:07 user nova-compute[75247]:       <wordsize>64</wordsize>
Dec 06 12:36:07 user nova-compute[75247]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2048'>powernv9</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>taihu</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2048'>powernv10</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='32'>ppce500</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>40p</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>pegasos2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>bamboo</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>g3beige</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>mac99</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>sam460ex</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>ref405ep</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2048'>powernv8</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='qemu'/>
Dec 06 12:36:07 user nova-compute[75247]:     </arch>
Dec 06 12:36:07 user nova-compute[75247]:     <features>
Dec 06 12:36:07 user nova-compute[75247]:       <cpuselection/>
Dec 06 12:36:07 user nova-compute[75247]:       <deviceboot/>
Dec 06 12:36:07 user nova-compute[75247]:       <disksnapshot default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     </features>
Dec 06 12:36:07 user nova-compute[75247]:   </guest>
Dec 06 12:36:07 user nova-compute[75247]:   <guest>
Dec 06 12:36:07 user nova-compute[75247]:     <os_type>hvm</os_type>
Dec 06 12:36:07 user nova-compute[75247]:     <arch name='riscv32'>
Dec 06 12:36:07 user nova-compute[75247]:       <wordsize>32</wordsize>
Dec 06 12:36:07 user nova-compute[75247]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='8'>spike</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>opentitan</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='5'>sifive_u</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>sifive_e</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='8'>virt</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='qemu'/>
Dec 06 12:36:07 user nova-compute[75247]:     </arch>
Dec 06 12:36:07 user nova-compute[75247]:     <features>
Dec 06 12:36:07 user nova-compute[75247]:       <cpuselection/>
Dec 06 12:36:07 user nova-compute[75247]:       <deviceboot/>
Dec 06 12:36:07 user nova-compute[75247]:       <disksnapshot default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     </features>
Dec 06 12:36:07 user nova-compute[75247]:   </guest>
Dec 06 12:36:07 user nova-compute[75247]:   <guest>
Dec 06 12:36:07 user nova-compute[75247]:     <os_type>hvm</os_type>
Dec 06 12:36:07 user nova-compute[75247]:     <arch name='riscv64'>
Dec 06 12:36:07 user nova-compute[75247]:       <wordsize>64</wordsize>
Dec 06 12:36:07 user nova-compute[75247]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='8'>spike</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='5'>sifive_u</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>shakti_c</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>sifive_e</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='8'>virt</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='qemu'/>
Dec 06 12:36:07 user nova-compute[75247]:     </arch>
Dec 06 12:36:07 user nova-compute[75247]:     <features>
Dec 06 12:36:07 user nova-compute[75247]:       <cpuselection/>
Dec 06 12:36:07 user nova-compute[75247]:       <deviceboot/>
Dec 06 12:36:07 user nova-compute[75247]:       <disksnapshot default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     </features>
Dec 06 12:36:07 user nova-compute[75247]:   </guest>
Dec 06 12:36:07 user nova-compute[75247]:   <guest>
Dec 06 12:36:07 user nova-compute[75247]:     <os_type>hvm</os_type>
Dec 06 12:36:07 user nova-compute[75247]:     <arch name='s390x'>
Dec 06 12:36:07 user nova-compute[75247]:       <wordsize>64</wordsize>
Dec 06 12:36:07 user nova-compute[75247]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='qemu'/>
Dec 06 12:36:07 user nova-compute[75247]:     </arch>
Dec 06 12:36:07 user nova-compute[75247]:     <features>
Dec 06 12:36:07 user nova-compute[75247]:       <cpuselection/>
Dec 06 12:36:07 user nova-compute[75247]:       <deviceboot/>
Dec 06 12:36:07 user nova-compute[75247]:       <disksnapshot default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     </features>
Dec 06 12:36:07 user nova-compute[75247]:   </guest>
Dec 06 12:36:07 user nova-compute[75247]:   <guest>
Dec 06 12:36:07 user nova-compute[75247]:     <os_type>hvm</os_type>
Dec 06 12:36:07 user nova-compute[75247]:     <arch name='sh4'>
Dec 06 12:36:07 user nova-compute[75247]:       <wordsize>32</wordsize>
Dec 06 12:36:07 user nova-compute[75247]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>shix</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>r2d</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='qemu'/>
Dec 06 12:36:07 user nova-compute[75247]:     </arch>
Dec 06 12:36:07 user nova-compute[75247]:     <features>
Dec 06 12:36:07 user nova-compute[75247]:       <cpuselection/>
Dec 06 12:36:07 user nova-compute[75247]:       <deviceboot/>
Dec 06 12:36:07 user nova-compute[75247]:       <disksnapshot default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     </features>
Dec 06 12:36:07 user nova-compute[75247]:   </guest>
Dec 06 12:36:07 user nova-compute[75247]:   <guest>
Dec 06 12:36:07 user nova-compute[75247]:     <os_type>hvm</os_type>
Dec 06 12:36:07 user nova-compute[75247]:     <arch name='sh4eb'>
Dec 06 12:36:07 user nova-compute[75247]:       <wordsize>64</wordsize>
Dec 06 12:36:07 user nova-compute[75247]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>shix</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>r2d</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='qemu'/>
Dec 06 12:36:07 user nova-compute[75247]:     </arch>
Dec 06 12:36:07 user nova-compute[75247]:     <features>
Dec 06 12:36:07 user nova-compute[75247]:       <cpuselection/>
Dec 06 12:36:07 user nova-compute[75247]:       <deviceboot/>
Dec 06 12:36:07 user nova-compute[75247]:       <disksnapshot default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     </features>
Dec 06 12:36:07 user nova-compute[75247]:   </guest>
Dec 06 12:36:07 user nova-compute[75247]:   <guest>
Dec 06 12:36:07 user nova-compute[75247]:     <os_type>hvm</os_type>
Dec 06 12:36:07 user nova-compute[75247]:     <arch name='sparc'>
Dec 06 12:36:07 user nova-compute[75247]:       <wordsize>32</wordsize>
Dec 06 12:36:07 user nova-compute[75247]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>SS-5</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>SS-20</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>LX</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>SPARCClassic</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>leon3_generic</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>SPARCbook</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>SS-4</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>SS-600MP</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>SS-10</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>Voyager</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='qemu'/>
Dec 06 12:36:07 user nova-compute[75247]:     </arch>
Dec 06 12:36:07 user nova-compute[75247]:     <features>
Dec 06 12:36:07 user nova-compute[75247]:       <cpuselection/>
Dec 06 12:36:07 user nova-compute[75247]:       <deviceboot/>
Dec 06 12:36:07 user nova-compute[75247]:       <disksnapshot default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     </features>
Dec 06 12:36:07 user nova-compute[75247]:   </guest>
Dec 06 12:36:07 user nova-compute[75247]:   <guest>
Dec 06 12:36:07 user nova-compute[75247]:     <os_type>hvm</os_type>
Dec 06 12:36:07 user nova-compute[75247]:     <arch name='sparc64'>
Dec 06 12:36:07 user nova-compute[75247]:       <wordsize>64</wordsize>
Dec 06 12:36:07 user nova-compute[75247]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>sun4u</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>niagara</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>sun4v</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='qemu'/>
Dec 06 12:36:07 user nova-compute[75247]:     </arch>
Dec 06 12:36:07 user nova-compute[75247]:     <features>
Dec 06 12:36:07 user nova-compute[75247]:       <cpuselection/>
Dec 06 12:36:07 user nova-compute[75247]:       <deviceboot/>
Dec 06 12:36:07 user nova-compute[75247]:       <disksnapshot default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     </features>
Dec 06 12:36:07 user nova-compute[75247]:   </guest>
Dec 06 12:36:07 user nova-compute[75247]:   <guest>
Dec 06 12:36:07 user nova-compute[75247]:     <os_type>hvm</os_type>
Dec 06 12:36:07 user nova-compute[75247]:     <arch name='x86_64'>
Dec 06 12:36:07 user nova-compute[75247]:       <wordsize>64</wordsize>
Dec 06 12:36:07 user nova-compute[75247]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-artful</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>x-remote</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='1'>isapc</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-disco</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-impish</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-focal</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>microvm</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='qemu'/>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='kvm'/>
Dec 06 12:36:07 user nova-compute[75247]:     </arch>
Dec 06 12:36:07 user nova-compute[75247]:     <features>
Dec 06 12:36:07 user nova-compute[75247]:       <acpi default='on' toggle='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:       <apic default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:       <cpuselection/>
Dec 06 12:36:07 user nova-compute[75247]:       <deviceboot/>
Dec 06 12:36:07 user nova-compute[75247]:       <disksnapshot default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     </features>
Dec 06 12:36:07 user nova-compute[75247]:   </guest>
Dec 06 12:36:07 user nova-compute[75247]:   <guest>
Dec 06 12:36:07 user nova-compute[75247]:     <os_type>hvm</os_type>
Dec 06 12:36:07 user nova-compute[75247]:     <arch name='xtensa'>
Dec 06 12:36:07 user nova-compute[75247]:       <wordsize>32</wordsize>
Dec 06 12:36:07 user nova-compute[75247]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>sim</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='32'>kc705</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='32'>ml605</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='32'>ml605-nommu</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='32'>virt</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='32'>lx60-nommu</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='32'>lx200</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='32'>lx200-nommu</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='32'>lx60</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='32'>kc705-nommu</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='qemu'/>
Dec 06 12:36:07 user nova-compute[75247]:     </arch>
Dec 06 12:36:07 user nova-compute[75247]:     <features>
Dec 06 12:36:07 user nova-compute[75247]:       <cpuselection/>
Dec 06 12:36:07 user nova-compute[75247]:       <deviceboot/>
Dec 06 12:36:07 user nova-compute[75247]:       <disksnapshot default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     </features>
Dec 06 12:36:07 user nova-compute[75247]:   </guest>
Dec 06 12:36:07 user nova-compute[75247]:   <guest>
Dec 06 12:36:07 user nova-compute[75247]:     <os_type>hvm</os_type>
Dec 06 12:36:07 user nova-compute[75247]:     <arch name='xtensaeb'>
Dec 06 12:36:07 user nova-compute[75247]:       <wordsize>32</wordsize>
Dec 06 12:36:07 user nova-compute[75247]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='4'>sim</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='32'>kc705</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='32'>ml605</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='32'>ml605-nommu</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='32'>virt</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='32'>lx60-nommu</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='32'>lx200</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='32'>lx200-nommu</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='32'>lx60</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <machine maxCpus='32'>kc705-nommu</machine>
Dec 06 12:36:07 user nova-compute[75247]:       <domain type='qemu'/>
Dec 06 12:36:07 user nova-compute[75247]:     </arch>
Dec 06 12:36:07 user nova-compute[75247]:     <features>
Dec 06 12:36:07 user nova-compute[75247]:       <cpuselection/>
Dec 06 12:36:07 user nova-compute[75247]:       <deviceboot/>
Dec 06 12:36:07 user nova-compute[75247]:       <disksnapshot default='on' toggle='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     </features>
Dec 06 12:36:07 user nova-compute[75247]:   </guest>
Dec 06 12:36:07 user nova-compute[75247]: </capabilities>
Dec 06 12:36:07 user nova-compute[75247]: 
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'q35', 'pc', 'ubuntu'} {{(pid=75247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Dec 06 12:36:07 user nova-compute[75247]: <domainCapabilities>
Dec 06 12:36:07 user nova-compute[75247]:   <path>/usr/bin/qemu-system-i386</path>
Dec 06 12:36:07 user nova-compute[75247]:   <domain>kvm</domain>
Dec 06 12:36:07 user nova-compute[75247]:   <machine>pc-q35-jammy</machine>
Dec 06 12:36:07 user nova-compute[75247]:   <arch>i686</arch>
Dec 06 12:36:07 user nova-compute[75247]:   <vcpu max='288'/>
Dec 06 12:36:07 user nova-compute[75247]:   <iothreads supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:   <os supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:     <enum name='firmware'/>
Dec 06 12:36:07 user nova-compute[75247]:     <loader supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='type'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>rom</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>pflash</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='readonly'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>yes</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>no</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='secure'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>no</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </loader>
Dec 06 12:36:07 user nova-compute[75247]:   </os>
Dec 06 12:36:07 user nova-compute[75247]:   <cpu>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='host-passthrough' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='hostPassthroughMigratable'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>off</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='maximum' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='maximumMigratable'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>on</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>off</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='host-model' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <vendor>Intel</vendor>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ss'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='vmx'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='pcid'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='hypervisor'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='arat'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='tsc_adjust'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='umip'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='md-clear'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='stibp'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='arch-capabilities'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ssbd'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ibpb'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ibrs'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='amd-stibp'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='amd-ssbd'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='disable' name='erms'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='disable' name='xsaveopt'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='disable' name='lm'/>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='custom' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>qemu64</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>qemu32</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>phenom</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>pentium3</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>pentium2</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>pentium</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>n270</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>kvm64</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>kvm32</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>coreduo</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>core2duo</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>athlon</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Westmere-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Westmere</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Snowridge</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Server</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Client</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>SandyBridge</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Penryn</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G5</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G4</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G3</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G2</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G1</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Nehalem-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Nehalem</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>IvyBridge</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Icelake-Server</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC-Rome</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC-Milan</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC-IBPB</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Dhyana</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Cooperlake</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Conroe</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Cascadelake-Server</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>486</model>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:   </cpu>
Dec 06 12:36:07 user nova-compute[75247]:   <memoryBacking supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:     <enum name='sourceType'>
Dec 06 12:36:07 user nova-compute[75247]:       <value>file</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>anonymous</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>memfd</value>
Dec 06 12:36:07 user nova-compute[75247]:     </enum>
Dec 06 12:36:07 user nova-compute[75247]:   </memoryBacking>
Dec 06 12:36:07 user nova-compute[75247]:   <devices>
Dec 06 12:36:07 user nova-compute[75247]:     <disk supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='diskDevice'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>disk</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>cdrom</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>floppy</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>lun</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='bus'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>fdc</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>scsi</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>usb</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>sata</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='model'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-non-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </disk>
Dec 06 12:36:07 user nova-compute[75247]:     <graphics supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='type'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>sdl</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>vnc</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>spice</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>egl-headless</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </graphics>
Dec 06 12:36:07 user nova-compute[75247]:     <video supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='modelType'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>vga</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>cirrus</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>vmvga</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>qxl</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>none</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>bochs</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>ramfb</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </video>
Dec 06 12:36:07 user nova-compute[75247]:     <hostdev supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='mode'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>subsystem</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='startupPolicy'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>default</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>mandatory</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>requisite</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>optional</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='subsysType'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>usb</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>pci</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>scsi</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='capsType'/>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='pciBackend'/>
Dec 06 12:36:07 user nova-compute[75247]:     </hostdev>
Dec 06 12:36:07 user nova-compute[75247]:     <rng supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='model'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-non-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='backendModel'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>random</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>egd</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>builtin</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </rng>
Dec 06 12:36:07 user nova-compute[75247]:     <filesystem supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='driverType'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>path</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>handle</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtiofs</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </filesystem>
Dec 06 12:36:07 user nova-compute[75247]:     <tpm supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='model'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>tpm-tis</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>tpm-crb</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='backendModel'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>passthrough</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>emulator</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </tpm>
Dec 06 12:36:07 user nova-compute[75247]:   </devices>
Dec 06 12:36:07 user nova-compute[75247]:   <features>
Dec 06 12:36:07 user nova-compute[75247]:     <gic supported='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     <vmcoreinfo supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <genid supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <backingStoreInput supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <backup supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <sev supported='no'/>
Dec 06 12:36:07 user nova-compute[75247]:   </features>
Dec 06 12:36:07 user nova-compute[75247]: </domainCapabilities>
Dec 06 12:36:07 user nova-compute[75247]:  {{(pid=75247) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Dec 06 12:36:07 user nova-compute[75247]: <domainCapabilities>
Dec 06 12:36:07 user nova-compute[75247]:   <path>/usr/bin/qemu-system-i386</path>
Dec 06 12:36:07 user nova-compute[75247]:   <domain>kvm</domain>
Dec 06 12:36:07 user nova-compute[75247]:   <machine>pc-q35-6.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:   <arch>i686</arch>
Dec 06 12:36:07 user nova-compute[75247]:   <vcpu max='288'/>
Dec 06 12:36:07 user nova-compute[75247]:   <iothreads supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:   <os supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:     <enum name='firmware'/>
Dec 06 12:36:07 user nova-compute[75247]:     <loader supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='type'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>rom</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>pflash</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='readonly'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>yes</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>no</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='secure'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>no</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </loader>
Dec 06 12:36:07 user nova-compute[75247]:   </os>
Dec 06 12:36:07 user nova-compute[75247]:   <cpu>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='host-passthrough' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='hostPassthroughMigratable'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>off</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='maximum' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='maximumMigratable'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>on</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>off</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='host-model' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <vendor>Intel</vendor>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ss'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='vmx'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='pcid'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='hypervisor'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='arat'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='tsc_adjust'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='umip'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='md-clear'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='stibp'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='arch-capabilities'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ssbd'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ibpb'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ibrs'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='amd-stibp'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='amd-ssbd'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='disable' name='erms'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='disable' name='xsaveopt'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='disable' name='lm'/>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='custom' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>qemu64</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>qemu32</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>phenom</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>pentium3</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>pentium2</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>pentium</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>n270</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>kvm64</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>kvm32</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>coreduo</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>core2duo</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>athlon</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Westmere-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Westmere</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Snowridge</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Server</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Client</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>SandyBridge</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Penryn</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G5</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G4</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G3</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G2</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G1</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Nehalem-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Nehalem</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>IvyBridge</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Icelake-Server</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC-Rome</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC-Milan</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC-IBPB</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Dhyana</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Cooperlake</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Conroe</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Cascadelake-Server</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>486</model>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:   </cpu>
Dec 06 12:36:07 user nova-compute[75247]:   <memoryBacking supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:     <enum name='sourceType'>
Dec 06 12:36:07 user nova-compute[75247]:       <value>file</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>anonymous</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>memfd</value>
Dec 06 12:36:07 user nova-compute[75247]:     </enum>
Dec 06 12:36:07 user nova-compute[75247]:   </memoryBacking>
Dec 06 12:36:07 user nova-compute[75247]:   <devices>
Dec 06 12:36:07 user nova-compute[75247]:     <disk supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='diskDevice'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>disk</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>cdrom</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>floppy</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>lun</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='bus'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>fdc</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>scsi</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>usb</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>sata</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='model'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-non-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </disk>
Dec 06 12:36:07 user nova-compute[75247]:     <graphics supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='type'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>sdl</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>vnc</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>spice</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>egl-headless</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </graphics>
Dec 06 12:36:07 user nova-compute[75247]:     <video supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='modelType'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>vga</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>cirrus</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>vmvga</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>qxl</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>none</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>bochs</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>ramfb</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </video>
Dec 06 12:36:07 user nova-compute[75247]:     <hostdev supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='mode'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>subsystem</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='startupPolicy'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>default</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>mandatory</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>requisite</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>optional</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='subsysType'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>usb</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>pci</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>scsi</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='capsType'/>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='pciBackend'/>
Dec 06 12:36:07 user nova-compute[75247]:     </hostdev>
Dec 06 12:36:07 user nova-compute[75247]:     <rng supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='model'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-non-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='backendModel'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>random</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>egd</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>builtin</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </rng>
Dec 06 12:36:07 user nova-compute[75247]:     <filesystem supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='driverType'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>path</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>handle</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtiofs</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </filesystem>
Dec 06 12:36:07 user nova-compute[75247]:     <tpm supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='model'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>tpm-tis</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>tpm-crb</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='backendModel'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>passthrough</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>emulator</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </tpm>
Dec 06 12:36:07 user nova-compute[75247]:   </devices>
Dec 06 12:36:07 user nova-compute[75247]:   <features>
Dec 06 12:36:07 user nova-compute[75247]:     <gic supported='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     <vmcoreinfo supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <genid supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <backingStoreInput supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <backup supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <sev supported='no'/>
Dec 06 12:36:07 user nova-compute[75247]:   </features>
Dec 06 12:36:07 user nova-compute[75247]: </domainCapabilities>
Dec 06 12:36:07 user nova-compute[75247]:  {{(pid=75247) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Dec 06 12:36:07 user nova-compute[75247]: <domainCapabilities>
Dec 06 12:36:07 user nova-compute[75247]:   <path>/usr/bin/qemu-system-i386</path>
Dec 06 12:36:07 user nova-compute[75247]:   <domain>kvm</domain>
Dec 06 12:36:07 user nova-compute[75247]:   <machine>pc-i440fx-6.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:   <arch>i686</arch>
Dec 06 12:36:07 user nova-compute[75247]:   <vcpu max='255'/>
Dec 06 12:36:07 user nova-compute[75247]:   <iothreads supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:   <os supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:     <enum name='firmware'/>
Dec 06 12:36:07 user nova-compute[75247]:     <loader supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='type'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>rom</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>pflash</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='readonly'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>yes</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>no</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='secure'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>no</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </loader>
Dec 06 12:36:07 user nova-compute[75247]:   </os>
Dec 06 12:36:07 user nova-compute[75247]:   <cpu>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='host-passthrough' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='hostPassthroughMigratable'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>off</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='maximum' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='maximumMigratable'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>on</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>off</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='host-model' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <vendor>Intel</vendor>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ss'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='vmx'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='pcid'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='hypervisor'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='arat'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='tsc_adjust'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='umip'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='md-clear'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='stibp'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='arch-capabilities'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ssbd'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ibpb'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ibrs'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='amd-stibp'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='amd-ssbd'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='disable' name='erms'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='disable' name='xsaveopt'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='disable' name='lm'/>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='custom' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>qemu64</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>qemu32</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>phenom</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>pentium3</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>pentium2</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>pentium</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>n270</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>kvm64</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>kvm32</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>coreduo</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>core2duo</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>athlon</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Westmere-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Westmere</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Snowridge</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Server</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Client</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>SandyBridge</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Penryn</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G5</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G4</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G3</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G2</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G1</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Nehalem-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Nehalem</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>IvyBridge</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Icelake-Server</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC-Rome</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC-Milan</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC-IBPB</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Dhyana</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Cooperlake</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Conroe</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Cascadelake-Server</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>486</model>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:   </cpu>
Dec 06 12:36:07 user nova-compute[75247]:   <memoryBacking supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:     <enum name='sourceType'>
Dec 06 12:36:07 user nova-compute[75247]:       <value>file</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>anonymous</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>memfd</value>
Dec 06 12:36:07 user nova-compute[75247]:     </enum>
Dec 06 12:36:07 user nova-compute[75247]:   </memoryBacking>
Dec 06 12:36:07 user nova-compute[75247]:   <devices>
Dec 06 12:36:07 user nova-compute[75247]:     <disk supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='diskDevice'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>disk</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>cdrom</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>floppy</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>lun</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='bus'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>ide</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>fdc</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>scsi</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>usb</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>sata</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='model'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-non-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </disk>
Dec 06 12:36:07 user nova-compute[75247]:     <graphics supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='type'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>sdl</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>vnc</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>spice</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>egl-headless</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </graphics>
Dec 06 12:36:07 user nova-compute[75247]:     <video supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='modelType'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>vga</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>cirrus</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>vmvga</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>qxl</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>none</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>bochs</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>ramfb</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </video>
Dec 06 12:36:07 user nova-compute[75247]:     <hostdev supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='mode'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>subsystem</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='startupPolicy'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>default</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>mandatory</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>requisite</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>optional</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='subsysType'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>usb</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>pci</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>scsi</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='capsType'/>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='pciBackend'/>
Dec 06 12:36:07 user nova-compute[75247]:     </hostdev>
Dec 06 12:36:07 user nova-compute[75247]:     <rng supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='model'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-non-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='backendModel'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>random</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>egd</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>builtin</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </rng>
Dec 06 12:36:07 user nova-compute[75247]:     <filesystem supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='driverType'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>path</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>handle</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtiofs</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </filesystem>
Dec 06 12:36:07 user nova-compute[75247]:     <tpm supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='model'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>tpm-tis</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>tpm-crb</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='backendModel'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>passthrough</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>emulator</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </tpm>
Dec 06 12:36:07 user nova-compute[75247]:   </devices>
Dec 06 12:36:07 user nova-compute[75247]:   <features>
Dec 06 12:36:07 user nova-compute[75247]:     <gic supported='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     <vmcoreinfo supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <genid supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <backingStoreInput supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <backup supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <sev supported='no'/>
Dec 06 12:36:07 user nova-compute[75247]:   </features>
Dec 06 12:36:07 user nova-compute[75247]: </domainCapabilities>
Dec 06 12:36:07 user nova-compute[75247]:  {{(pid=75247) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Dec 06 12:36:07 user nova-compute[75247]: <domainCapabilities>
Dec 06 12:36:07 user nova-compute[75247]:   <path>/usr/bin/qemu-system-i386</path>
Dec 06 12:36:07 user nova-compute[75247]:   <domain>kvm</domain>
Dec 06 12:36:07 user nova-compute[75247]:   <machine>pc-i440fx-jammy</machine>
Dec 06 12:36:07 user nova-compute[75247]:   <arch>i686</arch>
Dec 06 12:36:07 user nova-compute[75247]:   <vcpu max='255'/>
Dec 06 12:36:07 user nova-compute[75247]:   <iothreads supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:   <os supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:     <enum name='firmware'/>
Dec 06 12:36:07 user nova-compute[75247]:     <loader supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='type'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>rom</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>pflash</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='readonly'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>yes</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>no</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='secure'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>no</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </loader>
Dec 06 12:36:07 user nova-compute[75247]:   </os>
Dec 06 12:36:07 user nova-compute[75247]:   <cpu>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='host-passthrough' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='hostPassthroughMigratable'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>off</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='maximum' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='maximumMigratable'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>on</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>off</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='host-model' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <vendor>Intel</vendor>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ss'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='vmx'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='pcid'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='hypervisor'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='arat'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='tsc_adjust'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='umip'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='md-clear'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='stibp'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='arch-capabilities'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ssbd'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ibpb'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ibrs'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='amd-stibp'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='amd-ssbd'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='disable' name='erms'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='disable' name='xsaveopt'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='disable' name='lm'/>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='custom' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>qemu64</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>qemu32</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>phenom</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>pentium3</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>pentium2</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>pentium</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>n270</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>kvm64</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>kvm32</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>coreduo</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>core2duo</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>athlon</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Westmere-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Westmere</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Snowridge</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Server</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Client</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>SandyBridge</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Penryn</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G5</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G4</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G3</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G2</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G1</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Nehalem-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Nehalem</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>IvyBridge</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Icelake-Server</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC-Rome</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC-Milan</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC-IBPB</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Dhyana</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Cooperlake</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Conroe</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Cascadelake-Server</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>486</model>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:   </cpu>
Dec 06 12:36:07 user nova-compute[75247]:   <memoryBacking supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:     <enum name='sourceType'>
Dec 06 12:36:07 user nova-compute[75247]:       <value>file</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>anonymous</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>memfd</value>
Dec 06 12:36:07 user nova-compute[75247]:     </enum>
Dec 06 12:36:07 user nova-compute[75247]:   </memoryBacking>
Dec 06 12:36:07 user nova-compute[75247]:   <devices>
Dec 06 12:36:07 user nova-compute[75247]:     <disk supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='diskDevice'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>disk</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>cdrom</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>floppy</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>lun</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='bus'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>ide</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>fdc</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>scsi</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>usb</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>sata</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='model'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-non-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </disk>
Dec 06 12:36:07 user nova-compute[75247]:     <graphics supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='type'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>sdl</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>vnc</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>spice</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>egl-headless</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </graphics>
Dec 06 12:36:07 user nova-compute[75247]:     <video supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='modelType'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>vga</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>cirrus</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>vmvga</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>qxl</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>none</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>bochs</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>ramfb</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </video>
Dec 06 12:36:07 user nova-compute[75247]:     <hostdev supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='mode'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>subsystem</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='startupPolicy'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>default</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>mandatory</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>requisite</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>optional</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='subsysType'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>usb</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>pci</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>scsi</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='capsType'/>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='pciBackend'/>
Dec 06 12:36:07 user nova-compute[75247]:     </hostdev>
Dec 06 12:36:07 user nova-compute[75247]:     <rng supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='model'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-non-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='backendModel'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>random</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>egd</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>builtin</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </rng>
Dec 06 12:36:07 user nova-compute[75247]:     <filesystem supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='driverType'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>path</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>handle</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtiofs</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </filesystem>
Dec 06 12:36:07 user nova-compute[75247]:     <tpm supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='model'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>tpm-tis</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>tpm-crb</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='backendModel'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>passthrough</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>emulator</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </tpm>
Dec 06 12:36:07 user nova-compute[75247]:   </devices>
Dec 06 12:36:07 user nova-compute[75247]:   <features>
Dec 06 12:36:07 user nova-compute[75247]:     <gic supported='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     <vmcoreinfo supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <genid supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <backingStoreInput supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <backup supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <sev supported='no'/>
Dec 06 12:36:07 user nova-compute[75247]:   </features>
Dec 06 12:36:07 user nova-compute[75247]: </domainCapabilities>
Dec 06 12:36:07 user nova-compute[75247]:  {{(pid=75247) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'q35', 'pc', 'ubuntu'} {{(pid=75247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Dec 06 12:36:07 user nova-compute[75247]: <domainCapabilities>
Dec 06 12:36:07 user nova-compute[75247]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 06 12:36:07 user nova-compute[75247]:   <domain>kvm</domain>
Dec 06 12:36:07 user nova-compute[75247]:   <machine>pc-q35-jammy</machine>
Dec 06 12:36:07 user nova-compute[75247]:   <arch>x86_64</arch>
Dec 06 12:36:07 user nova-compute[75247]:   <vcpu max='288'/>
Dec 06 12:36:07 user nova-compute[75247]:   <iothreads supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:   <os supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:     <enum name='firmware'>
Dec 06 12:36:07 user nova-compute[75247]:       <value>efi</value>
Dec 06 12:36:07 user nova-compute[75247]:     </enum>
Dec 06 12:36:07 user nova-compute[75247]:     <loader supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='type'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>rom</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>pflash</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='readonly'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>yes</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>no</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='secure'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>yes</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>no</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </loader>
Dec 06 12:36:07 user nova-compute[75247]:   </os>
Dec 06 12:36:07 user nova-compute[75247]:   <cpu>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='host-passthrough' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='hostPassthroughMigratable'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>on</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>off</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='maximum' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='maximumMigratable'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>on</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>off</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='host-model' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <vendor>Intel</vendor>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ss'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='vmx'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='pcid'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='hypervisor'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='arat'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='tsc_adjust'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='umip'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='md-clear'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='stibp'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='arch-capabilities'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ssbd'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='invtsc'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ibpb'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ibrs'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='amd-stibp'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='amd-ssbd'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='rsba'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='pschange-mc-no'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='disable' name='erms'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='disable' name='xsaveopt'/>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='custom' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>qemu64</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>qemu32</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>phenom</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>pentium3</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>pentium2</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>pentium</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>n270</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>kvm64</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>kvm32</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>coreduo</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>core2duo</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>athlon</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Westmere-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Westmere</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Snowridge</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Server</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Client</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>SandyBridge</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Penryn</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G5</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G4</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G3</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G2</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Opteron_G1</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Nehalem</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>IvyBridge</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Icelake-Server</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC-Rome</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC-Milan</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC-IBPB</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Dhyana</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Cooperlake</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Conroe</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Cascadelake-Server</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>486</model>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:   </cpu>
Dec 06 12:36:07 user nova-compute[75247]:   <memoryBacking supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:     <enum name='sourceType'>
Dec 06 12:36:07 user nova-compute[75247]:       <value>file</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>anonymous</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>memfd</value>
Dec 06 12:36:07 user nova-compute[75247]:     </enum>
Dec 06 12:36:07 user nova-compute[75247]:   </memoryBacking>
Dec 06 12:36:07 user nova-compute[75247]:   <devices>
Dec 06 12:36:07 user nova-compute[75247]:     <disk supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='diskDevice'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>disk</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>cdrom</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>floppy</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>lun</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='bus'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>fdc</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>scsi</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>usb</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>sata</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='model'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-non-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </disk>
Dec 06 12:36:07 user nova-compute[75247]:     <graphics supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='type'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>sdl</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>vnc</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>spice</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>egl-headless</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </graphics>
Dec 06 12:36:07 user nova-compute[75247]:     <video supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='modelType'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>vga</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>cirrus</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>vmvga</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>qxl</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>none</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>bochs</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>ramfb</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </video>
Dec 06 12:36:07 user nova-compute[75247]:     <hostdev supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='mode'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>subsystem</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='startupPolicy'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>default</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>mandatory</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>requisite</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>optional</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='subsysType'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>usb</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>pci</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>scsi</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='capsType'/>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='pciBackend'/>
Dec 06 12:36:07 user nova-compute[75247]:     </hostdev>
Dec 06 12:36:07 user nova-compute[75247]:     <rng supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='model'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-non-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='backendModel'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>random</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>egd</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>builtin</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </rng>
Dec 06 12:36:07 user nova-compute[75247]:     <filesystem supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='driverType'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>path</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>handle</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtiofs</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </filesystem>
Dec 06 12:36:07 user nova-compute[75247]:     <tpm supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='model'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>tpm-tis</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>tpm-crb</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='backendModel'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>passthrough</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>emulator</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </tpm>
Dec 06 12:36:07 user nova-compute[75247]:   </devices>
Dec 06 12:36:07 user nova-compute[75247]:   <features>
Dec 06 12:36:07 user nova-compute[75247]:     <gic supported='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     <vmcoreinfo supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <genid supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <backingStoreInput supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <backup supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <sev supported='no'/>
Dec 06 12:36:07 user nova-compute[75247]:   </features>
Dec 06 12:36:07 user nova-compute[75247]: </domainCapabilities>
Dec 06 12:36:07 user nova-compute[75247]:  {{(pid=75247) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Dec 06 12:36:07 user nova-compute[75247]: <domainCapabilities>
Dec 06 12:36:07 user nova-compute[75247]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 06 12:36:07 user nova-compute[75247]:   <domain>kvm</domain>
Dec 06 12:36:07 user nova-compute[75247]:   <machine>pc-q35-6.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:   <arch>x86_64</arch>
Dec 06 12:36:07 user nova-compute[75247]:   <vcpu max='288'/>
Dec 06 12:36:07 user nova-compute[75247]:   <iothreads supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:   <os supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:     <enum name='firmware'>
Dec 06 12:36:07 user nova-compute[75247]:       <value>efi</value>
Dec 06 12:36:07 user nova-compute[75247]:     </enum>
Dec 06 12:36:07 user nova-compute[75247]:     <loader supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='type'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>rom</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>pflash</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='readonly'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>yes</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>no</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='secure'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>yes</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>no</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </loader>
Dec 06 12:36:07 user nova-compute[75247]:   </os>
Dec 06 12:36:07 user nova-compute[75247]:   <cpu>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='host-passthrough' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='hostPassthroughMigratable'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>on</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>off</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='maximum' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='maximumMigratable'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>on</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>off</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='host-model' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <vendor>Intel</vendor>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ss'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='vmx'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='pcid'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='hypervisor'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='arat'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='tsc_adjust'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='umip'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='md-clear'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='stibp'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='arch-capabilities'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ssbd'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='invtsc'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ibpb'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ibrs'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='amd-stibp'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='amd-ssbd'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='rsba'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='pschange-mc-no'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='disable' name='erms'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='disable' name='xsaveopt'/>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='custom' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>qemu64</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>qemu32</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>phenom</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>pentium3</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>pentium2</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>pentium</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>n270</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>kvm64</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>kvm32</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>coreduo</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>core2duo</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>athlon</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Westmere-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Westmere</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Snowridge</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Server</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Client</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>SandyBridge</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Penryn</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G5</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G4</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G3</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G2</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Opteron_G1</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Nehalem</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>IvyBridge</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Icelake-Server</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC-Rome</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC-Milan</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC-IBPB</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Dhyana</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Cooperlake</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Conroe</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Cascadelake-Server</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>486</model>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:   </cpu>
Dec 06 12:36:07 user nova-compute[75247]:   <memoryBacking supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:     <enum name='sourceType'>
Dec 06 12:36:07 user nova-compute[75247]:       <value>file</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>anonymous</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>memfd</value>
Dec 06 12:36:07 user nova-compute[75247]:     </enum>
Dec 06 12:36:07 user nova-compute[75247]:   </memoryBacking>
Dec 06 12:36:07 user nova-compute[75247]:   <devices>
Dec 06 12:36:07 user nova-compute[75247]:     <disk supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='diskDevice'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>disk</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>cdrom</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>floppy</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>lun</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='bus'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>fdc</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>scsi</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>usb</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>sata</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='model'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-non-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </disk>
Dec 06 12:36:07 user nova-compute[75247]:     <graphics supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='type'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>sdl</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>vnc</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>spice</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>egl-headless</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </graphics>
Dec 06 12:36:07 user nova-compute[75247]:     <video supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='modelType'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>vga</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>cirrus</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>vmvga</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>qxl</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>none</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>bochs</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>ramfb</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </video>
Dec 06 12:36:07 user nova-compute[75247]:     <hostdev supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='mode'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>subsystem</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='startupPolicy'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>default</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>mandatory</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>requisite</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>optional</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='subsysType'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>usb</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>pci</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>scsi</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='capsType'/>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='pciBackend'/>
Dec 06 12:36:07 user nova-compute[75247]:     </hostdev>
Dec 06 12:36:07 user nova-compute[75247]:     <rng supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='model'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-non-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='backendModel'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>random</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>egd</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>builtin</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </rng>
Dec 06 12:36:07 user nova-compute[75247]:     <filesystem supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='driverType'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>path</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>handle</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtiofs</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </filesystem>
Dec 06 12:36:07 user nova-compute[75247]:     <tpm supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='model'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>tpm-tis</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>tpm-crb</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='backendModel'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>passthrough</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>emulator</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </tpm>
Dec 06 12:36:07 user nova-compute[75247]:   </devices>
Dec 06 12:36:07 user nova-compute[75247]:   <features>
Dec 06 12:36:07 user nova-compute[75247]:     <gic supported='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     <vmcoreinfo supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <genid supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <backingStoreInput supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <backup supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <sev supported='no'/>
Dec 06 12:36:07 user nova-compute[75247]:   </features>
Dec 06 12:36:07 user nova-compute[75247]: </domainCapabilities>
Dec 06 12:36:07 user nova-compute[75247]:  {{(pid=75247) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Dec 06 12:36:07 user nova-compute[75247]: <domainCapabilities>
Dec 06 12:36:07 user nova-compute[75247]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 06 12:36:07 user nova-compute[75247]:   <domain>kvm</domain>
Dec 06 12:36:07 user nova-compute[75247]:   <machine>pc-i440fx-6.2</machine>
Dec 06 12:36:07 user nova-compute[75247]:   <arch>x86_64</arch>
Dec 06 12:36:07 user nova-compute[75247]:   <vcpu max='255'/>
Dec 06 12:36:07 user nova-compute[75247]:   <iothreads supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:   <os supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:     <enum name='firmware'>
Dec 06 12:36:07 user nova-compute[75247]:       <value>efi</value>
Dec 06 12:36:07 user nova-compute[75247]:     </enum>
Dec 06 12:36:07 user nova-compute[75247]:     <loader supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='type'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>rom</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>pflash</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='readonly'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>yes</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>no</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='secure'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>no</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </loader>
Dec 06 12:36:07 user nova-compute[75247]:   </os>
Dec 06 12:36:07 user nova-compute[75247]:   <cpu>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='host-passthrough' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='hostPassthroughMigratable'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>on</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>off</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='maximum' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='maximumMigratable'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>on</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>off</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='host-model' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <vendor>Intel</vendor>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ss'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='vmx'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='pcid'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='hypervisor'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='arat'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='tsc_adjust'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='umip'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='md-clear'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='stibp'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='arch-capabilities'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ssbd'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='invtsc'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ibpb'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ibrs'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='amd-stibp'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='amd-ssbd'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='rsba'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='pschange-mc-no'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='disable' name='erms'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='disable' name='xsaveopt'/>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='custom' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>qemu64</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>qemu32</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>phenom</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>pentium3</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>pentium2</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>pentium</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>n270</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>kvm64</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>kvm32</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>coreduo</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>core2duo</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>athlon</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Westmere-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Westmere</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Snowridge</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Server</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Client</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>SandyBridge</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Penryn</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G5</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G4</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G3</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G2</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Opteron_G1</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Nehalem</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>IvyBridge</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Icelake-Server</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC-Rome</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC-Milan</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC-IBPB</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Dhyana</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Cooperlake</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Conroe</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Cascadelake-Server</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>486</model>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:   </cpu>
Dec 06 12:36:07 user nova-compute[75247]:   <memoryBacking supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:     <enum name='sourceType'>
Dec 06 12:36:07 user nova-compute[75247]:       <value>file</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>anonymous</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>memfd</value>
Dec 06 12:36:07 user nova-compute[75247]:     </enum>
Dec 06 12:36:07 user nova-compute[75247]:   </memoryBacking>
Dec 06 12:36:07 user nova-compute[75247]:   <devices>
Dec 06 12:36:07 user nova-compute[75247]:     <disk supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='diskDevice'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>disk</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>cdrom</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>floppy</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>lun</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='bus'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>ide</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>fdc</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>scsi</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>usb</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>sata</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='model'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-non-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </disk>
Dec 06 12:36:07 user nova-compute[75247]:     <graphics supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='type'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>sdl</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>vnc</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>spice</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>egl-headless</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </graphics>
Dec 06 12:36:07 user nova-compute[75247]:     <video supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='modelType'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>vga</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>cirrus</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>vmvga</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>qxl</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>none</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>bochs</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>ramfb</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </video>
Dec 06 12:36:07 user nova-compute[75247]:     <hostdev supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='mode'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>subsystem</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='startupPolicy'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>default</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>mandatory</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>requisite</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>optional</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='subsysType'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>usb</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>pci</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>scsi</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='capsType'/>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='pciBackend'/>
Dec 06 12:36:07 user nova-compute[75247]:     </hostdev>
Dec 06 12:36:07 user nova-compute[75247]:     <rng supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='model'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-non-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='backendModel'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>random</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>egd</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>builtin</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </rng>
Dec 06 12:36:07 user nova-compute[75247]:     <filesystem supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='driverType'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>path</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>handle</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtiofs</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </filesystem>
Dec 06 12:36:07 user nova-compute[75247]:     <tpm supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='model'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>tpm-tis</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>tpm-crb</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='backendModel'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>passthrough</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>emulator</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </tpm>
Dec 06 12:36:07 user nova-compute[75247]:   </devices>
Dec 06 12:36:07 user nova-compute[75247]:   <features>
Dec 06 12:36:07 user nova-compute[75247]:     <gic supported='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     <vmcoreinfo supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <genid supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <backingStoreInput supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <backup supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <sev supported='no'/>
Dec 06 12:36:07 user nova-compute[75247]:   </features>
Dec 06 12:36:07 user nova-compute[75247]: </domainCapabilities>
Dec 06 12:36:07 user nova-compute[75247]:  {{(pid=75247) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Dec 06 12:36:07 user nova-compute[75247]: <domainCapabilities>
Dec 06 12:36:07 user nova-compute[75247]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 06 12:36:07 user nova-compute[75247]:   <domain>kvm</domain>
Dec 06 12:36:07 user nova-compute[75247]:   <machine>pc-i440fx-jammy</machine>
Dec 06 12:36:07 user nova-compute[75247]:   <arch>x86_64</arch>
Dec 06 12:36:07 user nova-compute[75247]:   <vcpu max='255'/>
Dec 06 12:36:07 user nova-compute[75247]:   <iothreads supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:   <os supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:     <enum name='firmware'>
Dec 06 12:36:07 user nova-compute[75247]:       <value>efi</value>
Dec 06 12:36:07 user nova-compute[75247]:     </enum>
Dec 06 12:36:07 user nova-compute[75247]:     <loader supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='type'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>rom</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>pflash</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='readonly'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>yes</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>no</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='secure'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>no</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </loader>
Dec 06 12:36:07 user nova-compute[75247]:   </os>
Dec 06 12:36:07 user nova-compute[75247]:   <cpu>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='host-passthrough' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='hostPassthroughMigratable'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>on</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>off</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='maximum' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='maximumMigratable'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>on</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>off</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='host-model' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <vendor>Intel</vendor>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ss'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='vmx'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='pcid'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='hypervisor'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='arat'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='tsc_adjust'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='umip'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='md-clear'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='stibp'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='arch-capabilities'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ssbd'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='invtsc'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ibpb'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='ibrs'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='amd-stibp'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='amd-ssbd'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='rsba'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='require' name='pschange-mc-no'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='disable' name='erms'/>
Dec 06 12:36:07 user nova-compute[75247]:       <feature policy='disable' name='xsaveopt'/>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:     <mode name='custom' supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>qemu64</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>qemu32</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>phenom</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>pentium3</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>pentium2</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>pentium</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>n270</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>kvm64</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>kvm32</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>coreduo</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>core2duo</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>athlon</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Westmere-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Westmere</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Snowridge</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Server</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Skylake-Client</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>SandyBridge</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Penryn</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G5</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G4</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G3</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Opteron_G2</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Opteron_G1</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Nehalem</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>IvyBridge</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Icelake-Server</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Haswell</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC-Rome</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC-Milan</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC-IBPB</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>EPYC</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Dhyana</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Cooperlake</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>Conroe</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Cascadelake-Server</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell-noTSX</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell-IBRS</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='no'>Broadwell</model>
Dec 06 12:36:07 user nova-compute[75247]:       <model usable='yes'>486</model>
Dec 06 12:36:07 user nova-compute[75247]:     </mode>
Dec 06 12:36:07 user nova-compute[75247]:   </cpu>
Dec 06 12:36:07 user nova-compute[75247]:   <memoryBacking supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:     <enum name='sourceType'>
Dec 06 12:36:07 user nova-compute[75247]:       <value>file</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>anonymous</value>
Dec 06 12:36:07 user nova-compute[75247]:       <value>memfd</value>
Dec 06 12:36:07 user nova-compute[75247]:     </enum>
Dec 06 12:36:07 user nova-compute[75247]:   </memoryBacking>
Dec 06 12:36:07 user nova-compute[75247]:   <devices>
Dec 06 12:36:07 user nova-compute[75247]:     <disk supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='diskDevice'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>disk</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>cdrom</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>floppy</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>lun</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='bus'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>ide</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>fdc</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>scsi</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>usb</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>sata</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='model'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-non-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </disk>
Dec 06 12:36:07 user nova-compute[75247]:     <graphics supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='type'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>sdl</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>vnc</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>spice</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>egl-headless</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </graphics>
Dec 06 12:36:07 user nova-compute[75247]:     <video supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='modelType'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>vga</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>cirrus</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>vmvga</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>qxl</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>none</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>bochs</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>ramfb</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </video>
Dec 06 12:36:07 user nova-compute[75247]:     <hostdev supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='mode'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>subsystem</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='startupPolicy'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>default</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>mandatory</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>requisite</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>optional</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='subsysType'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>usb</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>pci</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>scsi</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='capsType'/>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='pciBackend'/>
Dec 06 12:36:07 user nova-compute[75247]:     </hostdev>
Dec 06 12:36:07 user nova-compute[75247]:     <rng supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='model'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtio-non-transitional</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='backendModel'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>random</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>egd</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>builtin</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </rng>
Dec 06 12:36:07 user nova-compute[75247]:     <filesystem supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='driverType'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>path</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>handle</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>virtiofs</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </filesystem>
Dec 06 12:36:07 user nova-compute[75247]:     <tpm supported='yes'>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='model'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>tpm-tis</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>tpm-crb</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:       <enum name='backendModel'>
Dec 06 12:36:07 user nova-compute[75247]:         <value>passthrough</value>
Dec 06 12:36:07 user nova-compute[75247]:         <value>emulator</value>
Dec 06 12:36:07 user nova-compute[75247]:       </enum>
Dec 06 12:36:07 user nova-compute[75247]:     </tpm>
Dec 06 12:36:07 user nova-compute[75247]:   </devices>
Dec 06 12:36:07 user nova-compute[75247]:   <features>
Dec 06 12:36:07 user nova-compute[75247]:     <gic supported='no'/>
Dec 06 12:36:07 user nova-compute[75247]:     <vmcoreinfo supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <genid supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <backingStoreInput supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <backup supported='yes'/>
Dec 06 12:36:07 user nova-compute[75247]:     <sev supported='no'/>
Dec 06 12:36:07 user nova-compute[75247]:   </features>
Dec 06 12:36:07 user nova-compute[75247]: </domainCapabilities>
Dec 06 12:36:07 user nova-compute[75247]:  {{(pid=75247) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75247) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75247) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Checking secure boot support for host arch (x86_64) {{(pid=75247) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Dec 06 12:36:07 user nova-compute[75247]: INFO nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Secure Boot support detected
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] cpu compare xml: <cpu match="exact">
Dec 06 12:36:07 user nova-compute[75247]:   <model>Nehalem</model>
Dec 06 12:36:07 user nova-compute[75247]: </cpu>
Dec 06 12:36:07 user nova-compute[75247]:  {{(pid=75247) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10025}}
Dec 06 12:36:07 user nova-compute[75247]: INFO nova.virt.node [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Generated node identity d326b140-3450-4409-964c-9eafc6cc025d
Dec 06 12:36:07 user nova-compute[75247]: INFO nova.virt.node [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Wrote node identity d326b140-3450-4409-964c-9eafc6cc025d to /opt/stack/data/nova/compute_id
Dec 06 12:36:07 user nova-compute[75247]: WARNING nova.compute.manager [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Compute nodes ['d326b140-3450-4409-964c-9eafc6cc025d'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Dec 06 12:36:07 user nova-compute[75247]: INFO nova.compute.manager [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Dec 06 12:36:07 user nova-compute[75247]: WARNING nova.compute.manager [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Dec 06 12:36:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 12:36:07 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:36:07 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Hypervisor/Node resource view: name=user free_ram=11019MB free_disk=26.12744140625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:36:07 user nova-compute[75247]: WARNING nova.compute.resource_tracker [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] No compute node record for user:d326b140-3450-4409-964c-9eafc6cc025d: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host d326b140-3450-4409-964c-9eafc6cc025d could not be found.
Dec 06 12:36:07 user nova-compute[75247]: INFO nova.compute.resource_tracker [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Compute node record created for user:user with uuid: d326b140-3450-4409-964c-9eafc6cc025d
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 12:36:07 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 12:36:07 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] [req-623e5a65-7364-45fa-9cf9-337619c48005] Created resource provider record via placement API for resource provider with UUID d326b140-3450-4409-964c-9eafc6cc025d and name user.
Dec 06 12:36:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75247) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Dec 06 12:36:08 user nova-compute[75247]: INFO nova.virt.libvirt.host [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] kernel doesn't support AMD SEV
Dec 06 12:36:08 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Updating inventory in ProviderTree for provider d326b140-3450-4409-964c-9eafc6cc025d with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 12:36:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:36:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Libvirt baseline CPU <cpu>
Dec 06 12:36:08 user nova-compute[75247]:   <arch>x86_64</arch>
Dec 06 12:36:08 user nova-compute[75247]:   <model>Nehalem</model>
Dec 06 12:36:08 user nova-compute[75247]:   <vendor>Intel</vendor>
Dec 06 12:36:08 user nova-compute[75247]:   <topology sockets="6" cores="1" threads="1"/>
Dec 06 12:36:08 user nova-compute[75247]: </cpu>
Dec 06 12:36:08 user nova-compute[75247]:  {{(pid=75247) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12524}}
Dec 06 12:36:08 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Updated inventory for provider d326b140-3450-4409-964c-9eafc6cc025d with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Dec 06 12:36:08 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Updating resource provider d326b140-3450-4409-964c-9eafc6cc025d generation from 0 to 1 during operation: update_inventory {{(pid=75247) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Dec 06 12:36:08 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Updating inventory in ProviderTree for provider d326b140-3450-4409-964c-9eafc6cc025d with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 12:36:08 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Updating resource provider d326b140-3450-4409-964c-9eafc6cc025d generation from 1 to 2 during operation: update_traits {{(pid=75247) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Dec 06 12:36:08 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 12:36:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.712s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:36:08 user nova-compute[75247]: DEBUG nova.service [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Creating RPC server for service compute {{(pid=75247) start /opt/stack/nova/nova/service.py:182}}
Dec 06 12:36:08 user nova-compute[75247]: DEBUG nova.service [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] Join ServiceGroup membership for this service compute {{(pid=75247) start /opt/stack/nova/nova/service.py:199}}
Dec 06 12:36:08 user nova-compute[75247]: DEBUG nova.servicegroup.drivers.db [None req-1ab65f9e-9e77-48e6-ab9c-4183ab25a590 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75247) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Dec 06 12:36:51 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:36:51 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:36:58 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:36:58 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:36:58 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 12:36:58 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 12:36:58 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Didn't find any instances for network info cache update. {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 12:36:58 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:36:58 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:36:58 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:36:58 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:36:58 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:36:58 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:36:58 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 12:36:58 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:36:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:36:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:36:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:36:58 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 12:36:59 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:36:59 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:36:59 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=10461MB free_disk=26.03122329711914GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 12:36:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:36:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:36:59 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 12:36:59 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 12:36:59 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:36:59 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:36:59 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 12:36:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:37:59 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:37:59 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:37:59 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:37:59 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 12:37:59 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 12:37:59 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Didn't find any instances for network info cache update. {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 12:37:59 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:37:59 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:37:59 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:37:59 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:37:59 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:37:59 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 12:37:59 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:37:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:37:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:37:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:37:59 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 12:37:59 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:37:59 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:37:59 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=10394MB free_disk=26.096450805664062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 12:37:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:37:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:37:59 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 12:37:59 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 12:37:59 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:37:59 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:37:59 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 12:37:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:38:00 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:38:58 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:38:58 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 12:38:58 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 12:38:58 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Didn't find any instances for network info cache update. {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 12:38:58 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:38:58 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:38:59 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:38:59 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:38:59 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:38:59 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:39:00 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:39:00 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 12:39:00 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:39:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:39:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:39:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:39:00 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 12:39:01 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:39:01 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:39:01 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=10387MB free_disk=25.84799575805664GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 12:39:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:39:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:39:01 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 12:39:01 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 12:39:01 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:39:01 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:39:01 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 12:39:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:39:59 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:39:59 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:39:59 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:39:59 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 12:39:59 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 12:39:59 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Didn't find any instances for network info cache update. {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 12:39:59 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:39:59 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:40:00 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:40:00 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:40:00 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:40:00 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:40:00 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 12:40:01 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:40:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:01 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 12:40:02 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:40:02 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:40:02 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=9729MB free_disk=25.877185821533203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 12:40:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:02 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 12:40:02 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 12:40:02 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:40:02 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:40:02 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 12:40:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.118s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Acquiring lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:11 user nova-compute[75247]: DEBUG nova.compute.manager [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:40:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:12 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:40:12 user nova-compute[75247]: INFO nova.compute.claims [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Claim successful on node user
Dec 06 12:40:12 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:40:12 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:40:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:12 user nova-compute[75247]: DEBUG nova.compute.manager [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:40:12 user nova-compute[75247]: DEBUG nova.compute.manager [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:40:12 user nova-compute[75247]: DEBUG nova.network.neutron [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:40:12 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:40:12 user nova-compute[75247]: DEBUG nova.compute.manager [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:40:12 user nova-compute[75247]: DEBUG nova.compute.manager [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:40:12 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:40:12 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Creating image(s)
Dec 06 12:40:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a07dcbb-573e-4835-a4d2-3cae1d3446e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "/opt/stack/data/nova/instances/0a07dcbb-573e-4835-a4d2-3cae1d3446e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "/opt/stack/data/nova/instances/0a07dcbb-573e-4835-a4d2-3cae1d3446e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "70c4664e-ae7a-47de-bba7-18300391d209" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "70c4664e-ae7a-47de-bba7-18300391d209" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:12 user nova-compute[75247]: DEBUG nova.compute.manager [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:40:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:13 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:40:13 user nova-compute[75247]: INFO nova.compute.claims [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Claim successful on node user
Dec 06 12:40:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec.part --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:13 user nova-compute[75247]: DEBUG nova.policy [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93fbc9a260f8468291684e31046c74c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ddbb56f5d94b0cb91768e9c9a7aa62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:40:13 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:40:13 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:40:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.653s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:13 user nova-compute[75247]: DEBUG nova.compute.manager [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:40:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec.part --force-share --output=json" returned: 0 in 0.187s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:13 user nova-compute[75247]: DEBUG nova.virt.images [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] 8242af4f-c2f6-4990-9385-f1348e8ff114 was qcow2, converting to raw {{(pid=75247) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 12:40:13 user nova-compute[75247]: DEBUG nova.privsep.utils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 12:40:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec.part /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec.converted {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:13 user nova-compute[75247]: DEBUG nova.compute.manager [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:40:13 user nova-compute[75247]: DEBUG nova.network.neutron [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:40:13 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:40:13 user nova-compute[75247]: DEBUG nova.compute.manager [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:40:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec.part /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec.converted" returned: 0 in 0.157s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec.converted --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:14 user nova-compute[75247]: DEBUG nova.compute.manager [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:40:14 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:40:14 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Creating image(s)
Dec 06 12:40:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "/opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "/opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "/opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:14 user nova-compute[75247]: DEBUG nova.policy [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0efa55fc4754d96a33d07d52342d8f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222da79e3583495d90d5442029996343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:40:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.318s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:14 user nova-compute[75247]: INFO oslo.privsep.daemon [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpn77d0rd8/privsep.sock']
Dec 06 12:40:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.145s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:14 user sudo[84500]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpn77d0rd8/privsep.sock
Dec 06 12:40:14 user sudo[84500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 06 12:40:15 user sudo[84500]: pam_unix(sudo:session): session closed for user root
Dec 06 12:40:15 user nova-compute[75247]: INFO oslo.privsep.daemon [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Spawned new privsep daemon via rootwrap
Dec 06 12:40:15 user nova-compute[75247]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 06 12:40:15 user nova-compute[75247]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 06 12:40:15 user nova-compute[75247]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Dec 06 12:40:15 user nova-compute[75247]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84505
Dec 06 12:40:15 user nova-compute[75247]: WARNING oslo_privsep.priv_context [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] privsep daemon already running
Dec 06 12:40:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.165s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.232s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG nova.network.neutron [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Successfully created port: 2c3b146f-74ce-47d5-9bca-54c20e685cdb {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.169s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG nova.network.neutron [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Successfully created port: 4f46192c-414a-4af4-b5de-5bd99d31d1fe {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk 1073741824" returned: 0 in 0.181s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.357s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.496s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.268s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Checking if we can resize image /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.190s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/0a07dcbb-573e-4835-a4d2-3cae1d3446e3/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/0a07dcbb-573e-4835-a4d2-3cae1d3446e3/disk 1073741824" returned: 0 in 0.041s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Cannot resize image /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Ensure instance console log exists: /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.173s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a07dcbb-573e-4835-a4d2-3cae1d3446e3/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:40:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a07dcbb-573e-4835-a4d2-3cae1d3446e3/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a07dcbb-573e-4835-a4d2-3cae1d3446e3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:17 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Cannot resize image /opt/stack/data/nova/instances/0a07dcbb-573e-4835-a4d2-3cae1d3446e3/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:40:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:40:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Ensure instance console log exists: /opt/stack/data/nova/instances/0a07dcbb-573e-4835-a4d2-3cae1d3446e3/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:40:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "782289e2-91cd-4aee-9a08-eadfb2a5965b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "782289e2-91cd-4aee-9a08-eadfb2a5965b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:18 user nova-compute[75247]: DEBUG nova.compute.manager [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:40:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:18 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:40:18 user nova-compute[75247]: INFO nova.compute.claims [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Claim successful on node user
Dec 06 12:40:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:18 user nova-compute[75247]: DEBUG nova.compute.manager [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:40:18 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:40:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.compute.manager [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.060s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:40:19 user nova-compute[75247]: INFO nova.compute.claims [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Claim successful on node user
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.compute.manager [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.network.neutron [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:40:19 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.compute.manager [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.compute.manager [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:40:19 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Creating image(s)
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "/opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "/opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "/opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "4531bf11-b948-4d57-bf55-f33563815e26" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "4531bf11-b948-4d57-bf55-f33563815e26" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.policy [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc13843d8f074da189dbd3e93750b811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ccf15765714ca2a8c4700d2d6e3ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.compute.manager [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.177s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.network.neutron [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Successfully updated port: 4f46192c-414a-4af4-b5de-5bd99d31d1fe {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "refresh_cache-70c4664e-ae7a-47de-bba7-18300391d209" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquired lock "refresh_cache-70c4664e-ae7a-47de-bba7-18300391d209" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.network.neutron [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.compute.manager [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.network.neutron [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:40:19 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.177s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.network.neutron [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Successfully updated port: 2c3b146f-74ce-47d5-9bca-54c20e685cdb {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.compute.manager [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk 1073741824" returned: 0 in 0.066s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Acquiring lock "refresh_cache-0a07dcbb-573e-4835-a4d2-3cae1d3446e3" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Acquired lock "refresh_cache-0a07dcbb-573e-4835-a4d2-3cae1d3446e3" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.network.neutron [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:40:19 user nova-compute[75247]: INFO nova.compute.claims [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Claim successful on node user
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.network.neutron [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.compute.manager [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:40:19 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Creating image(s)
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "/opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "/opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "/opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.compute.manager [req-110d584b-e0f0-45e9-8d12-0219ef219526 req-371e6519-7002-47b9-a718-fe7776f037b3 service nova] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Received event network-changed-4f46192c-414a-4af4-b5de-5bd99d31d1fe {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.compute.manager [req-110d584b-e0f0-45e9-8d12-0219ef219526 req-371e6519-7002-47b9-a718-fe7776f037b3 service nova] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Refreshing instance network info cache due to event network-changed-4f46192c-414a-4af4-b5de-5bd99d31d1fe. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-110d584b-e0f0-45e9-8d12-0219ef219526 req-371e6519-7002-47b9-a718-fe7776f037b3 service nova] Acquiring lock "refresh_cache-70c4664e-ae7a-47de-bba7-18300391d209" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.185s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Checking if we can resize image /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:40:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG nova.policy [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4cb0e32ba6094d1e8053787bc1979b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3aeaf6ffdb4cc0807d90e73e92fa7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG nova.network.neutron [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.190s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Cannot resize image /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Ensure instance console log exists: /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.182s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk 1073741824" returned: 0 in 0.054s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:20 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:40:20 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.162s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:40:20 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Creating image(s)
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "/opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "/opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "/opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Cannot resize image /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Ensure instance console log exists: /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.164s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.165s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG nova.policy [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5dd4165666a1426aa1134c2889214b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57ba4e5fa37f4fd29d6712069230d3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk 1073741824" returned: 0 in 0.043s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:20 user nova-compute[75247]: DEBUG nova.network.neutron [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Updating instance_info_cache with network_info: [{"id": "4f46192c-414a-4af4-b5de-5bd99d31d1fe", "address": "fa:16:3e:b5:83:aa", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f46192c-41", "ovs_interfaceid": "4f46192c-414a-4af4-b5de-5bd99d31d1fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Releasing lock "refresh_cache-70c4664e-ae7a-47de-bba7-18300391d209" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.compute.manager [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Instance network_info: |[{"id": "4f46192c-414a-4af4-b5de-5bd99d31d1fe", "address": "fa:16:3e:b5:83:aa", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f46192c-41", "ovs_interfaceid": "4f46192c-414a-4af4-b5de-5bd99d31d1fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-110d584b-e0f0-45e9-8d12-0219ef219526 req-371e6519-7002-47b9-a718-fe7776f037b3 service nova] Acquired lock "refresh_cache-70c4664e-ae7a-47de-bba7-18300391d209" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.network.neutron [req-110d584b-e0f0-45e9-8d12-0219ef219526 req-371e6519-7002-47b9-a718-fe7776f037b3 service nova] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Refreshing network info cache for port 4f46192c-414a-4af4-b5de-5bd99d31d1fe {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Start _get_guest_xml network_info=[{"id": "4f46192c-414a-4af4-b5de-5bd99d31d1fe", "address": "fa:16:3e:b5:83:aa", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f46192c-41", "ovs_interfaceid": "4f46192c-414a-4af4-b5de-5bd99d31d1fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:40:21 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:40:21 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.privsep.utils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1363181667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1363181667',id=2,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='222da79e3583495d90d5442029996343',ramdisk_id='',reservation_id='r-k3i92vzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:40:14Z,user_data=None,user_id='d0efa55fc4754d96a33d07d52342d8f7',uuid=70c4664e-ae7a-47de-bba7-18300391d209,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f46192c-414a-4af4-b5de-5bd99d31d1fe", "address": "fa:16:3e:b5:83:aa", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f46192c-41", "ovs_interfaceid": "4f46192c-414a-4af4-b5de-5bd99d31d1fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converting VIF {"id": "4f46192c-414a-4af4-b5de-5bd99d31d1fe", "address": "fa:16:3e:b5:83:aa", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f46192c-41", "ovs_interfaceid": "4f46192c-414a-4af4-b5de-5bd99d31d1fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:83:aa,bridge_name='br-int',has_traffic_filtering=True,id=4f46192c-414a-4af4-b5de-5bd99d31d1fe,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f46192c-41') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.objects.instance [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lazy-loading 'pci_devices' on Instance uuid 70c4664e-ae7a-47de-bba7-18300391d209 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:40:21 user nova-compute[75247]:   <uuid>70c4664e-ae7a-47de-bba7-18300391d209</uuid>
Dec 06 12:40:21 user nova-compute[75247]:   <name>instance-00000002</name>
Dec 06 12:40:21 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:40:21 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:40:21 user nova-compute[75247]:   <metadata>
Dec 06 12:40:21 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:40:21 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:40:21 user nova-compute[75247]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1363181667</nova:name>
Dec 06 12:40:21 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:40:21</nova:creationTime>
Dec 06 12:40:21 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:40:21 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:40:21 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:40:21 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:40:21 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:40:21 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:40:21 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:40:21 user nova-compute[75247]:       <nova:owner>
Dec 06 12:40:21 user nova-compute[75247]:         <nova:user uuid="d0efa55fc4754d96a33d07d52342d8f7">tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member</nova:user>
Dec 06 12:40:21 user nova-compute[75247]:         <nova:project uuid="222da79e3583495d90d5442029996343">tempest-ServerBootFromVolumeStableRescueTest-1200643969</nova:project>
Dec 06 12:40:21 user nova-compute[75247]:       </nova:owner>
Dec 06 12:40:21 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:40:21 user nova-compute[75247]:       <nova:ports>
Dec 06 12:40:21 user nova-compute[75247]:         <nova:port uuid="4f46192c-414a-4af4-b5de-5bd99d31d1fe">
Dec 06 12:40:21 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 12:40:21 user nova-compute[75247]:         </nova:port>
Dec 06 12:40:21 user nova-compute[75247]:       </nova:ports>
Dec 06 12:40:21 user nova-compute[75247]:     </nova:instance>
Dec 06 12:40:21 user nova-compute[75247]:   </metadata>
Dec 06 12:40:21 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:40:21 user nova-compute[75247]:     <system>
Dec 06 12:40:21 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:40:21 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:40:21 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:40:21 user nova-compute[75247]:       <entry name="serial">70c4664e-ae7a-47de-bba7-18300391d209</entry>
Dec 06 12:40:21 user nova-compute[75247]:       <entry name="uuid">70c4664e-ae7a-47de-bba7-18300391d209</entry>
Dec 06 12:40:21 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:40:21 user nova-compute[75247]:     </system>
Dec 06 12:40:21 user nova-compute[75247]:   </sysinfo>
Dec 06 12:40:21 user nova-compute[75247]:   <os>
Dec 06 12:40:21 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:40:21 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:40:21 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:40:21 user nova-compute[75247]:   </os>
Dec 06 12:40:21 user nova-compute[75247]:   <features>
Dec 06 12:40:21 user nova-compute[75247]:     <acpi/>
Dec 06 12:40:21 user nova-compute[75247]:     <apic/>
Dec 06 12:40:21 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:40:21 user nova-compute[75247]:   </features>
Dec 06 12:40:21 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:40:21 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:40:21 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:40:21 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:40:21 user nova-compute[75247]:   </clock>
Dec 06 12:40:21 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:40:21 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:40:21 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:40:21 user nova-compute[75247]:   </cpu>
Dec 06 12:40:21 user nova-compute[75247]:   <devices>
Dec 06 12:40:21 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:40:21 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:40:21 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk"/>
Dec 06 12:40:21 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:40:21 user nova-compute[75247]:     </disk>
Dec 06 12:40:21 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:40:21 user nova-compute[75247]:       <mac address="fa:16:3e:b5:83:aa"/>
Dec 06 12:40:21 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:40:21 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:40:21 user nova-compute[75247]:       <target dev="tap4f46192c-41"/>
Dec 06 12:40:21 user nova-compute[75247]:     </interface>
Dec 06 12:40:21 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:40:21 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/console.log" append="off"/>
Dec 06 12:40:21 user nova-compute[75247]:     </serial>
Dec 06 12:40:21 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:40:21 user nova-compute[75247]:     <video>
Dec 06 12:40:21 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:40:21 user nova-compute[75247]:     </video>
Dec 06 12:40:21 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:40:21 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:40:21 user nova-compute[75247]:     </rng>
Dec 06 12:40:21 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:40:21 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:40:21 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:40:21 user nova-compute[75247]:     </memballoon>
Dec 06 12:40:21 user nova-compute[75247]:   </devices>
Dec 06 12:40:21 user nova-compute[75247]: </domain>
Dec 06 12:40:21 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1363181667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1363181667',id=2,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='222da79e3583495d90d5442029996343',ramdisk_id='',reservation_id='r-k3i92vzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:40:14Z,user_data=None,user_id='d0efa55fc4754d96a33d07d52342d8f7',uuid=70c4664e-ae7a-47de-bba7-18300391d209,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f46192c-414a-4af4-b5de-5bd99d31d1fe", "address": "fa:16:3e:b5:83:aa", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f46192c-41", "ovs_interfaceid": "4f46192c-414a-4af4-b5de-5bd99d31d1fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converting VIF {"id": "4f46192c-414a-4af4-b5de-5bd99d31d1fe", "address": "fa:16:3e:b5:83:aa", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f46192c-41", "ovs_interfaceid": "4f46192c-414a-4af4-b5de-5bd99d31d1fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:83:aa,bridge_name='br-int',has_traffic_filtering=True,id=4f46192c-414a-4af4-b5de-5bd99d31d1fe,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f46192c-41') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG os_vif [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:83:aa,bridge_name='br-int',has_traffic_filtering=True,id=4f46192c-414a-4af4-b5de-5bd99d31d1fe,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f46192c-41') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Created schema index Interface.name {{(pid=75247) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Created schema index Port.name {{(pid=75247) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Created schema index Bridge.name {{(pid=75247) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [POLLOUT] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.358s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee5a2c69-51cf-5c59-aa52-edf13bf56c8b', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:40:21 user nova-compute[75247]: INFO oslo.privsep.daemon [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp9kogpx5u/privsep.sock']
Dec 06 12:40:21 user sudo[84619]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp9kogpx5u/privsep.sock
Dec 06 12:40:21 user sudo[84619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 06 12:40:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Cannot resize image /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Ensure instance console log exists: /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.compute.manager [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.network.neutron [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Updating instance_info_cache with network_info: [{"id": "2c3b146f-74ce-47d5-9bca-54c20e685cdb", "address": "fa:16:3e:77:4d:71", "network": {"id": "b814ddee-1e11-441b-aa6f-c96e6aae965e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-831812673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ddbb56f5d94b0cb91768e9c9a7aa62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c3b146f-74", "ovs_interfaceid": "2c3b146f-74ce-47d5-9bca-54c20e685cdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Releasing lock "refresh_cache-0a07dcbb-573e-4835-a4d2-3cae1d3446e3" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.compute.manager [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Instance network_info: |[{"id": "2c3b146f-74ce-47d5-9bca-54c20e685cdb", "address": "fa:16:3e:77:4d:71", "network": {"id": "b814ddee-1e11-441b-aa6f-c96e6aae965e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-831812673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ddbb56f5d94b0cb91768e9c9a7aa62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c3b146f-74", "ovs_interfaceid": "2c3b146f-74ce-47d5-9bca-54c20e685cdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Start _get_guest_xml network_info=[{"id": "2c3b146f-74ce-47d5-9bca-54c20e685cdb", "address": "fa:16:3e:77:4d:71", "network": {"id": "b814ddee-1e11-441b-aa6f-c96e6aae965e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-831812673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ddbb56f5d94b0cb91768e9c9a7aa62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c3b146f-74", "ovs_interfaceid": "2c3b146f-74ce-47d5-9bca-54c20e685cdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:40:21 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:40:21 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1358724081',display_name='tempest-DeleteServersTestJSON-server-1358724081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1358724081',id=1,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66ddbb56f5d94b0cb91768e9c9a7aa62',ramdisk_id='',reservation_id='r-rgzmc3il',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2009001202',owner_user_name='tempest-DeleteServersTestJSON-2009001202-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:40:13Z,user_data=None,user_id='93fbc9a260f8468291684e31046c74c4',uuid=0a07dcbb-573e-4835-a4d2-3cae1d3446e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c3b146f-74ce-47d5-9bca-54c20e685cdb", "address": "fa:16:3e:77:4d:71", "network": {"id": "b814ddee-1e11-441b-aa6f-c96e6aae965e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-831812673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ddbb56f5d94b0cb91768e9c9a7aa62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c3b146f-74", "ovs_interfaceid": "2c3b146f-74ce-47d5-9bca-54c20e685cdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Converting VIF {"id": "2c3b146f-74ce-47d5-9bca-54c20e685cdb", "address": "fa:16:3e:77:4d:71", "network": {"id": "b814ddee-1e11-441b-aa6f-c96e6aae965e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-831812673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ddbb56f5d94b0cb91768e9c9a7aa62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c3b146f-74", "ovs_interfaceid": "2c3b146f-74ce-47d5-9bca-54c20e685cdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:4d:71,bridge_name='br-int',has_traffic_filtering=True,id=2c3b146f-74ce-47d5-9bca-54c20e685cdb,network=Network(b814ddee-1e11-441b-aa6f-c96e6aae965e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c3b146f-74') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.objects.instance [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a07dcbb-573e-4835-a4d2-3cae1d3446e3 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:40:21 user nova-compute[75247]:   <uuid>0a07dcbb-573e-4835-a4d2-3cae1d3446e3</uuid>
Dec 06 12:40:21 user nova-compute[75247]:   <name>instance-00000001</name>
Dec 06 12:40:21 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:40:21 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:40:21 user nova-compute[75247]:   <metadata>
Dec 06 12:40:21 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:40:21 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:40:21 user nova-compute[75247]:       <nova:name>tempest-DeleteServersTestJSON-server-1358724081</nova:name>
Dec 06 12:40:21 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:40:21</nova:creationTime>
Dec 06 12:40:21 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:40:21 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:40:21 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:40:21 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:40:21 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:40:21 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:40:21 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:40:21 user nova-compute[75247]:       <nova:owner>
Dec 06 12:40:21 user nova-compute[75247]:         <nova:user uuid="93fbc9a260f8468291684e31046c74c4">tempest-DeleteServersTestJSON-2009001202-project-member</nova:user>
Dec 06 12:40:21 user nova-compute[75247]:         <nova:project uuid="66ddbb56f5d94b0cb91768e9c9a7aa62">tempest-DeleteServersTestJSON-2009001202</nova:project>
Dec 06 12:40:21 user nova-compute[75247]:       </nova:owner>
Dec 06 12:40:21 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:40:21 user nova-compute[75247]:       <nova:ports>
Dec 06 12:40:21 user nova-compute[75247]:         <nova:port uuid="2c3b146f-74ce-47d5-9bca-54c20e685cdb">
Dec 06 12:40:21 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 06 12:40:21 user nova-compute[75247]:         </nova:port>
Dec 06 12:40:21 user nova-compute[75247]:       </nova:ports>
Dec 06 12:40:21 user nova-compute[75247]:     </nova:instance>
Dec 06 12:40:21 user nova-compute[75247]:   </metadata>
Dec 06 12:40:21 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:40:21 user nova-compute[75247]:     <system>
Dec 06 12:40:21 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:40:21 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:40:21 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:40:21 user nova-compute[75247]:       <entry name="serial">0a07dcbb-573e-4835-a4d2-3cae1d3446e3</entry>
Dec 06 12:40:21 user nova-compute[75247]:       <entry name="uuid">0a07dcbb-573e-4835-a4d2-3cae1d3446e3</entry>
Dec 06 12:40:21 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:40:21 user nova-compute[75247]:     </system>
Dec 06 12:40:21 user nova-compute[75247]:   </sysinfo>
Dec 06 12:40:21 user nova-compute[75247]:   <os>
Dec 06 12:40:21 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:40:21 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:40:21 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:40:21 user nova-compute[75247]:   </os>
Dec 06 12:40:21 user nova-compute[75247]:   <features>
Dec 06 12:40:21 user nova-compute[75247]:     <acpi/>
Dec 06 12:40:21 user nova-compute[75247]:     <apic/>
Dec 06 12:40:21 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:40:21 user nova-compute[75247]:   </features>
Dec 06 12:40:21 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:40:21 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:40:21 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:40:21 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:40:21 user nova-compute[75247]:   </clock>
Dec 06 12:40:21 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:40:21 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:40:21 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:40:21 user nova-compute[75247]:   </cpu>
Dec 06 12:40:21 user nova-compute[75247]:   <devices>
Dec 06 12:40:21 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:40:21 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:40:21 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/0a07dcbb-573e-4835-a4d2-3cae1d3446e3/disk"/>
Dec 06 12:40:21 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:40:21 user nova-compute[75247]:     </disk>
Dec 06 12:40:21 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:40:21 user nova-compute[75247]:       <mac address="fa:16:3e:77:4d:71"/>
Dec 06 12:40:21 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:40:21 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:40:21 user nova-compute[75247]:       <target dev="tap2c3b146f-74"/>
Dec 06 12:40:21 user nova-compute[75247]:     </interface>
Dec 06 12:40:21 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:40:21 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/0a07dcbb-573e-4835-a4d2-3cae1d3446e3/console.log" append="off"/>
Dec 06 12:40:21 user nova-compute[75247]:     </serial>
Dec 06 12:40:21 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:40:21 user nova-compute[75247]:     <video>
Dec 06 12:40:21 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:40:21 user nova-compute[75247]:     </video>
Dec 06 12:40:21 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:40:21 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:40:21 user nova-compute[75247]:     </rng>
Dec 06 12:40:21 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:40:21 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:40:21 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:40:21 user nova-compute[75247]:     </memballoon>
Dec 06 12:40:21 user nova-compute[75247]:   </devices>
Dec 06 12:40:21 user nova-compute[75247]: </domain>
Dec 06 12:40:21 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1358724081',display_name='tempest-DeleteServersTestJSON-server-1358724081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1358724081',id=1,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66ddbb56f5d94b0cb91768e9c9a7aa62',ramdisk_id='',reservation_id='r-rgzmc3il',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2009001202',owner_user_name='tempest-DeleteServersTestJSON-2009001202-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:40:13Z,user_data=None,user_id='93fbc9a260f8468291684e31046c74c4',uuid=0a07dcbb-573e-4835-a4d2-3cae1d3446e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c3b146f-74ce-47d5-9bca-54c20e685cdb", "address": "fa:16:3e:77:4d:71", "network": {"id": "b814ddee-1e11-441b-aa6f-c96e6aae965e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-831812673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ddbb56f5d94b0cb91768e9c9a7aa62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c3b146f-74", "ovs_interfaceid": "2c3b146f-74ce-47d5-9bca-54c20e685cdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Converting VIF {"id": "2c3b146f-74ce-47d5-9bca-54c20e685cdb", "address": "fa:16:3e:77:4d:71", "network": {"id": "b814ddee-1e11-441b-aa6f-c96e6aae965e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-831812673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ddbb56f5d94b0cb91768e9c9a7aa62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c3b146f-74", "ovs_interfaceid": "2c3b146f-74ce-47d5-9bca-54c20e685cdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:4d:71,bridge_name='br-int',has_traffic_filtering=True,id=2c3b146f-74ce-47d5-9bca-54c20e685cdb,network=Network(b814ddee-1e11-441b-aa6f-c96e6aae965e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c3b146f-74') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG os_vif [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:4d:71,bridge_name='br-int',has_traffic_filtering=True,id=2c3b146f-74ce-47d5-9bca-54c20e685cdb,network=Network(b814ddee-1e11-441b-aa6f-c96e6aae965e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c3b146f-74') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c46aba6c-3ea3-543e-a64f-4f756e91cb05', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:40:21 user nova-compute[75247]: INFO nova.compute.claims [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Claim successful on node user
Dec 06 12:40:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:21 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG nova.compute.manager [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG nova.compute.manager [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG nova.network.neutron [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:40:22 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:40:22 user nova-compute[75247]: DEBUG nova.compute.manager [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-d49701ad-aa49-4c0d-b86a-9cf08e8d1be7 req-e2be9153-2fcd-4867-86dd-a774b977e08e service nova] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Received event network-changed-2c3b146f-74ce-47d5-9bca-54c20e685cdb {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-d49701ad-aa49-4c0d-b86a-9cf08e8d1be7 req-e2be9153-2fcd-4867-86dd-a774b977e08e service nova] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Refreshing instance network info cache due to event network-changed-2c3b146f-74ce-47d5-9bca-54c20e685cdb. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d49701ad-aa49-4c0d-b86a-9cf08e8d1be7 req-e2be9153-2fcd-4867-86dd-a774b977e08e service nova] Acquiring lock "refresh_cache-0a07dcbb-573e-4835-a4d2-3cae1d3446e3" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d49701ad-aa49-4c0d-b86a-9cf08e8d1be7 req-e2be9153-2fcd-4867-86dd-a774b977e08e service nova] Acquired lock "refresh_cache-0a07dcbb-573e-4835-a4d2-3cae1d3446e3" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG nova.network.neutron [req-d49701ad-aa49-4c0d-b86a-9cf08e8d1be7 req-e2be9153-2fcd-4867-86dd-a774b977e08e service nova] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Refreshing network info cache for port 2c3b146f-74ce-47d5-9bca-54c20e685cdb {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG nova.compute.manager [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:40:22 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Creating image(s)
Dec 06 12:40:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "/opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "/opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG nova.policy [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d7becd4d5734bc2b652e6f37492eb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6b077946334f1c8fd16d091a7738e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.197s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:22 user sudo[84619]: pam_unix(sudo:session): session closed for user root
Dec 06 12:40:22 user nova-compute[75247]: INFO oslo.privsep.daemon [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Spawned new privsep daemon via rootwrap
Dec 06 12:40:22 user nova-compute[75247]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 06 12:40:22 user nova-compute[75247]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 06 12:40:22 user nova-compute[75247]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Dec 06 12:40:22 user nova-compute[75247]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84625
Dec 06 12:40:22 user nova-compute[75247]: WARNING oslo_privsep.priv_context [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] privsep daemon already running
Dec 06 12:40:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.190s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk 1073741824" returned: 0 in 0.049s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG nova.network.neutron [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Successfully created port: b924c627-a11e-4fc4-8e23-d1a974c4de3d {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:40:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.213s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG nova.network.neutron [req-110d584b-e0f0-45e9-8d12-0219ef219526 req-371e6519-7002-47b9-a718-fe7776f037b3 service nova] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Updated VIF entry in instance network info cache for port 4f46192c-414a-4af4-b5de-5bd99d31d1fe. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG nova.network.neutron [req-110d584b-e0f0-45e9-8d12-0219ef219526 req-371e6519-7002-47b9-a718-fe7776f037b3 service nova] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Updating instance_info_cache with network_info: [{"id": "4f46192c-414a-4af4-b5de-5bd99d31d1fe", "address": "fa:16:3e:b5:83:aa", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f46192c-41", "ovs_interfaceid": "4f46192c-414a-4af4-b5de-5bd99d31d1fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-110d584b-e0f0-45e9-8d12-0219ef219526 req-371e6519-7002-47b9-a718-fe7776f037b3 service nova] Releasing lock "refresh_cache-70c4664e-ae7a-47de-bba7-18300391d209" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Cannot resize image /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Ensure instance console log exists: /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c3b146f-74, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c3b146f-74, col_values=(('qos', UUID('b6913ffd-6d5b-4dc1-90ef-9771fd98a384')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c3b146f-74, col_values=(('external_ids', {'iface-id': '2c3b146f-74ce-47d5-9bca-54c20e685cdb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:4d:71', 'vm-uuid': '0a07dcbb-573e-4835-a4d2-3cae1d3446e3'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:23 user nova-compute[75247]: INFO os_vif [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:4d:71,bridge_name='br-int',has_traffic_filtering=True,id=2c3b146f-74ce-47d5-9bca-54c20e685cdb,network=Network(b814ddee-1e11-441b-aa6f-c96e6aae965e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c3b146f-74')
Dec 06 12:40:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f46192c-41, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f46192c-41, col_values=(('qos', UUID('596dfaed-cecc-4242-9ed6-dc5f5d5f0d91')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f46192c-41, col_values=(('external_ids', {'iface-id': '4f46192c-414a-4af4-b5de-5bd99d31d1fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:83:aa', 'vm-uuid': '70c4664e-ae7a-47de-bba7-18300391d209'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:23 user nova-compute[75247]: INFO os_vif [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:83:aa,bridge_name='br-int',has_traffic_filtering=True,id=4f46192c-414a-4af4-b5de-5bd99d31d1fe,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f46192c-41')
Dec 06 12:40:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] No VIF found with MAC fa:16:3e:77:4d:71, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] No VIF found with MAC fa:16:3e:b5:83:aa, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG nova.network.neutron [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Successfully created port: b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG nova.network.neutron [req-d49701ad-aa49-4c0d-b86a-9cf08e8d1be7 req-e2be9153-2fcd-4867-86dd-a774b977e08e service nova] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Updated VIF entry in instance network info cache for port 2c3b146f-74ce-47d5-9bca-54c20e685cdb. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:40:23 user nova-compute[75247]: DEBUG nova.network.neutron [req-d49701ad-aa49-4c0d-b86a-9cf08e8d1be7 req-e2be9153-2fcd-4867-86dd-a774b977e08e service nova] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Updating instance_info_cache with network_info: [{"id": "2c3b146f-74ce-47d5-9bca-54c20e685cdb", "address": "fa:16:3e:77:4d:71", "network": {"id": "b814ddee-1e11-441b-aa6f-c96e6aae965e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-831812673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ddbb56f5d94b0cb91768e9c9a7aa62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c3b146f-74", "ovs_interfaceid": "2c3b146f-74ce-47d5-9bca-54c20e685cdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:40:24 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Successfully created port: 348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:40:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d49701ad-aa49-4c0d-b86a-9cf08e8d1be7 req-e2be9153-2fcd-4867-86dd-a774b977e08e service nova] Releasing lock "refresh_cache-0a07dcbb-573e-4835-a4d2-3cae1d3446e3" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:40:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:25 user nova-compute[75247]: DEBUG nova.network.neutron [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Successfully created port: a205065f-e23d-46b2-9f34-f77ff2b3ebb1 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:40:26 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Successfully updated port: 348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:40:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "refresh_cache-4531bf11-b948-4d57-bf55-f33563815e26" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:40:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquired lock "refresh_cache-4531bf11-b948-4d57-bf55-f33563815e26" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:40:26 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:40:26 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:40:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-394d793d-9e38-481a-9249-f1dfba5bd878 req-e6efb4db-57aa-4c52-ac13-8a6e97b2cb75 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received event network-changed-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:40:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-394d793d-9e38-481a-9249-f1dfba5bd878 req-e6efb4db-57aa-4c52-ac13-8a6e97b2cb75 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Refreshing instance network info cache due to event network-changed-348d8e54-a814-4893-8636-de9e795794a2. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:40:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-394d793d-9e38-481a-9249-f1dfba5bd878 req-e6efb4db-57aa-4c52-ac13-8a6e97b2cb75 service nova] Acquiring lock "refresh_cache-4531bf11-b948-4d57-bf55-f33563815e26" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:40:26 user nova-compute[75247]: DEBUG nova.network.neutron [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Successfully updated port: b924c627-a11e-4fc4-8e23-d1a974c4de3d {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:40:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "refresh_cache-782289e2-91cd-4aee-9a08-eadfb2a5965b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:40:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquired lock "refresh_cache-782289e2-91cd-4aee-9a08-eadfb2a5965b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:40:26 user nova-compute[75247]: DEBUG nova.network.neutron [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:40:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-1866c136-74cc-41f8-ae15-18c1cefe4b82 req-00bd64ab-b5f9-4240-8238-a7aedb299a2c service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Received event network-changed-b924c627-a11e-4fc4-8e23-d1a974c4de3d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:40:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-1866c136-74cc-41f8-ae15-18c1cefe4b82 req-00bd64ab-b5f9-4240-8238-a7aedb299a2c service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Refreshing instance network info cache due to event network-changed-b924c627-a11e-4fc4-8e23-d1a974c4de3d. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:40:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1866c136-74cc-41f8-ae15-18c1cefe4b82 req-00bd64ab-b5f9-4240-8238-a7aedb299a2c service nova] Acquiring lock "refresh_cache-782289e2-91cd-4aee-9a08-eadfb2a5965b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:40:26 user nova-compute[75247]: DEBUG nova.network.neutron [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Updating instance_info_cache with network_info: [{"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Releasing lock "refresh_cache-4531bf11-b948-4d57-bf55-f33563815e26" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Instance network_info: |[{"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-394d793d-9e38-481a-9249-f1dfba5bd878 req-e6efb4db-57aa-4c52-ac13-8a6e97b2cb75 service nova] Acquired lock "refresh_cache-4531bf11-b948-4d57-bf55-f33563815e26" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.network.neutron [req-394d793d-9e38-481a-9249-f1dfba5bd878 req-e6efb4db-57aa-4c52-ac13-8a6e97b2cb75 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Refreshing network info cache for port 348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Start _get_guest_xml network_info=[{"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:40:27 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:40:27 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1307258181',display_name='tempest-ServerActionsTestOtherB-server-1307258181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1307258181',id=5,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXd4LdKL4pG7XKtcC6TX8wMNmPTD7z6hx6EQTzh/vLbbeocUHdpJ42qGTjwVyD4AThWLqebjjgjZMtQsvJgysEhbuskpjq8ZyizdS/bi/KghYHYkKPwpNCJccaNThNvgg==',key_name='tempest-keypair-1971386181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57ba4e5fa37f4fd29d6712069230d3e6',ramdisk_id='',reservation_id='r-wbn2uy0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-472154126',owner_user_name='tempest-ServerActionsTestOtherB-472154126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:40:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd4165666a1426aa1134c2889214b0f',uuid=4531bf11-b948-4d57-bf55-f33563815e26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Converting VIF {"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=348d8e54-a814-4893-8636-de9e795794a2,network=Network(7d8127bc-30f6-40e2-9bd3-2054440440d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348d8e54-a8') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.objects.instance [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lazy-loading 'pci_devices' on Instance uuid 4531bf11-b948-4d57-bf55-f33563815e26 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:40:27 user nova-compute[75247]:   <uuid>4531bf11-b948-4d57-bf55-f33563815e26</uuid>
Dec 06 12:40:27 user nova-compute[75247]:   <name>instance-00000005</name>
Dec 06 12:40:27 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:40:27 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:40:27 user nova-compute[75247]:   <metadata>
Dec 06 12:40:27 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:40:27 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:40:27 user nova-compute[75247]:       <nova:name>tempest-ServerActionsTestOtherB-server-1307258181</nova:name>
Dec 06 12:40:27 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:40:27</nova:creationTime>
Dec 06 12:40:27 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:40:27 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:40:27 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:40:27 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:40:27 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:40:27 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:40:27 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:40:27 user nova-compute[75247]:       <nova:owner>
Dec 06 12:40:27 user nova-compute[75247]:         <nova:user uuid="5dd4165666a1426aa1134c2889214b0f">tempest-ServerActionsTestOtherB-472154126-project-member</nova:user>
Dec 06 12:40:27 user nova-compute[75247]:         <nova:project uuid="57ba4e5fa37f4fd29d6712069230d3e6">tempest-ServerActionsTestOtherB-472154126</nova:project>
Dec 06 12:40:27 user nova-compute[75247]:       </nova:owner>
Dec 06 12:40:27 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:40:27 user nova-compute[75247]:       <nova:ports>
Dec 06 12:40:27 user nova-compute[75247]:         <nova:port uuid="348d8e54-a814-4893-8636-de9e795794a2">
Dec 06 12:40:27 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 06 12:40:27 user nova-compute[75247]:         </nova:port>
Dec 06 12:40:27 user nova-compute[75247]:       </nova:ports>
Dec 06 12:40:27 user nova-compute[75247]:     </nova:instance>
Dec 06 12:40:27 user nova-compute[75247]:   </metadata>
Dec 06 12:40:27 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:40:27 user nova-compute[75247]:     <system>
Dec 06 12:40:27 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:40:27 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:40:27 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:40:27 user nova-compute[75247]:       <entry name="serial">4531bf11-b948-4d57-bf55-f33563815e26</entry>
Dec 06 12:40:27 user nova-compute[75247]:       <entry name="uuid">4531bf11-b948-4d57-bf55-f33563815e26</entry>
Dec 06 12:40:27 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:40:27 user nova-compute[75247]:     </system>
Dec 06 12:40:27 user nova-compute[75247]:   </sysinfo>
Dec 06 12:40:27 user nova-compute[75247]:   <os>
Dec 06 12:40:27 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:40:27 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:40:27 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:40:27 user nova-compute[75247]:   </os>
Dec 06 12:40:27 user nova-compute[75247]:   <features>
Dec 06 12:40:27 user nova-compute[75247]:     <acpi/>
Dec 06 12:40:27 user nova-compute[75247]:     <apic/>
Dec 06 12:40:27 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:40:27 user nova-compute[75247]:   </features>
Dec 06 12:40:27 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:40:27 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:40:27 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:40:27 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:40:27 user nova-compute[75247]:   </clock>
Dec 06 12:40:27 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:40:27 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:40:27 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:40:27 user nova-compute[75247]:   </cpu>
Dec 06 12:40:27 user nova-compute[75247]:   <devices>
Dec 06 12:40:27 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:40:27 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:40:27 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk"/>
Dec 06 12:40:27 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:40:27 user nova-compute[75247]:     </disk>
Dec 06 12:40:27 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:40:27 user nova-compute[75247]:       <mac address="fa:16:3e:7d:fe:f6"/>
Dec 06 12:40:27 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:40:27 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:40:27 user nova-compute[75247]:       <target dev="tap348d8e54-a8"/>
Dec 06 12:40:27 user nova-compute[75247]:     </interface>
Dec 06 12:40:27 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:40:27 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/console.log" append="off"/>
Dec 06 12:40:27 user nova-compute[75247]:     </serial>
Dec 06 12:40:27 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:40:27 user nova-compute[75247]:     <video>
Dec 06 12:40:27 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:40:27 user nova-compute[75247]:     </video>
Dec 06 12:40:27 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:40:27 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:40:27 user nova-compute[75247]:     </rng>
Dec 06 12:40:27 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:40:27 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:40:27 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:40:27 user nova-compute[75247]:     </memballoon>
Dec 06 12:40:27 user nova-compute[75247]:   </devices>
Dec 06 12:40:27 user nova-compute[75247]: </domain>
Dec 06 12:40:27 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1307258181',display_name='tempest-ServerActionsTestOtherB-server-1307258181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1307258181',id=5,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXd4LdKL4pG7XKtcC6TX8wMNmPTD7z6hx6EQTzh/vLbbeocUHdpJ42qGTjwVyD4AThWLqebjjgjZMtQsvJgysEhbuskpjq8ZyizdS/bi/KghYHYkKPwpNCJccaNThNvgg==',key_name='tempest-keypair-1971386181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57ba4e5fa37f4fd29d6712069230d3e6',ramdisk_id='',reservation_id='r-wbn2uy0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-472154126',owner_user_name='tempest-ServerActionsTestOtherB-472154126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:40:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd4165666a1426aa1134c2889214b0f',uuid=4531bf11-b948-4d57-bf55-f33563815e26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Converting VIF {"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=348d8e54-a814-4893-8636-de9e795794a2,network=Network(7d8127bc-30f6-40e2-9bd3-2054440440d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348d8e54-a8') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG os_vif [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=348d8e54-a814-4893-8636-de9e795794a2,network=Network(7d8127bc-30f6-40e2-9bd3-2054440440d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348d8e54-a8') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2e811f34-8db5-5fe0-9563-f5f73c51a248', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap348d8e54-a8, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap348d8e54-a8, col_values=(('qos', UUID('3dc5bd8a-8377-4ab5-8632-23b1e5931a2d')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap348d8e54-a8, col_values=(('external_ids', {'iface-id': '348d8e54-a814-4893-8636-de9e795794a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:fe:f6', 'vm-uuid': '4531bf11-b948-4d57-bf55-f33563815e26'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:40:27 user nova-compute[75247]: INFO os_vif [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=348d8e54-a814-4893-8636-de9e795794a2,network=Network(7d8127bc-30f6-40e2-9bd3-2054440440d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348d8e54-a8')
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] No VIF found with MAC fa:16:3e:7d:fe:f6, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.network.neutron [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Successfully updated port: b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "refresh_cache-a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquired lock "refresh_cache-a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.network.neutron [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.compute.manager [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.compute.manager [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:27 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Instance spawned successfully.
Dec 06 12:40:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:40:28 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Instance spawned successfully.
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.network.neutron [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.network.neutron [req-394d793d-9e38-481a-9249-f1dfba5bd878 req-e6efb4db-57aa-4c52-ac13-8a6e97b2cb75 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Updated VIF entry in instance network info cache for port 348d8e54-a814-4893-8636-de9e795794a2. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.network.neutron [req-394d793d-9e38-481a-9249-f1dfba5bd878 req-e6efb4db-57aa-4c52-ac13-8a6e97b2cb75 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Updating instance_info_cache with network_info: [{"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:40:28 user nova-compute[75247]: INFO nova.compute.manager [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Took 15.34 seconds to spawn the instance on the hypervisor.
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.compute.manager [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:40:28 user nova-compute[75247]: INFO nova.compute.manager [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Took 14.18 seconds to spawn the instance on the hypervisor.
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.compute.manager [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-394d793d-9e38-481a-9249-f1dfba5bd878 req-e6efb4db-57aa-4c52-ac13-8a6e97b2cb75 service nova] Releasing lock "refresh_cache-4531bf11-b948-4d57-bf55-f33563815e26" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:40:28 user nova-compute[75247]: INFO nova.compute.manager [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Took 15.32 seconds to build instance.
Dec 06 12:40:28 user nova-compute[75247]: INFO nova.compute.manager [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Took 16.49 seconds to build instance.
Dec 06 12:40:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3194c1f2-5fbc-43ff-915e-db3be59ca4d9 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "70c4664e-ae7a-47de-bba7-18300391d209" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.477s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be67698d-d3de-4938-97bd-60412f6f5bb7 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.796s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.network.neutron [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Updating instance_info_cache with network_info: [{"id": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "address": "fa:16:3e:e4:cb:02", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924c627-a1", "ovs_interfaceid": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Releasing lock "refresh_cache-782289e2-91cd-4aee-9a08-eadfb2a5965b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.compute.manager [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Instance network_info: |[{"id": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "address": "fa:16:3e:e4:cb:02", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924c627-a1", "ovs_interfaceid": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1866c136-74cc-41f8-ae15-18c1cefe4b82 req-00bd64ab-b5f9-4240-8238-a7aedb299a2c service nova] Acquired lock "refresh_cache-782289e2-91cd-4aee-9a08-eadfb2a5965b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.network.neutron [req-1866c136-74cc-41f8-ae15-18c1cefe4b82 req-00bd64ab-b5f9-4240-8238-a7aedb299a2c service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Refreshing network info cache for port b924c627-a11e-4fc4-8e23-d1a974c4de3d {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Start _get_guest_xml network_info=[{"id": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "address": "fa:16:3e:e4:cb:02", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924c627-a1", "ovs_interfaceid": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:40:28 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:40:28 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-784837433',display_name='tempest-ServerActionsTestOtherA-server-784837433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-784837433',id=3,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1PSIn5waVLUBUVXmci26Bjo3OHYSVHL8/oxs3uvNoObvAgLe5HgiP5u61wX8nEvgm8XgeBjcCfcP/HNC/vep9hMtkBYH/Pz/i1rF8IkHYEtoKU1LHCX3Qi/2pvpu4Reg==',key_name='tempest-keypair-1071092699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0ccf15765714ca2a8c4700d2d6e3ed2',ramdisk_id='',reservation_id='r-460343j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2075667053',owner_user_name='tempest-ServerActionsTestOtherA-2075667053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:40:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13843d8f074da189dbd3e93750b811',uuid=782289e2-91cd-4aee-9a08-eadfb2a5965b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "address": "fa:16:3e:e4:cb:02", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924c627-a1", "ovs_interfaceid": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converting VIF {"id": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "address": "fa:16:3e:e4:cb:02", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924c627-a1", "ovs_interfaceid": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cb:02,bridge_name='br-int',has_traffic_filtering=True,id=b924c627-a11e-4fc4-8e23-d1a974c4de3d,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb924c627-a1') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.objects.instance [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lazy-loading 'pci_devices' on Instance uuid 782289e2-91cd-4aee-9a08-eadfb2a5965b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:40:28 user nova-compute[75247]:   <uuid>782289e2-91cd-4aee-9a08-eadfb2a5965b</uuid>
Dec 06 12:40:28 user nova-compute[75247]:   <name>instance-00000003</name>
Dec 06 12:40:28 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:40:28 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:40:28 user nova-compute[75247]:   <metadata>
Dec 06 12:40:28 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:40:28 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:40:28 user nova-compute[75247]:       <nova:name>tempest-ServerActionsTestOtherA-server-784837433</nova:name>
Dec 06 12:40:28 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:40:28</nova:creationTime>
Dec 06 12:40:28 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:40:28 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:40:28 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:40:28 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:40:28 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:40:28 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:40:28 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:40:28 user nova-compute[75247]:       <nova:owner>
Dec 06 12:40:28 user nova-compute[75247]:         <nova:user uuid="fc13843d8f074da189dbd3e93750b811">tempest-ServerActionsTestOtherA-2075667053-project-member</nova:user>
Dec 06 12:40:28 user nova-compute[75247]:         <nova:project uuid="a0ccf15765714ca2a8c4700d2d6e3ed2">tempest-ServerActionsTestOtherA-2075667053</nova:project>
Dec 06 12:40:28 user nova-compute[75247]:       </nova:owner>
Dec 06 12:40:28 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:40:28 user nova-compute[75247]:       <nova:ports>
Dec 06 12:40:28 user nova-compute[75247]:         <nova:port uuid="b924c627-a11e-4fc4-8e23-d1a974c4de3d">
Dec 06 12:40:28 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 06 12:40:28 user nova-compute[75247]:         </nova:port>
Dec 06 12:40:28 user nova-compute[75247]:       </nova:ports>
Dec 06 12:40:28 user nova-compute[75247]:     </nova:instance>
Dec 06 12:40:28 user nova-compute[75247]:   </metadata>
Dec 06 12:40:28 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:40:28 user nova-compute[75247]:     <system>
Dec 06 12:40:28 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:40:28 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:40:28 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:40:28 user nova-compute[75247]:       <entry name="serial">782289e2-91cd-4aee-9a08-eadfb2a5965b</entry>
Dec 06 12:40:28 user nova-compute[75247]:       <entry name="uuid">782289e2-91cd-4aee-9a08-eadfb2a5965b</entry>
Dec 06 12:40:28 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:40:28 user nova-compute[75247]:     </system>
Dec 06 12:40:28 user nova-compute[75247]:   </sysinfo>
Dec 06 12:40:28 user nova-compute[75247]:   <os>
Dec 06 12:40:28 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:40:28 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:40:28 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:40:28 user nova-compute[75247]:   </os>
Dec 06 12:40:28 user nova-compute[75247]:   <features>
Dec 06 12:40:28 user nova-compute[75247]:     <acpi/>
Dec 06 12:40:28 user nova-compute[75247]:     <apic/>
Dec 06 12:40:28 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:40:28 user nova-compute[75247]:   </features>
Dec 06 12:40:28 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:40:28 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:40:28 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:40:28 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:40:28 user nova-compute[75247]:   </clock>
Dec 06 12:40:28 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:40:28 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:40:28 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:40:28 user nova-compute[75247]:   </cpu>
Dec 06 12:40:28 user nova-compute[75247]:   <devices>
Dec 06 12:40:28 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:40:28 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:40:28 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk"/>
Dec 06 12:40:28 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:40:28 user nova-compute[75247]:     </disk>
Dec 06 12:40:28 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:40:28 user nova-compute[75247]:       <mac address="fa:16:3e:e4:cb:02"/>
Dec 06 12:40:28 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:40:28 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:40:28 user nova-compute[75247]:       <target dev="tapb924c627-a1"/>
Dec 06 12:40:28 user nova-compute[75247]:     </interface>
Dec 06 12:40:28 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:40:28 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/console.log" append="off"/>
Dec 06 12:40:28 user nova-compute[75247]:     </serial>
Dec 06 12:40:28 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:40:28 user nova-compute[75247]:     <video>
Dec 06 12:40:28 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:40:28 user nova-compute[75247]:     </video>
Dec 06 12:40:28 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:40:28 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:40:28 user nova-compute[75247]:     </rng>
Dec 06 12:40:28 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:40:28 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:40:28 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:40:28 user nova-compute[75247]:     </memballoon>
Dec 06 12:40:28 user nova-compute[75247]:   </devices>
Dec 06 12:40:28 user nova-compute[75247]: </domain>
Dec 06 12:40:28 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-784837433',display_name='tempest-ServerActionsTestOtherA-server-784837433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-784837433',id=3,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1PSIn5waVLUBUVXmci26Bjo3OHYSVHL8/oxs3uvNoObvAgLe5HgiP5u61wX8nEvgm8XgeBjcCfcP/HNC/vep9hMtkBYH/Pz/i1rF8IkHYEtoKU1LHCX3Qi/2pvpu4Reg==',key_name='tempest-keypair-1071092699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0ccf15765714ca2a8c4700d2d6e3ed2',ramdisk_id='',reservation_id='r-460343j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2075667053',owner_user_name='tempest-ServerActionsTestOtherA-2075667053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:40:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13843d8f074da189dbd3e93750b811',uuid=782289e2-91cd-4aee-9a08-eadfb2a5965b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "address": "fa:16:3e:e4:cb:02", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924c627-a1", "ovs_interfaceid": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converting VIF {"id": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "address": "fa:16:3e:e4:cb:02", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924c627-a1", "ovs_interfaceid": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cb:02,bridge_name='br-int',has_traffic_filtering=True,id=b924c627-a11e-4fc4-8e23-d1a974c4de3d,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb924c627-a1') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG os_vif [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cb:02,bridge_name='br-int',has_traffic_filtering=True,id=b924c627-a11e-4fc4-8e23-d1a974c4de3d,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb924c627-a1') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79154fac-bd12-56dc-9bb2-a4f91139d9f2', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb924c627-a1, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb924c627-a1, col_values=(('qos', UUID('23ec1a69-e1a5-4728-87f3-07e49d32ff36')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb924c627-a1, col_values=(('external_ids', {'iface-id': 'b924c627-a11e-4fc4-8e23-d1a974c4de3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:cb:02', 'vm-uuid': '782289e2-91cd-4aee-9a08-eadfb2a5965b'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:28 user nova-compute[75247]: INFO os_vif [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cb:02,bridge_name='br-int',has_traffic_filtering=True,id=b924c627-a11e-4fc4-8e23-d1a974c4de3d,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb924c627-a1')
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-06a34fc7-62ac-44ad-a5d7-2c22c56b8c66 req-c2ee1f26-5c14-4db1-ae43-ae1b30d3f15b service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received event network-changed-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-06a34fc7-62ac-44ad-a5d7-2c22c56b8c66 req-c2ee1f26-5c14-4db1-ae43-ae1b30d3f15b service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Refreshing instance network info cache due to event network-changed-b7c5418b-5afb-45b5-af6c-c46f82ef72cc. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-06a34fc7-62ac-44ad-a5d7-2c22c56b8c66 req-c2ee1f26-5c14-4db1-ae43-ae1b30d3f15b service nova] Acquiring lock "refresh_cache-a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:40:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] No VIF found with MAC fa:16:3e:e4:cb:02, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.network.neutron [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Updating instance_info_cache with network_info: [{"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Releasing lock "refresh_cache-a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.compute.manager [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Instance network_info: |[{"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-06a34fc7-62ac-44ad-a5d7-2c22c56b8c66 req-c2ee1f26-5c14-4db1-ae43-ae1b30d3f15b service nova] Acquired lock "refresh_cache-a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.network.neutron [req-06a34fc7-62ac-44ad-a5d7-2c22c56b8c66 req-c2ee1f26-5c14-4db1-ae43-ae1b30d3f15b service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Refreshing network info cache for port b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Start _get_guest_xml network_info=[{"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:40:29 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:40:29 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1942005817',display_name='tempest-AttachVolumeTestJSON-server-1942005817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1942005817',id=4,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGz+hJ0HTVL1CpIzjfndN5RB0FYKnfV0muFx2QzLM69CRA62Oly9Vvvkkj6Ccf/qOmS6iQUbmUmx8/zqty8k8DI7l9pqS+f/lxdpJZ0usxBwqzknFRlQwwi6Ig22Eo3VA==',key_name='tempest-keypair-21482804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f3aeaf6ffdb4cc0807d90e73e92fa7e',ramdisk_id='',reservation_id='r-wenfkxlt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-209684424',owner_user_name='tempest-AttachVolumeTestJSON-209684424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:40:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cb0e32ba6094d1e8053787bc1979b65',uuid=a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Converting VIF {"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2f:c5,bridge_name='br-int',has_traffic_filtering=True,id=b7c5418b-5afb-45b5-af6c-c46f82ef72cc,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5418b-5a') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.objects.instance [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'pci_devices' on Instance uuid a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:40:29 user nova-compute[75247]:   <uuid>a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a</uuid>
Dec 06 12:40:29 user nova-compute[75247]:   <name>instance-00000004</name>
Dec 06 12:40:29 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:40:29 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:40:29 user nova-compute[75247]:   <metadata>
Dec 06 12:40:29 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:40:29 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:40:29 user nova-compute[75247]:       <nova:name>tempest-AttachVolumeTestJSON-server-1942005817</nova:name>
Dec 06 12:40:29 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:40:29</nova:creationTime>
Dec 06 12:40:29 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:40:29 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:40:29 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:40:29 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:40:29 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:40:29 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:40:29 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:40:29 user nova-compute[75247]:       <nova:owner>
Dec 06 12:40:29 user nova-compute[75247]:         <nova:user uuid="4cb0e32ba6094d1e8053787bc1979b65">tempest-AttachVolumeTestJSON-209684424-project-member</nova:user>
Dec 06 12:40:29 user nova-compute[75247]:         <nova:project uuid="4f3aeaf6ffdb4cc0807d90e73e92fa7e">tempest-AttachVolumeTestJSON-209684424</nova:project>
Dec 06 12:40:29 user nova-compute[75247]:       </nova:owner>
Dec 06 12:40:29 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:40:29 user nova-compute[75247]:       <nova:ports>
Dec 06 12:40:29 user nova-compute[75247]:         <nova:port uuid="b7c5418b-5afb-45b5-af6c-c46f82ef72cc">
Dec 06 12:40:29 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 06 12:40:29 user nova-compute[75247]:         </nova:port>
Dec 06 12:40:29 user nova-compute[75247]:       </nova:ports>
Dec 06 12:40:29 user nova-compute[75247]:     </nova:instance>
Dec 06 12:40:29 user nova-compute[75247]:   </metadata>
Dec 06 12:40:29 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:40:29 user nova-compute[75247]:     <system>
Dec 06 12:40:29 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:40:29 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:40:29 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:40:29 user nova-compute[75247]:       <entry name="serial">a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a</entry>
Dec 06 12:40:29 user nova-compute[75247]:       <entry name="uuid">a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a</entry>
Dec 06 12:40:29 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:40:29 user nova-compute[75247]:     </system>
Dec 06 12:40:29 user nova-compute[75247]:   </sysinfo>
Dec 06 12:40:29 user nova-compute[75247]:   <os>
Dec 06 12:40:29 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:40:29 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:40:29 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:40:29 user nova-compute[75247]:   </os>
Dec 06 12:40:29 user nova-compute[75247]:   <features>
Dec 06 12:40:29 user nova-compute[75247]:     <acpi/>
Dec 06 12:40:29 user nova-compute[75247]:     <apic/>
Dec 06 12:40:29 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:40:29 user nova-compute[75247]:   </features>
Dec 06 12:40:29 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:40:29 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:40:29 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:40:29 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:40:29 user nova-compute[75247]:   </clock>
Dec 06 12:40:29 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:40:29 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:40:29 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:40:29 user nova-compute[75247]:   </cpu>
Dec 06 12:40:29 user nova-compute[75247]:   <devices>
Dec 06 12:40:29 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:40:29 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:40:29 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk"/>
Dec 06 12:40:29 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:40:29 user nova-compute[75247]:     </disk>
Dec 06 12:40:29 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:40:29 user nova-compute[75247]:       <mac address="fa:16:3e:ae:2f:c5"/>
Dec 06 12:40:29 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:40:29 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:40:29 user nova-compute[75247]:       <target dev="tapb7c5418b-5a"/>
Dec 06 12:40:29 user nova-compute[75247]:     </interface>
Dec 06 12:40:29 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:40:29 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/console.log" append="off"/>
Dec 06 12:40:29 user nova-compute[75247]:     </serial>
Dec 06 12:40:29 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:40:29 user nova-compute[75247]:     <video>
Dec 06 12:40:29 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:40:29 user nova-compute[75247]:     </video>
Dec 06 12:40:29 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:40:29 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:40:29 user nova-compute[75247]:     </rng>
Dec 06 12:40:29 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:40:29 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:40:29 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:40:29 user nova-compute[75247]:     </memballoon>
Dec 06 12:40:29 user nova-compute[75247]:   </devices>
Dec 06 12:40:29 user nova-compute[75247]: </domain>
Dec 06 12:40:29 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1942005817',display_name='tempest-AttachVolumeTestJSON-server-1942005817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1942005817',id=4,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGz+hJ0HTVL1CpIzjfndN5RB0FYKnfV0muFx2QzLM69CRA62Oly9Vvvkkj6Ccf/qOmS6iQUbmUmx8/zqty8k8DI7l9pqS+f/lxdpJZ0usxBwqzknFRlQwwi6Ig22Eo3VA==',key_name='tempest-keypair-21482804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f3aeaf6ffdb4cc0807d90e73e92fa7e',ramdisk_id='',reservation_id='r-wenfkxlt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-209684424',owner_user_name='tempest-AttachVolumeTestJSON-209684424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:40:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cb0e32ba6094d1e8053787bc1979b65',uuid=a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Converting VIF {"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2f:c5,bridge_name='br-int',has_traffic_filtering=True,id=b7c5418b-5afb-45b5-af6c-c46f82ef72cc,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5418b-5a') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG os_vif [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2f:c5,bridge_name='br-int',has_traffic_filtering=True,id=b7c5418b-5afb-45b5-af6c-c46f82ef72cc,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5418b-5a') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '19928c8e-ba45-58a2-9df8-574e27ffb82c', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7c5418b-5a, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7c5418b-5a, col_values=(('qos', UUID('f9c7451c-ad67-4d52-9c97-9e06c1f56a85')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7c5418b-5a, col_values=(('external_ids', {'iface-id': 'b7c5418b-5afb-45b5-af6c-c46f82ef72cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:2f:c5', 'vm-uuid': 'a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:40:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:30 user nova-compute[75247]: INFO os_vif [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2f:c5,bridge_name='br-int',has_traffic_filtering=True,id=b7c5418b-5afb-45b5-af6c-c46f82ef72cc,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5418b-5a')
Dec 06 12:40:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:40:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] No VIF found with MAC fa:16:3e:ae:2f:c5, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:40:30 user nova-compute[75247]: DEBUG nova.network.neutron [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Successfully updated port: a205065f-e23d-46b2-9f34-f77ff2b3ebb1 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:40:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "refresh_cache-ec9eea5d-dc9a-4a65-881a-a89538e3a593" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:40:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquired lock "refresh_cache-ec9eea5d-dc9a-4a65-881a-a89538e3a593" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:40:30 user nova-compute[75247]: DEBUG nova.network.neutron [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:40:30 user nova-compute[75247]: DEBUG nova.network.neutron [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:40:30 user nova-compute[75247]: DEBUG nova.network.neutron [req-1866c136-74cc-41f8-ae15-18c1cefe4b82 req-00bd64ab-b5f9-4240-8238-a7aedb299a2c service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Updated VIF entry in instance network info cache for port b924c627-a11e-4fc4-8e23-d1a974c4de3d. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:40:30 user nova-compute[75247]: DEBUG nova.network.neutron [req-1866c136-74cc-41f8-ae15-18c1cefe4b82 req-00bd64ab-b5f9-4240-8238-a7aedb299a2c service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Updating instance_info_cache with network_info: [{"id": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "address": "fa:16:3e:e4:cb:02", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924c627-a1", "ovs_interfaceid": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:40:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1866c136-74cc-41f8-ae15-18c1cefe4b82 req-00bd64ab-b5f9-4240-8238-a7aedb299a2c service nova] Releasing lock "refresh_cache-782289e2-91cd-4aee-9a08-eadfb2a5965b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.compute.manager [req-33135a4f-9a43-4177-8453-89b1c8f381a0 req-426f4dd9-2fbb-461a-80af-f071fe80b282 service nova] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Received event network-changed-a205065f-e23d-46b2-9f34-f77ff2b3ebb1 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.compute.manager [req-33135a4f-9a43-4177-8453-89b1c8f381a0 req-426f4dd9-2fbb-461a-80af-f071fe80b282 service nova] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Refreshing instance network info cache due to event network-changed-a205065f-e23d-46b2-9f34-f77ff2b3ebb1. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-33135a4f-9a43-4177-8453-89b1c8f381a0 req-426f4dd9-2fbb-461a-80af-f071fe80b282 service nova] Acquiring lock "refresh_cache-ec9eea5d-dc9a-4a65-881a-a89538e3a593" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.network.neutron [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Updating instance_info_cache with network_info: [{"id": "a205065f-e23d-46b2-9f34-f77ff2b3ebb1", "address": "fa:16:3e:6b:3a:c0", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa205065f-e2", "ovs_interfaceid": "a205065f-e23d-46b2-9f34-f77ff2b3ebb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.network.neutron [req-06a34fc7-62ac-44ad-a5d7-2c22c56b8c66 req-c2ee1f26-5c14-4db1-ae43-ae1b30d3f15b service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Updated VIF entry in instance network info cache for port b7c5418b-5afb-45b5-af6c-c46f82ef72cc. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.network.neutron [req-06a34fc7-62ac-44ad-a5d7-2c22c56b8c66 req-c2ee1f26-5c14-4db1-ae43-ae1b30d3f15b service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Updating instance_info_cache with network_info: [{"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Releasing lock "refresh_cache-ec9eea5d-dc9a-4a65-881a-a89538e3a593" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.compute.manager [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Instance network_info: |[{"id": "a205065f-e23d-46b2-9f34-f77ff2b3ebb1", "address": "fa:16:3e:6b:3a:c0", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa205065f-e2", "ovs_interfaceid": "a205065f-e23d-46b2-9f34-f77ff2b3ebb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-33135a4f-9a43-4177-8453-89b1c8f381a0 req-426f4dd9-2fbb-461a-80af-f071fe80b282 service nova] Acquired lock "refresh_cache-ec9eea5d-dc9a-4a65-881a-a89538e3a593" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.network.neutron [req-33135a4f-9a43-4177-8453-89b1c8f381a0 req-426f4dd9-2fbb-461a-80af-f071fe80b282 service nova] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Refreshing network info cache for port a205065f-e23d-46b2-9f34-f77ff2b3ebb1 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Start _get_guest_xml network_info=[{"id": "a205065f-e23d-46b2-9f34-f77ff2b3ebb1", "address": "fa:16:3e:6b:3a:c0", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa205065f-e2", "ovs_interfaceid": "a205065f-e23d-46b2-9f34-f77ff2b3ebb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-06a34fc7-62ac-44ad-a5d7-2c22c56b8c66 req-c2ee1f26-5c14-4db1-ae43-ae1b30d3f15b service nova] Releasing lock "refresh_cache-a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:40:31 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:40:31 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-740815625',display_name='tempest-AttachVolumeNegativeTest-server-740815625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-740815625',id=6,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmfPng4L5JeOOZpBaUR9V4No179LblAI1enFVcrX82Z+xYTXjk9B+MXKBdY+s63uqbwtVFdjzeWq/zLouKdnDMgMYSROfjndGihLxxoWODJShYjImIOS3rgXN37DY7lxg==',key_name='tempest-keypair-609900860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a6b077946334f1c8fd16d091a7738e1',ramdisk_id='',reservation_id='r-4nvivrlo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2136789566',owner_user_name='tempest-AttachVolumeNegativeTest-2136789566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:40:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d7becd4d5734bc2b652e6f37492eb5e',uuid=ec9eea5d-dc9a-4a65-881a-a89538e3a593,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a205065f-e23d-46b2-9f34-f77ff2b3ebb1", "address": "fa:16:3e:6b:3a:c0", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa205065f-e2", "ovs_interfaceid": "a205065f-e23d-46b2-9f34-f77ff2b3ebb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Converting VIF {"id": "a205065f-e23d-46b2-9f34-f77ff2b3ebb1", "address": "fa:16:3e:6b:3a:c0", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa205065f-e2", "ovs_interfaceid": "a205065f-e23d-46b2-9f34-f77ff2b3ebb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:3a:c0,bridge_name='br-int',has_traffic_filtering=True,id=a205065f-e23d-46b2-9f34-f77ff2b3ebb1,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa205065f-e2') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.objects.instance [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lazy-loading 'pci_devices' on Instance uuid ec9eea5d-dc9a-4a65-881a-a89538e3a593 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:40:31 user nova-compute[75247]:   <uuid>ec9eea5d-dc9a-4a65-881a-a89538e3a593</uuid>
Dec 06 12:40:31 user nova-compute[75247]:   <name>instance-00000006</name>
Dec 06 12:40:31 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:40:31 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:40:31 user nova-compute[75247]:   <metadata>
Dec 06 12:40:31 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:40:31 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:40:31 user nova-compute[75247]:       <nova:name>tempest-AttachVolumeNegativeTest-server-740815625</nova:name>
Dec 06 12:40:31 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:40:31</nova:creationTime>
Dec 06 12:40:31 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:40:31 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:40:31 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:40:31 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:40:31 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:40:31 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:40:31 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:40:31 user nova-compute[75247]:       <nova:owner>
Dec 06 12:40:31 user nova-compute[75247]:         <nova:user uuid="9d7becd4d5734bc2b652e6f37492eb5e">tempest-AttachVolumeNegativeTest-2136789566-project-member</nova:user>
Dec 06 12:40:31 user nova-compute[75247]:         <nova:project uuid="6a6b077946334f1c8fd16d091a7738e1">tempest-AttachVolumeNegativeTest-2136789566</nova:project>
Dec 06 12:40:31 user nova-compute[75247]:       </nova:owner>
Dec 06 12:40:31 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:40:31 user nova-compute[75247]:       <nova:ports>
Dec 06 12:40:31 user nova-compute[75247]:         <nova:port uuid="a205065f-e23d-46b2-9f34-f77ff2b3ebb1">
Dec 06 12:40:31 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 06 12:40:31 user nova-compute[75247]:         </nova:port>
Dec 06 12:40:31 user nova-compute[75247]:       </nova:ports>
Dec 06 12:40:31 user nova-compute[75247]:     </nova:instance>
Dec 06 12:40:31 user nova-compute[75247]:   </metadata>
Dec 06 12:40:31 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:40:31 user nova-compute[75247]:     <system>
Dec 06 12:40:31 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:40:31 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:40:31 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:40:31 user nova-compute[75247]:       <entry name="serial">ec9eea5d-dc9a-4a65-881a-a89538e3a593</entry>
Dec 06 12:40:31 user nova-compute[75247]:       <entry name="uuid">ec9eea5d-dc9a-4a65-881a-a89538e3a593</entry>
Dec 06 12:40:31 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:40:31 user nova-compute[75247]:     </system>
Dec 06 12:40:31 user nova-compute[75247]:   </sysinfo>
Dec 06 12:40:31 user nova-compute[75247]:   <os>
Dec 06 12:40:31 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:40:31 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:40:31 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:40:31 user nova-compute[75247]:   </os>
Dec 06 12:40:31 user nova-compute[75247]:   <features>
Dec 06 12:40:31 user nova-compute[75247]:     <acpi/>
Dec 06 12:40:31 user nova-compute[75247]:     <apic/>
Dec 06 12:40:31 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:40:31 user nova-compute[75247]:   </features>
Dec 06 12:40:31 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:40:31 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:40:31 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:40:31 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:40:31 user nova-compute[75247]:   </clock>
Dec 06 12:40:31 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:40:31 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:40:31 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:40:31 user nova-compute[75247]:   </cpu>
Dec 06 12:40:31 user nova-compute[75247]:   <devices>
Dec 06 12:40:31 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:40:31 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:40:31 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk"/>
Dec 06 12:40:31 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:40:31 user nova-compute[75247]:     </disk>
Dec 06 12:40:31 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:40:31 user nova-compute[75247]:       <mac address="fa:16:3e:6b:3a:c0"/>
Dec 06 12:40:31 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:40:31 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:40:31 user nova-compute[75247]:       <target dev="tapa205065f-e2"/>
Dec 06 12:40:31 user nova-compute[75247]:     </interface>
Dec 06 12:40:31 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:40:31 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/console.log" append="off"/>
Dec 06 12:40:31 user nova-compute[75247]:     </serial>
Dec 06 12:40:31 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:40:31 user nova-compute[75247]:     <video>
Dec 06 12:40:31 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:40:31 user nova-compute[75247]:     </video>
Dec 06 12:40:31 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:40:31 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:40:31 user nova-compute[75247]:     </rng>
Dec 06 12:40:31 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:40:31 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:40:31 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:40:31 user nova-compute[75247]:     </memballoon>
Dec 06 12:40:31 user nova-compute[75247]:   </devices>
Dec 06 12:40:31 user nova-compute[75247]: </domain>
Dec 06 12:40:31 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-740815625',display_name='tempest-AttachVolumeNegativeTest-server-740815625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-740815625',id=6,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmfPng4L5JeOOZpBaUR9V4No179LblAI1enFVcrX82Z+xYTXjk9B+MXKBdY+s63uqbwtVFdjzeWq/zLouKdnDMgMYSROfjndGihLxxoWODJShYjImIOS3rgXN37DY7lxg==',key_name='tempest-keypair-609900860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a6b077946334f1c8fd16d091a7738e1',ramdisk_id='',reservation_id='r-4nvivrlo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2136789566',owner_user_name='tempest-AttachVolumeNegativeTest-2136789566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:40:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d7becd4d5734bc2b652e6f37492eb5e',uuid=ec9eea5d-dc9a-4a65-881a-a89538e3a593,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a205065f-e23d-46b2-9f34-f77ff2b3ebb1", "address": "fa:16:3e:6b:3a:c0", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa205065f-e2", "ovs_interfaceid": "a205065f-e23d-46b2-9f34-f77ff2b3ebb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Converting VIF {"id": "a205065f-e23d-46b2-9f34-f77ff2b3ebb1", "address": "fa:16:3e:6b:3a:c0", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa205065f-e2", "ovs_interfaceid": "a205065f-e23d-46b2-9f34-f77ff2b3ebb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:3a:c0,bridge_name='br-int',has_traffic_filtering=True,id=a205065f-e23d-46b2-9f34-f77ff2b3ebb1,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa205065f-e2') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG os_vif [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:3a:c0,bridge_name='br-int',has_traffic_filtering=True,id=a205065f-e23d-46b2-9f34-f77ff2b3ebb1,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa205065f-e2') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de5b8905-06f9-5524-8fd3-b16c0e49b819', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa205065f-e2, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa205065f-e2, col_values=(('qos', UUID('c4b6eaea-229f-4cfd-abe4-fb70b9448eeb')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa205065f-e2, col_values=(('external_ids', {'iface-id': 'a205065f-e23d-46b2-9f34-f77ff2b3ebb1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:3a:c0', 'vm-uuid': 'ec9eea5d-dc9a-4a65-881a-a89538e3a593'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:31 user nova-compute[75247]: INFO os_vif [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:3a:c0,bridge_name='br-int',has_traffic_filtering=True,id=a205065f-e23d-46b2-9f34-f77ff2b3ebb1,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa205065f-e2')
Dec 06 12:40:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:40:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] No VIF found with MAC fa:16:3e:6b:3a:c0, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:40:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:32 user nova-compute[75247]: DEBUG nova.network.neutron [req-33135a4f-9a43-4177-8453-89b1c8f381a0 req-426f4dd9-2fbb-461a-80af-f071fe80b282 service nova] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Updated VIF entry in instance network info cache for port a205065f-e23d-46b2-9f34-f77ff2b3ebb1. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:40:32 user nova-compute[75247]: DEBUG nova.network.neutron [req-33135a4f-9a43-4177-8453-89b1c8f381a0 req-426f4dd9-2fbb-461a-80af-f071fe80b282 service nova] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Updating instance_info_cache with network_info: [{"id": "a205065f-e23d-46b2-9f34-f77ff2b3ebb1", "address": "fa:16:3e:6b:3a:c0", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa205065f-e2", "ovs_interfaceid": "a205065f-e23d-46b2-9f34-f77ff2b3ebb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:40:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-33135a4f-9a43-4177-8453-89b1c8f381a0 req-426f4dd9-2fbb-461a-80af-f071fe80b282 service nova] Releasing lock "refresh_cache-ec9eea5d-dc9a-4a65-881a-a89538e3a593" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:40:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:33 user nova-compute[75247]: DEBUG nova.compute.manager [req-27f6f60c-7297-4ce0-854c-b1146c61e728 req-37c56f7a-e1a5-4562-8218-e099e1beff8e service nova] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Received event network-vif-plugged-2c3b146f-74ce-47d5-9bca-54c20e685cdb {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:40:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-27f6f60c-7297-4ce0-854c-b1146c61e728 req-37c56f7a-e1a5-4562-8218-e099e1beff8e service nova] Acquiring lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-27f6f60c-7297-4ce0-854c-b1146c61e728 req-37c56f7a-e1a5-4562-8218-e099e1beff8e service nova] Lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-27f6f60c-7297-4ce0-854c-b1146c61e728 req-37c56f7a-e1a5-4562-8218-e099e1beff8e service nova] Lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:33 user nova-compute[75247]: DEBUG nova.compute.manager [req-27f6f60c-7297-4ce0-854c-b1146c61e728 req-37c56f7a-e1a5-4562-8218-e099e1beff8e service nova] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] No waiting events found dispatching network-vif-plugged-2c3b146f-74ce-47d5-9bca-54c20e685cdb {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:40:33 user nova-compute[75247]: WARNING nova.compute.manager [req-27f6f60c-7297-4ce0-854c-b1146c61e728 req-37c56f7a-e1a5-4562-8218-e099e1beff8e service nova] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Received unexpected event network-vif-plugged-2c3b146f-74ce-47d5-9bca-54c20e685cdb for instance with vm_state active and task_state None.
Dec 06 12:40:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:35 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:40:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:40:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:35 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Instance spawned successfully.
Dec 06 12:40:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:40:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:35 user nova-compute[75247]: INFO nova.compute.manager [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Took 14.74 seconds to spawn the instance on the hypervisor.
Dec 06 12:40:35 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:40:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:35 user nova-compute[75247]: DEBUG nova.compute.manager [req-7e699cf7-5ebb-45e6-a90b-323155b6f265 req-4c4145cf-5f3c-4445-ac42-9b25e90844b4 service nova] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Received event network-vif-plugged-2c3b146f-74ce-47d5-9bca-54c20e685cdb {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:40:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7e699cf7-5ebb-45e6-a90b-323155b6f265 req-4c4145cf-5f3c-4445-ac42-9b25e90844b4 service nova] Acquiring lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7e699cf7-5ebb-45e6-a90b-323155b6f265 req-4c4145cf-5f3c-4445-ac42-9b25e90844b4 service nova] Lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7e699cf7-5ebb-45e6-a90b-323155b6f265 req-4c4145cf-5f3c-4445-ac42-9b25e90844b4 service nova] Lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:35 user nova-compute[75247]: DEBUG nova.compute.manager [req-7e699cf7-5ebb-45e6-a90b-323155b6f265 req-4c4145cf-5f3c-4445-ac42-9b25e90844b4 service nova] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] No waiting events found dispatching network-vif-plugged-2c3b146f-74ce-47d5-9bca-54c20e685cdb {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:40:35 user nova-compute[75247]: WARNING nova.compute.manager [req-7e699cf7-5ebb-45e6-a90b-323155b6f265 req-4c4145cf-5f3c-4445-ac42-9b25e90844b4 service nova] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Received unexpected event network-vif-plugged-2c3b146f-74ce-47d5-9bca-54c20e685cdb for instance with vm_state active and task_state None.
Dec 06 12:40:35 user nova-compute[75247]: INFO nova.compute.manager [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Took 15.85 seconds to build instance.
Dec 06 12:40:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7cbc54b-56c3-43d6-87d8-e6f95f2e616f tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "4531bf11-b948-4d57-bf55-f33563815e26" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.165s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:36 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:36 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:36 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:36 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:37 user nova-compute[75247]: DEBUG nova.compute.manager [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:40:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:40:37 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Instance spawned successfully.
Dec 06 12:40:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:40:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:37 user nova-compute[75247]: DEBUG nova.compute.manager [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:40:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:40:37 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Instance spawned successfully.
Dec 06 12:40:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:40:37 user nova-compute[75247]: INFO nova.compute.manager [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Took 18.33 seconds to spawn the instance on the hypervisor.
Dec 06 12:40:37 user nova-compute[75247]: DEBUG nova.compute.manager [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:40:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:37 user nova-compute[75247]: INFO nova.compute.manager [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Took 19.23 seconds to build instance.
Dec 06 12:40:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be23b960-38c1-4d2a-8a8e-92d3996cff58 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "782289e2-91cd-4aee-9a08-eadfb2a5965b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.347s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:37 user nova-compute[75247]: DEBUG nova.compute.manager [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:40:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:40:37 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Instance spawned successfully.
Dec 06 12:40:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:40:38 user nova-compute[75247]: INFO nova.compute.manager [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Took 18.17 seconds to spawn the instance on the hypervisor.
Dec 06 12:40:38 user nova-compute[75247]: DEBUG nova.compute.manager [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:40:38 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:38 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:38 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:38 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:38 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:38 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:38 user nova-compute[75247]: INFO nova.compute.manager [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Took 16.14 seconds to spawn the instance on the hypervisor.
Dec 06 12:40:38 user nova-compute[75247]: DEBUG nova.compute.manager [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:40:38 user nova-compute[75247]: INFO nova.compute.manager [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Took 19.62 seconds to build instance.
Dec 06 12:40:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f382f80-a5b4-45ab-948c-7eb3b5af61bc tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.799s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:38 user nova-compute[75247]: INFO nova.compute.manager [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Took 17.19 seconds to build instance.
Dec 06 12:40:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1b06e53b-a1e4-46d1-88b5-cf52585f42d8 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.358s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Acquiring lock "f0e26668-e253-409a-a011-a54e8ad3ebb7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "f0e26668-e253-409a-a011-a54e8ad3ebb7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:40 user nova-compute[75247]: DEBUG nova.compute.manager [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:40:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:40 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:40:40 user nova-compute[75247]: INFO nova.compute.claims [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Claim successful on node user
Dec 06 12:40:41 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:40:41 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:40:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.813s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:41 user nova-compute[75247]: DEBUG nova.compute.manager [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:40:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:41 user nova-compute[75247]: DEBUG nova.compute.manager [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:40:41 user nova-compute[75247]: DEBUG nova.network.neutron [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:40:41 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Dec 06 12:40:41 user nova-compute[75247]: DEBUG nova.compute.manager [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:40:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:41 user nova-compute[75247]: DEBUG nova.compute.manager [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:40:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:40:41 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Creating image(s)
Dec 06 12:40:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "/opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "/opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.014s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Acquiring lock "1fcebc9900475945aad86b0df6a6f74e3252032d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "1fcebc9900475945aad86b0df6a6f74e3252032d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fcebc9900475945aad86b0df6a6f74e3252032d.part --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:42 user nova-compute[75247]: DEBUG nova.policy [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f734dd5ead24a3bbddace417e18bbbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ed07eb8a8d4dfe9ba6bd8af697f1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:40:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fcebc9900475945aad86b0df6a6f74e3252032d.part --force-share --output=json" returned: 0 in 0.320s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:42 user nova-compute[75247]: DEBUG nova.virt.images [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] 2d2536e6-9076-431d-93fe-0b9e2aab6535 was qcow2, converting to raw {{(pid=75247) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 12:40:42 user nova-compute[75247]: DEBUG nova.privsep.utils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 12:40:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1fcebc9900475945aad86b0df6a6f74e3252032d.part /opt/stack/data/nova/instances/_base/1fcebc9900475945aad86b0df6a6f74e3252032d.converted {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Acquiring lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:43 user nova-compute[75247]: DEBUG nova.compute.manager [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:40:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:43 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:40:43 user nova-compute[75247]: INFO nova.compute.claims [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Claim successful on node user
Dec 06 12:40:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1fcebc9900475945aad86b0df6a6f74e3252032d.part /opt/stack/data/nova/instances/_base/1fcebc9900475945aad86b0df6a6f74e3252032d.converted" returned: 0 in 0.628s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fcebc9900475945aad86b0df6a6f74e3252032d.converted --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fcebc9900475945aad86b0df6a6f74e3252032d.converted --force-share --output=json" returned: 0 in 0.280s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "1fcebc9900475945aad86b0df6a6f74e3252032d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.891s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fcebc9900475945aad86b0df6a6f74e3252032d --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:44 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:40:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fcebc9900475945aad86b0df6a6f74e3252032d --force-share --output=json" returned: 0 in 0.347s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Acquiring lock "1fcebc9900475945aad86b0df6a6f74e3252032d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "1fcebc9900475945aad86b0df6a6f74e3252032d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fcebc9900475945aad86b0df6a6f74e3252032d --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:44 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:40:44 user nova-compute[75247]: DEBUG nova.network.neutron [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Successfully created port: 7ec9c7ac-57f1-42a5-b2ff-df899a930efd {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:40:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.008s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:44 user nova-compute[75247]: DEBUG nova.compute.manager [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:40:44 user nova-compute[75247]: DEBUG nova.compute.manager [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:40:44 user nova-compute[75247]: DEBUG nova.network.neutron [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:40:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fcebc9900475945aad86b0df6a6f74e3252032d --force-share --output=json" returned: 0 in 0.343s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1fcebc9900475945aad86b0df6a6f74e3252032d,backing_fmt=raw /opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:44 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:40:44 user nova-compute[75247]: DEBUG nova.compute.manager [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:40:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1fcebc9900475945aad86b0df6a6f74e3252032d,backing_fmt=raw /opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/disk 1073741824" returned: 0 in 0.135s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "1fcebc9900475945aad86b0df6a6f74e3252032d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.482s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fcebc9900475945aad86b0df6a6f74e3252032d --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:44 user nova-compute[75247]: DEBUG nova.policy [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1e02d70124b494c839a0b4f9b8267d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa091fb4534e24b685fec6e6ca52e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:40:44 user nova-compute[75247]: DEBUG nova.compute.manager [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:40:44 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:40:44 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Creating image(s)
Dec 06 12:40:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Acquiring lock "/opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "/opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "/opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fcebc9900475945aad86b0df6a6f74e3252032d --force-share --output=json" returned: 0 in 0.303s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:45 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:40:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.301s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:45 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Cannot resize image /opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:40:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:40:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Ensure instance console log exists: /opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:40:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.275s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/disk 1073741824" returned: 0 in 0.071s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.352s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Acquiring lock "f2e75618-9164-4527-a6a3-5f5195effccf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "f2e75618-9164-4527-a6a3-5f5195effccf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:46 user nova-compute[75247]: DEBUG nova.compute.manager [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:40:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.445s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:46 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:40:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:46 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:40:46 user nova-compute[75247]: INFO nova.compute.claims [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Claim successful on node user
Dec 06 12:40:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:46 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Cannot resize image /opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:40:46 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:40:46 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Ensure instance console log exists: /opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:40:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:46 user nova-compute[75247]: DEBUG nova.network.neutron [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Successfully created port: ee42c358-3097-4050-a477-8a48b500de81 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:40:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:47 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:40:47 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:40:47 user nova-compute[75247]: DEBUG nova.network.neutron [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Successfully updated port: 7ec9c7ac-57f1-42a5-b2ff-df899a930efd {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:40:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.944s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:47 user nova-compute[75247]: DEBUG nova.compute.manager [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:40:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Acquiring lock "refresh_cache-f0e26668-e253-409a-a011-a54e8ad3ebb7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:40:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Acquired lock "refresh_cache-f0e26668-e253-409a-a011-a54e8ad3ebb7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:40:47 user nova-compute[75247]: DEBUG nova.network.neutron [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:40:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-b2dfd6be-f35e-4364-92f5-929598b216c3 req-0843d1ca-f4ba-4047-9598-674083c7b038 service nova] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Received event network-changed-7ec9c7ac-57f1-42a5-b2ff-df899a930efd {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:40:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-b2dfd6be-f35e-4364-92f5-929598b216c3 req-0843d1ca-f4ba-4047-9598-674083c7b038 service nova] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Refreshing instance network info cache due to event network-changed-7ec9c7ac-57f1-42a5-b2ff-df899a930efd. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:40:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b2dfd6be-f35e-4364-92f5-929598b216c3 req-0843d1ca-f4ba-4047-9598-674083c7b038 service nova] Acquiring lock "refresh_cache-f0e26668-e253-409a-a011-a54e8ad3ebb7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:40:47 user nova-compute[75247]: DEBUG nova.compute.manager [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:40:47 user nova-compute[75247]: DEBUG nova.network.neutron [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:40:47 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:40:47 user nova-compute[75247]: DEBUG nova.network.neutron [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:40:47 user nova-compute[75247]: DEBUG nova.compute.manager [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:40:47 user nova-compute[75247]: DEBUG nova.policy [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14563ea794be4e5bb54c7b4cabde8ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4031371ec46d42c2bd887bac7edf42a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:40:47 user nova-compute[75247]: DEBUG nova.compute.manager [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:40:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:40:47 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Creating image(s)
Dec 06 12:40:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "/opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "/opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.230s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.network.neutron [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Successfully updated port: ee42c358-3097-4050-a477-8a48b500de81 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Acquiring lock "refresh_cache-dbb64a66-f500-407b-ae92-80f27eb6ce2e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Acquired lock "refresh_cache-dbb64a66-f500-407b-ae92-80f27eb6ce2e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.network.neutron [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.262s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.network.neutron [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.network.neutron [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Updating instance_info_cache with network_info: [{"id": "7ec9c7ac-57f1-42a5-b2ff-df899a930efd", "address": "fa:16:3e:ae:36:46", "network": {"id": "a3353b80-0ced-43e4-8cea-c98cd7d8c132", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638714784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ed07eb8a8d4dfe9ba6bd8af697f1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ec9c7ac-57", "ovs_interfaceid": "7ec9c7ac-57f1-42a5-b2ff-df899a930efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk 1073741824" returned: 0 in 0.085s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.357s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Releasing lock "refresh_cache-f0e26668-e253-409a-a011-a54e8ad3ebb7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.compute.manager [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Instance network_info: |[{"id": "7ec9c7ac-57f1-42a5-b2ff-df899a930efd", "address": "fa:16:3e:ae:36:46", "network": {"id": "a3353b80-0ced-43e4-8cea-c98cd7d8c132", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638714784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ed07eb8a8d4dfe9ba6bd8af697f1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ec9c7ac-57", "ovs_interfaceid": "7ec9c7ac-57f1-42a5-b2ff-df899a930efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b2dfd6be-f35e-4364-92f5-929598b216c3 req-0843d1ca-f4ba-4047-9598-674083c7b038 service nova] Acquired lock "refresh_cache-f0e26668-e253-409a-a011-a54e8ad3ebb7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.network.neutron [req-b2dfd6be-f35e-4364-92f5-929598b216c3 req-0843d1ca-f4ba-4047-9598-674083c7b038 service nova] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Refreshing network info cache for port 7ec9c7ac-57f1-42a5-b2ff-df899a930efd {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Start _get_guest_xml network_info=[{"id": "7ec9c7ac-57f1-42a5-b2ff-df899a930efd", "address": "fa:16:3e:ae:36:46", "network": {"id": "a3353b80-0ced-43e4-8cea-c98cd7d8c132", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638714784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ed07eb8a8d4dfe9ba6bd8af697f1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ec9c7ac-57", "ovs_interfaceid": "7ec9c7ac-57f1-42a5-b2ff-df899a930efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:40:30Z,direct_url=<?>,disk_format='qcow2',id=2d2536e6-9076-431d-93fe-0b9e2aab6535,min_disk=0,min_ram=0,name='',owner='8f0ac144cc4944ac868ce5615aac3599',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:40:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'device_name': '/dev/sda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'scsi', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '2d2536e6-9076-431d-93fe-0b9e2aab6535'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:40:48 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:40:48 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:40:30Z,direct_url=<?>,disk_format='qcow2',id=2d2536e6-9076-431d-93fe-0b9e2aab6535,min_disk=0,min_ram=0,name='',owner='8f0ac144cc4944ac868ce5615aac3599',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:40:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:40:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1365250011',display_name='tempest-AttachSCSIVolumeTestJSON-server-1365250011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1365250011',id=7,image_ref='2d2536e6-9076-431d-93fe-0b9e2aab6535',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYvF1ysQZxUe4KQhuyUVnV9QSYlchajcSK3qwIxMdZr23Agz8JiRew/YgxFEv9EL4qHm105P9w5kIftabmGUNLzNf9pcaNrf1cXlMNQUy9csFJIy3rMOEiCkrFoB0TJLA==',key_name='tempest-keypair-552943027',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92ed07eb8a8d4dfe9ba6bd8af697f1e6',ramdisk_id='',reservation_id='r-u41oipq7',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2d2536e6-9076-431d-93fe-0b9e2aab6535',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-490069061',owner_user_name='tempest-AttachSCSIVolumeTestJSON-490069061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:40:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f734dd5ead24a3bbddace417e18bbbb',uuid=f0e26668-e253-409a-a011-a54e8ad3ebb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ec9c7ac-57f1-42a5-b2ff-df899a930efd", "address": "fa:16:3e:ae:36:46", "network": {"id": "a3353b80-0ced-43e4-8cea-c98cd7d8c132", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638714784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ed07eb8a8d4dfe9ba6bd8af697f1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ec9c7ac-57", "ovs_interfaceid": "7ec9c7ac-57f1-42a5-b2ff-df899a930efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Converting VIF {"id": "7ec9c7ac-57f1-42a5-b2ff-df899a930efd", "address": "fa:16:3e:ae:36:46", "network": {"id": "a3353b80-0ced-43e4-8cea-c98cd7d8c132", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638714784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ed07eb8a8d4dfe9ba6bd8af697f1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ec9c7ac-57", "ovs_interfaceid": "7ec9c7ac-57f1-42a5-b2ff-df899a930efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:36:46,bridge_name='br-int',has_traffic_filtering=True,id=7ec9c7ac-57f1-42a5-b2ff-df899a930efd,network=Network(a3353b80-0ced-43e4-8cea-c98cd7d8c132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ec9c7ac-57') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.objects.instance [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lazy-loading 'pci_devices' on Instance uuid f0e26668-e253-409a-a011-a54e8ad3ebb7 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.193s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:40:48 user nova-compute[75247]:   <uuid>f0e26668-e253-409a-a011-a54e8ad3ebb7</uuid>
Dec 06 12:40:48 user nova-compute[75247]:   <name>instance-00000007</name>
Dec 06 12:40:48 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:40:48 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:40:48 user nova-compute[75247]:   <metadata>
Dec 06 12:40:48 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:40:48 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:40:48 user nova-compute[75247]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1365250011</nova:name>
Dec 06 12:40:48 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:40:48</nova:creationTime>
Dec 06 12:40:48 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:40:48 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:40:48 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:40:48 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:40:48 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:40:48 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:40:48 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:40:48 user nova-compute[75247]:       <nova:owner>
Dec 06 12:40:48 user nova-compute[75247]:         <nova:user uuid="4f734dd5ead24a3bbddace417e18bbbb">tempest-AttachSCSIVolumeTestJSON-490069061-project-member</nova:user>
Dec 06 12:40:48 user nova-compute[75247]:         <nova:project uuid="92ed07eb8a8d4dfe9ba6bd8af697f1e6">tempest-AttachSCSIVolumeTestJSON-490069061</nova:project>
Dec 06 12:40:48 user nova-compute[75247]:       </nova:owner>
Dec 06 12:40:48 user nova-compute[75247]:       <nova:root type="image" uuid="2d2536e6-9076-431d-93fe-0b9e2aab6535"/>
Dec 06 12:40:48 user nova-compute[75247]:       <nova:ports>
Dec 06 12:40:48 user nova-compute[75247]:         <nova:port uuid="7ec9c7ac-57f1-42a5-b2ff-df899a930efd">
Dec 06 12:40:48 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 12:40:48 user nova-compute[75247]:         </nova:port>
Dec 06 12:40:48 user nova-compute[75247]:       </nova:ports>
Dec 06 12:40:48 user nova-compute[75247]:     </nova:instance>
Dec 06 12:40:48 user nova-compute[75247]:   </metadata>
Dec 06 12:40:48 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:40:48 user nova-compute[75247]:     <system>
Dec 06 12:40:48 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:40:48 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:40:48 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:40:48 user nova-compute[75247]:       <entry name="serial">f0e26668-e253-409a-a011-a54e8ad3ebb7</entry>
Dec 06 12:40:48 user nova-compute[75247]:       <entry name="uuid">f0e26668-e253-409a-a011-a54e8ad3ebb7</entry>
Dec 06 12:40:48 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:40:48 user nova-compute[75247]:     </system>
Dec 06 12:40:48 user nova-compute[75247]:   </sysinfo>
Dec 06 12:40:48 user nova-compute[75247]:   <os>
Dec 06 12:40:48 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:40:48 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:40:48 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:40:48 user nova-compute[75247]:   </os>
Dec 06 12:40:48 user nova-compute[75247]:   <features>
Dec 06 12:40:48 user nova-compute[75247]:     <acpi/>
Dec 06 12:40:48 user nova-compute[75247]:     <apic/>
Dec 06 12:40:48 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:40:48 user nova-compute[75247]:   </features>
Dec 06 12:40:48 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:40:48 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:40:48 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:40:48 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:40:48 user nova-compute[75247]:   </clock>
Dec 06 12:40:48 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:40:48 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:40:48 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:40:48 user nova-compute[75247]:   </cpu>
Dec 06 12:40:48 user nova-compute[75247]:   <devices>
Dec 06 12:40:48 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:40:48 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:40:48 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/disk"/>
Dec 06 12:40:48 user nova-compute[75247]:       <target dev="sda" bus="scsi"/>
Dec 06 12:40:48 user nova-compute[75247]:       <address type="drive" controller="0" unit="0"/>
Dec 06 12:40:48 user nova-compute[75247]:     </disk>
Dec 06 12:40:48 user nova-compute[75247]:     <disk type="file" device="cdrom">
Dec 06 12:40:48 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none"/>
Dec 06 12:40:48 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/disk.config"/>
Dec 06 12:40:48 user nova-compute[75247]:       <target dev="sdb" bus="scsi"/>
Dec 06 12:40:48 user nova-compute[75247]:       <address type="drive" controller="0" unit="1"/>
Dec 06 12:40:48 user nova-compute[75247]:     </disk>
Dec 06 12:40:48 user nova-compute[75247]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Dec 06 12:40:48 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:40:48 user nova-compute[75247]:       <mac address="fa:16:3e:ae:36:46"/>
Dec 06 12:40:48 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:40:48 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:40:48 user nova-compute[75247]:       <target dev="tap7ec9c7ac-57"/>
Dec 06 12:40:48 user nova-compute[75247]:     </interface>
Dec 06 12:40:48 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:40:48 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/console.log" append="off"/>
Dec 06 12:40:48 user nova-compute[75247]:     </serial>
Dec 06 12:40:48 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:40:48 user nova-compute[75247]:     <video>
Dec 06 12:40:48 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:40:48 user nova-compute[75247]:     </video>
Dec 06 12:40:48 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:40:48 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:40:48 user nova-compute[75247]:     </rng>
Dec 06 12:40:48 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:40:48 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:40:48 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:40:48 user nova-compute[75247]:     </memballoon>
Dec 06 12:40:48 user nova-compute[75247]:   </devices>
Dec 06 12:40:48 user nova-compute[75247]: </domain>
Dec 06 12:40:48 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:40:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1365250011',display_name='tempest-AttachSCSIVolumeTestJSON-server-1365250011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1365250011',id=7,image_ref='2d2536e6-9076-431d-93fe-0b9e2aab6535',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYvF1ysQZxUe4KQhuyUVnV9QSYlchajcSK3qwIxMdZr23Agz8JiRew/YgxFEv9EL4qHm105P9w5kIftabmGUNLzNf9pcaNrf1cXlMNQUy9csFJIy3rMOEiCkrFoB0TJLA==',key_name='tempest-keypair-552943027',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92ed07eb8a8d4dfe9ba6bd8af697f1e6',ramdisk_id='',reservation_id='r-u41oipq7',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2d2536e6-9076-431d-93fe-0b9e2aab6535',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-490069061',owner_user_name='tempest-AttachSCSIVolumeTestJSON-490069061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:40:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f734dd5ead24a3bbddace417e18bbbb',uuid=f0e26668-e253-409a-a011-a54e8ad3ebb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ec9c7ac-57f1-42a5-b2ff-df899a930efd", "address": "fa:16:3e:ae:36:46", "network": {"id": "a3353b80-0ced-43e4-8cea-c98cd7d8c132", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638714784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ed07eb8a8d4dfe9ba6bd8af697f1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ec9c7ac-57", "ovs_interfaceid": "7ec9c7ac-57f1-42a5-b2ff-df899a930efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Converting VIF {"id": "7ec9c7ac-57f1-42a5-b2ff-df899a930efd", "address": "fa:16:3e:ae:36:46", "network": {"id": "a3353b80-0ced-43e4-8cea-c98cd7d8c132", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638714784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ed07eb8a8d4dfe9ba6bd8af697f1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ec9c7ac-57", "ovs_interfaceid": "7ec9c7ac-57f1-42a5-b2ff-df899a930efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:36:46,bridge_name='br-int',has_traffic_filtering=True,id=7ec9c7ac-57f1-42a5-b2ff-df899a930efd,network=Network(a3353b80-0ced-43e4-8cea-c98cd7d8c132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ec9c7ac-57') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG os_vif [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:36:46,bridge_name='br-int',has_traffic_filtering=True,id=7ec9c7ac-57f1-42a5-b2ff-df899a930efd,network=Network(a3353b80-0ced-43e4-8cea-c98cd7d8c132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ec9c7ac-57') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '275bf010-57e0-5f25-a1d3-e719b26e15e3', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ec9c7ac-57, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ec9c7ac-57, col_values=(('qos', UUID('e1692eb9-fe7f-4dad-a088-fffa5800c9f7')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ec9c7ac-57, col_values=(('external_ids', {'iface-id': '7ec9c7ac-57f1-42a5-b2ff-df899a930efd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:36:46', 'vm-uuid': 'f0e26668-e253-409a-a011-a54e8ad3ebb7'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:40:48 user nova-compute[75247]: INFO os_vif [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:36:46,bridge_name='br-int',has_traffic_filtering=True,id=7ec9c7ac-57f1-42a5-b2ff-df899a930efd,network=Network(a3353b80-0ced-43e4-8cea-c98cd7d8c132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ec9c7ac-57')
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] No BDM found with device name sda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] No VIF found with MAC fa:16:3e:ae:36:46, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:40:48 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Using config drive
Dec 06 12:40:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Cannot resize image /opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Ensure instance console log exists: /opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:49 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Creating config drive at /opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/disk.config
Dec 06 12:40:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9b0jfbcy {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9b0jfbcy" returned: 0 in 0.057s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-26b74859-1cc6-4204-a106-abae3fd4da53 req-086e15c1-ce1a-414e-812d-e2c4b26bd40c service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Received event network-changed-ee42c358-3097-4050-a477-8a48b500de81 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-26b74859-1cc6-4204-a106-abae3fd4da53 req-086e15c1-ce1a-414e-812d-e2c4b26bd40c service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Refreshing instance network info cache due to event network-changed-ee42c358-3097-4050-a477-8a48b500de81. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-26b74859-1cc6-4204-a106-abae3fd4da53 req-086e15c1-ce1a-414e-812d-e2c4b26bd40c service nova] Acquiring lock "refresh_cache-dbb64a66-f500-407b-ae92-80f27eb6ce2e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.network.neutron [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Updating instance_info_cache with network_info: [{"id": "ee42c358-3097-4050-a477-8a48b500de81", "address": "fa:16:3e:fd:3e:cc", "network": {"id": "003dc158-ddf8-48e4-9fa4-d9fa5f102273", "bridge": "br-int", "label": "tempest-TestVolumeSwap-823652334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09aa091fb4534e24b685fec6e6ca52e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee42c358-30", "ovs_interfaceid": "ee42c358-3097-4050-a477-8a48b500de81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Releasing lock "refresh_cache-dbb64a66-f500-407b-ae92-80f27eb6ce2e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.compute.manager [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Instance network_info: |[{"id": "ee42c358-3097-4050-a477-8a48b500de81", "address": "fa:16:3e:fd:3e:cc", "network": {"id": "003dc158-ddf8-48e4-9fa4-d9fa5f102273", "bridge": "br-int", "label": "tempest-TestVolumeSwap-823652334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09aa091fb4534e24b685fec6e6ca52e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee42c358-30", "ovs_interfaceid": "ee42c358-3097-4050-a477-8a48b500de81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-26b74859-1cc6-4204-a106-abae3fd4da53 req-086e15c1-ce1a-414e-812d-e2c4b26bd40c service nova] Acquired lock "refresh_cache-dbb64a66-f500-407b-ae92-80f27eb6ce2e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.network.neutron [req-26b74859-1cc6-4204-a106-abae3fd4da53 req-086e15c1-ce1a-414e-812d-e2c4b26bd40c service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Refreshing network info cache for port ee42c358-3097-4050-a477-8a48b500de81 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Start _get_guest_xml network_info=[{"id": "ee42c358-3097-4050-a477-8a48b500de81", "address": "fa:16:3e:fd:3e:cc", "network": {"id": "003dc158-ddf8-48e4-9fa4-d9fa5f102273", "bridge": "br-int", "label": "tempest-TestVolumeSwap-823652334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09aa091fb4534e24b685fec6e6ca52e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee42c358-30", "ovs_interfaceid": "ee42c358-3097-4050-a477-8a48b500de81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:40:49 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:40:49 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-511846269',display_name='tempest-TestVolumeSwap-server-511846269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-511846269',id=8,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMSSRL05OBf7q6EBiY5Wi+iA+BRCtnSnHfUpaMhcSzrT4gAeWrXOrO8Dt7eqx7VM46FFzMkf0EZob+q+ADX6damHqod3nRTcgkEnsE8x/DmKzkOlkBN7YB7HrUllMqL0Q==',key_name='tempest-keypair-1423327926',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09aa091fb4534e24b685fec6e6ca52e7',ramdisk_id='',reservation_id='r-1zc0u4bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-994069222',owner_user_name='tempest-TestVolumeSwap-994069222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1e02d70124b494c839a0b4f9b8267d4',uuid=dbb64a66-f500-407b-ae92-80f27eb6ce2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee42c358-3097-4050-a477-8a48b500de81", "address": "fa:16:3e:fd:3e:cc", "network": {"id": "003dc158-ddf8-48e4-9fa4-d9fa5f102273", "bridge": "br-int", "label": "tempest-TestVolumeSwap-823652334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09aa091fb4534e24b685fec6e6ca52e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee42c358-30", "ovs_interfaceid": "ee42c358-3097-4050-a477-8a48b500de81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Converting VIF {"id": "ee42c358-3097-4050-a477-8a48b500de81", "address": "fa:16:3e:fd:3e:cc", "network": {"id": "003dc158-ddf8-48e4-9fa4-d9fa5f102273", "bridge": "br-int", "label": "tempest-TestVolumeSwap-823652334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09aa091fb4534e24b685fec6e6ca52e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee42c358-30", "ovs_interfaceid": "ee42c358-3097-4050-a477-8a48b500de81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:3e:cc,bridge_name='br-int',has_traffic_filtering=True,id=ee42c358-3097-4050-a477-8a48b500de81,network=Network(003dc158-ddf8-48e4-9fa4-d9fa5f102273),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee42c358-30') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.objects.instance [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lazy-loading 'pci_devices' on Instance uuid dbb64a66-f500-407b-ae92-80f27eb6ce2e {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:40:49 user nova-compute[75247]:   <uuid>dbb64a66-f500-407b-ae92-80f27eb6ce2e</uuid>
Dec 06 12:40:49 user nova-compute[75247]:   <name>instance-00000008</name>
Dec 06 12:40:49 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:40:49 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:40:49 user nova-compute[75247]:   <metadata>
Dec 06 12:40:49 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:40:49 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:40:49 user nova-compute[75247]:       <nova:name>tempest-TestVolumeSwap-server-511846269</nova:name>
Dec 06 12:40:49 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:40:49</nova:creationTime>
Dec 06 12:40:49 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:40:49 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:40:49 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:40:49 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:40:49 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:40:49 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:40:49 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:40:49 user nova-compute[75247]:       <nova:owner>
Dec 06 12:40:49 user nova-compute[75247]:         <nova:user uuid="f1e02d70124b494c839a0b4f9b8267d4">tempest-TestVolumeSwap-994069222-project-member</nova:user>
Dec 06 12:40:49 user nova-compute[75247]:         <nova:project uuid="09aa091fb4534e24b685fec6e6ca52e7">tempest-TestVolumeSwap-994069222</nova:project>
Dec 06 12:40:49 user nova-compute[75247]:       </nova:owner>
Dec 06 12:40:49 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:40:49 user nova-compute[75247]:       <nova:ports>
Dec 06 12:40:49 user nova-compute[75247]:         <nova:port uuid="ee42c358-3097-4050-a477-8a48b500de81">
Dec 06 12:40:49 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 06 12:40:49 user nova-compute[75247]:         </nova:port>
Dec 06 12:40:49 user nova-compute[75247]:       </nova:ports>
Dec 06 12:40:49 user nova-compute[75247]:     </nova:instance>
Dec 06 12:40:49 user nova-compute[75247]:   </metadata>
Dec 06 12:40:49 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:40:49 user nova-compute[75247]:     <system>
Dec 06 12:40:49 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:40:49 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:40:49 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:40:49 user nova-compute[75247]:       <entry name="serial">dbb64a66-f500-407b-ae92-80f27eb6ce2e</entry>
Dec 06 12:40:49 user nova-compute[75247]:       <entry name="uuid">dbb64a66-f500-407b-ae92-80f27eb6ce2e</entry>
Dec 06 12:40:49 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:40:49 user nova-compute[75247]:     </system>
Dec 06 12:40:49 user nova-compute[75247]:   </sysinfo>
Dec 06 12:40:49 user nova-compute[75247]:   <os>
Dec 06 12:40:49 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:40:49 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:40:49 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:40:49 user nova-compute[75247]:   </os>
Dec 06 12:40:49 user nova-compute[75247]:   <features>
Dec 06 12:40:49 user nova-compute[75247]:     <acpi/>
Dec 06 12:40:49 user nova-compute[75247]:     <apic/>
Dec 06 12:40:49 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:40:49 user nova-compute[75247]:   </features>
Dec 06 12:40:49 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:40:49 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:40:49 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:40:49 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:40:49 user nova-compute[75247]:   </clock>
Dec 06 12:40:49 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:40:49 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:40:49 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:40:49 user nova-compute[75247]:   </cpu>
Dec 06 12:40:49 user nova-compute[75247]:   <devices>
Dec 06 12:40:49 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:40:49 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:40:49 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/disk"/>
Dec 06 12:40:49 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:40:49 user nova-compute[75247]:     </disk>
Dec 06 12:40:49 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:40:49 user nova-compute[75247]:       <mac address="fa:16:3e:fd:3e:cc"/>
Dec 06 12:40:49 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:40:49 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:40:49 user nova-compute[75247]:       <target dev="tapee42c358-30"/>
Dec 06 12:40:49 user nova-compute[75247]:     </interface>
Dec 06 12:40:49 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:40:49 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/console.log" append="off"/>
Dec 06 12:40:49 user nova-compute[75247]:     </serial>
Dec 06 12:40:49 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:40:49 user nova-compute[75247]:     <video>
Dec 06 12:40:49 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:40:49 user nova-compute[75247]:     </video>
Dec 06 12:40:49 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:40:49 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:40:49 user nova-compute[75247]:     </rng>
Dec 06 12:40:49 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:40:49 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:40:49 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:40:49 user nova-compute[75247]:     </memballoon>
Dec 06 12:40:49 user nova-compute[75247]:   </devices>
Dec 06 12:40:49 user nova-compute[75247]: </domain>
Dec 06 12:40:49 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-511846269',display_name='tempest-TestVolumeSwap-server-511846269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-511846269',id=8,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMSSRL05OBf7q6EBiY5Wi+iA+BRCtnSnHfUpaMhcSzrT4gAeWrXOrO8Dt7eqx7VM46FFzMkf0EZob+q+ADX6damHqod3nRTcgkEnsE8x/DmKzkOlkBN7YB7HrUllMqL0Q==',key_name='tempest-keypair-1423327926',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09aa091fb4534e24b685fec6e6ca52e7',ramdisk_id='',reservation_id='r-1zc0u4bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-994069222',owner_user_name='tempest-TestVolumeSwap-994069222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1e02d70124b494c839a0b4f9b8267d4',uuid=dbb64a66-f500-407b-ae92-80f27eb6ce2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee42c358-3097-4050-a477-8a48b500de81", "address": "fa:16:3e:fd:3e:cc", "network": {"id": "003dc158-ddf8-48e4-9fa4-d9fa5f102273", "bridge": "br-int", "label": "tempest-TestVolumeSwap-823652334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09aa091fb4534e24b685fec6e6ca52e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee42c358-30", "ovs_interfaceid": "ee42c358-3097-4050-a477-8a48b500de81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Converting VIF {"id": "ee42c358-3097-4050-a477-8a48b500de81", "address": "fa:16:3e:fd:3e:cc", "network": {"id": "003dc158-ddf8-48e4-9fa4-d9fa5f102273", "bridge": "br-int", "label": "tempest-TestVolumeSwap-823652334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09aa091fb4534e24b685fec6e6ca52e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee42c358-30", "ovs_interfaceid": "ee42c358-3097-4050-a477-8a48b500de81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:3e:cc,bridge_name='br-int',has_traffic_filtering=True,id=ee42c358-3097-4050-a477-8a48b500de81,network=Network(003dc158-ddf8-48e4-9fa4-d9fa5f102273),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee42c358-30') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG os_vif [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:3e:cc,bridge_name='br-int',has_traffic_filtering=True,id=ee42c358-3097-4050-a477-8a48b500de81,network=Network(003dc158-ddf8-48e4-9fa4-d9fa5f102273),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee42c358-30') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e0313e7-45fd-537e-bf61-8b42e0e322d1', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee42c358-30, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee42c358-30, col_values=(('qos', UUID('9730af39-7fab-4e90-8ff5-1d31359d1d77')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee42c358-30, col_values=(('external_ids', {'iface-id': 'ee42c358-3097-4050-a477-8a48b500de81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:3e:cc', 'vm-uuid': 'dbb64a66-f500-407b-ae92-80f27eb6ce2e'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:49 user nova-compute[75247]: INFO os_vif [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:3e:cc,bridge_name='br-int',has_traffic_filtering=True,id=ee42c358-3097-4050-a477-8a48b500de81,network=Network(003dc158-ddf8-48e4-9fa4-d9fa5f102273),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee42c358-30')
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] No VIF found with MAC fa:16:3e:fd:3e:cc, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.network.neutron [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Successfully created port: 68ab6435-5cd9-45bf-891c-c20b68415e11 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.network.neutron [req-b2dfd6be-f35e-4364-92f5-929598b216c3 req-0843d1ca-f4ba-4047-9598-674083c7b038 service nova] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Updated VIF entry in instance network info cache for port 7ec9c7ac-57f1-42a5-b2ff-df899a930efd. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG nova.network.neutron [req-b2dfd6be-f35e-4364-92f5-929598b216c3 req-0843d1ca-f4ba-4047-9598-674083c7b038 service nova] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Updating instance_info_cache with network_info: [{"id": "7ec9c7ac-57f1-42a5-b2ff-df899a930efd", "address": "fa:16:3e:ae:36:46", "network": {"id": "a3353b80-0ced-43e4-8cea-c98cd7d8c132", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638714784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ed07eb8a8d4dfe9ba6bd8af697f1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ec9c7ac-57", "ovs_interfaceid": "7ec9c7ac-57f1-42a5-b2ff-df899a930efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:40:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b2dfd6be-f35e-4364-92f5-929598b216c3 req-0843d1ca-f4ba-4047-9598-674083c7b038 service nova] Releasing lock "refresh_cache-f0e26668-e253-409a-a011-a54e8ad3ebb7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:40:50 user nova-compute[75247]: DEBUG nova.network.neutron [req-26b74859-1cc6-4204-a106-abae3fd4da53 req-086e15c1-ce1a-414e-812d-e2c4b26bd40c service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Updated VIF entry in instance network info cache for port ee42c358-3097-4050-a477-8a48b500de81. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:40:50 user nova-compute[75247]: DEBUG nova.network.neutron [req-26b74859-1cc6-4204-a106-abae3fd4da53 req-086e15c1-ce1a-414e-812d-e2c4b26bd40c service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Updating instance_info_cache with network_info: [{"id": "ee42c358-3097-4050-a477-8a48b500de81", "address": "fa:16:3e:fd:3e:cc", "network": {"id": "003dc158-ddf8-48e4-9fa4-d9fa5f102273", "bridge": "br-int", "label": "tempest-TestVolumeSwap-823652334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09aa091fb4534e24b685fec6e6ca52e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee42c358-30", "ovs_interfaceid": "ee42c358-3097-4050-a477-8a48b500de81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:40:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-26b74859-1cc6-4204-a106-abae3fd4da53 req-086e15c1-ce1a-414e-812d-e2c4b26bd40c service nova] Releasing lock "refresh_cache-dbb64a66-f500-407b-ae92-80f27eb6ce2e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:40:50 user nova-compute[75247]: DEBUG nova.network.neutron [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Successfully updated port: 68ab6435-5cd9-45bf-891c-c20b68415e11 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:40:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Acquiring lock "refresh_cache-f2e75618-9164-4527-a6a3-5f5195effccf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:40:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Acquired lock "refresh_cache-f2e75618-9164-4527-a6a3-5f5195effccf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:40:50 user nova-compute[75247]: DEBUG nova.network.neutron [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.network.neutron [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Acquiring lock "12f40dad-65dc-4281-aa53-6036aa7e26d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Lock "12f40dad-65dc-4281-aa53-6036aa7e26d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:40:51 user nova-compute[75247]: INFO nova.compute.claims [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Claim successful on node user
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.network.neutron [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Updating instance_info_cache with network_info: [{"id": "68ab6435-5cd9-45bf-891c-c20b68415e11", "address": "fa:16:3e:b0:12:84", "network": {"id": "c5765401-4948-42dc-bfce-fe0e5ebf3a42", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-751579203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ab6435-5c", "ovs_interfaceid": "68ab6435-5cd9-45bf-891c-c20b68415e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Releasing lock "refresh_cache-f2e75618-9164-4527-a6a3-5f5195effccf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.compute.manager [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Instance network_info: |[{"id": "68ab6435-5cd9-45bf-891c-c20b68415e11", "address": "fa:16:3e:b0:12:84", "network": {"id": "c5765401-4948-42dc-bfce-fe0e5ebf3a42", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-751579203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ab6435-5c", "ovs_interfaceid": "68ab6435-5cd9-45bf-891c-c20b68415e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Start _get_guest_xml network_info=[{"id": "68ab6435-5cd9-45bf-891c-c20b68415e11", "address": "fa:16:3e:b0:12:84", "network": {"id": "c5765401-4948-42dc-bfce-fe0e5ebf3a42", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-751579203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ab6435-5c", "ovs_interfaceid": "68ab6435-5cd9-45bf-891c-c20b68415e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:40:51 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:40:51 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.compute.manager [req-8f568d41-34be-4293-9119-f34c26dff5b5 req-b1446e86-1277-499e-9fdd-fd9af46f8f54 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Received event network-changed-68ab6435-5cd9-45bf-891c-c20b68415e11 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.compute.manager [req-8f568d41-34be-4293-9119-f34c26dff5b5 req-b1446e86-1277-499e-9fdd-fd9af46f8f54 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Refreshing instance network info cache due to event network-changed-68ab6435-5cd9-45bf-891c-c20b68415e11. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-8f568d41-34be-4293-9119-f34c26dff5b5 req-b1446e86-1277-499e-9fdd-fd9af46f8f54 service nova] Acquiring lock "refresh_cache-f2e75618-9164-4527-a6a3-5f5195effccf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-8f568d41-34be-4293-9119-f34c26dff5b5 req-b1446e86-1277-499e-9fdd-fd9af46f8f54 service nova] Acquired lock "refresh_cache-f2e75618-9164-4527-a6a3-5f5195effccf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.network.neutron [req-8f568d41-34be-4293-9119-f34c26dff5b5 req-b1446e86-1277-499e-9fdd-fd9af46f8f54 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Refreshing network info cache for port 68ab6435-5cd9-45bf-891c-c20b68415e11 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1618747013',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1618747013',id=9,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJqUDXevj4gXj7N7wpZj/XCteR5V+dPOM68FsqKu9Fudl378/ktu9MdzbbKdcoiSMygbRXxj+WBcn7A30ZdIiAz+sQjvUKqzGUuXAmht+5SuCJrZIb25AK4InwaKc1iVg==',key_name='tempest-keypair-76799662',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4031371ec46d42c2bd887bac7edf42a4',ramdisk_id='',reservation_id='r-ouoqw3qc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1141791142',owner_user_name='tempest-TaggedAttachmentsTest-1141791142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14563ea794be4e5bb54c7b4cabde8ee0',uuid=f2e75618-9164-4527-a6a3-5f5195effccf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68ab6435-5cd9-45bf-891c-c20b68415e11", "address": "fa:16:3e:b0:12:84", "network": {"id": "c5765401-4948-42dc-bfce-fe0e5ebf3a42", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-751579203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ab6435-5c", "ovs_interfaceid": "68ab6435-5cd9-45bf-891c-c20b68415e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Converting VIF {"id": "68ab6435-5cd9-45bf-891c-c20b68415e11", "address": "fa:16:3e:b0:12:84", "network": {"id": "c5765401-4948-42dc-bfce-fe0e5ebf3a42", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-751579203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ab6435-5c", "ovs_interfaceid": "68ab6435-5cd9-45bf-891c-c20b68415e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:12:84,bridge_name='br-int',has_traffic_filtering=True,id=68ab6435-5cd9-45bf-891c-c20b68415e11,network=Network(c5765401-4948-42dc-bfce-fe0e5ebf3a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68ab6435-5c') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.objects.instance [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lazy-loading 'pci_devices' on Instance uuid f2e75618-9164-4527-a6a3-5f5195effccf {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:40:51 user nova-compute[75247]:   <uuid>f2e75618-9164-4527-a6a3-5f5195effccf</uuid>
Dec 06 12:40:51 user nova-compute[75247]:   <name>instance-00000009</name>
Dec 06 12:40:51 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:40:51 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:40:51 user nova-compute[75247]:   <metadata>
Dec 06 12:40:51 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:40:51 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:40:51 user nova-compute[75247]:       <nova:name>tempest-device-tagging-server-1618747013</nova:name>
Dec 06 12:40:51 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:40:51</nova:creationTime>
Dec 06 12:40:51 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:40:51 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:40:51 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:40:51 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:40:51 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:40:51 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:40:51 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:40:51 user nova-compute[75247]:       <nova:owner>
Dec 06 12:40:51 user nova-compute[75247]:         <nova:user uuid="14563ea794be4e5bb54c7b4cabde8ee0">tempest-TaggedAttachmentsTest-1141791142-project-member</nova:user>
Dec 06 12:40:51 user nova-compute[75247]:         <nova:project uuid="4031371ec46d42c2bd887bac7edf42a4">tempest-TaggedAttachmentsTest-1141791142</nova:project>
Dec 06 12:40:51 user nova-compute[75247]:       </nova:owner>
Dec 06 12:40:51 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:40:51 user nova-compute[75247]:       <nova:ports>
Dec 06 12:40:51 user nova-compute[75247]:         <nova:port uuid="68ab6435-5cd9-45bf-891c-c20b68415e11">
Dec 06 12:40:51 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 12:40:51 user nova-compute[75247]:         </nova:port>
Dec 06 12:40:51 user nova-compute[75247]:       </nova:ports>
Dec 06 12:40:51 user nova-compute[75247]:     </nova:instance>
Dec 06 12:40:51 user nova-compute[75247]:   </metadata>
Dec 06 12:40:51 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:40:51 user nova-compute[75247]:     <system>
Dec 06 12:40:51 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:40:51 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:40:51 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:40:51 user nova-compute[75247]:       <entry name="serial">f2e75618-9164-4527-a6a3-5f5195effccf</entry>
Dec 06 12:40:51 user nova-compute[75247]:       <entry name="uuid">f2e75618-9164-4527-a6a3-5f5195effccf</entry>
Dec 06 12:40:51 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:40:51 user nova-compute[75247]:     </system>
Dec 06 12:40:51 user nova-compute[75247]:   </sysinfo>
Dec 06 12:40:51 user nova-compute[75247]:   <os>
Dec 06 12:40:51 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:40:51 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:40:51 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:40:51 user nova-compute[75247]:   </os>
Dec 06 12:40:51 user nova-compute[75247]:   <features>
Dec 06 12:40:51 user nova-compute[75247]:     <acpi/>
Dec 06 12:40:51 user nova-compute[75247]:     <apic/>
Dec 06 12:40:51 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:40:51 user nova-compute[75247]:   </features>
Dec 06 12:40:51 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:40:51 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:40:51 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:40:51 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:40:51 user nova-compute[75247]:   </clock>
Dec 06 12:40:51 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:40:51 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:40:51 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:40:51 user nova-compute[75247]:   </cpu>
Dec 06 12:40:51 user nova-compute[75247]:   <devices>
Dec 06 12:40:51 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:40:51 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:40:51 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk"/>
Dec 06 12:40:51 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:40:51 user nova-compute[75247]:     </disk>
Dec 06 12:40:51 user nova-compute[75247]:     <disk type="file" device="cdrom">
Dec 06 12:40:51 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none"/>
Dec 06 12:40:51 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk.config"/>
Dec 06 12:40:51 user nova-compute[75247]:       <target dev="hda" bus="ide"/>
Dec 06 12:40:51 user nova-compute[75247]:     </disk>
Dec 06 12:40:51 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:40:51 user nova-compute[75247]:       <mac address="fa:16:3e:b0:12:84"/>
Dec 06 12:40:51 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:40:51 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:40:51 user nova-compute[75247]:       <target dev="tap68ab6435-5c"/>
Dec 06 12:40:51 user nova-compute[75247]:     </interface>
Dec 06 12:40:51 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:40:51 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/console.log" append="off"/>
Dec 06 12:40:51 user nova-compute[75247]:     </serial>
Dec 06 12:40:51 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:40:51 user nova-compute[75247]:     <video>
Dec 06 12:40:51 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:40:51 user nova-compute[75247]:     </video>
Dec 06 12:40:51 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:40:51 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:40:51 user nova-compute[75247]:     </rng>
Dec 06 12:40:51 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:40:51 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:40:51 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:40:51 user nova-compute[75247]:     </memballoon>
Dec 06 12:40:51 user nova-compute[75247]:   </devices>
Dec 06 12:40:51 user nova-compute[75247]: </domain>
Dec 06 12:40:51 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1618747013',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1618747013',id=9,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJqUDXevj4gXj7N7wpZj/XCteR5V+dPOM68FsqKu9Fudl378/ktu9MdzbbKdcoiSMygbRXxj+WBcn7A30ZdIiAz+sQjvUKqzGUuXAmht+5SuCJrZIb25AK4InwaKc1iVg==',key_name='tempest-keypair-76799662',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4031371ec46d42c2bd887bac7edf42a4',ramdisk_id='',reservation_id='r-ouoqw3qc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1141791142',owner_user_name='tempest-TaggedAttachmentsTest-1141791142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14563ea794be4e5bb54c7b4cabde8ee0',uuid=f2e75618-9164-4527-a6a3-5f5195effccf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68ab6435-5cd9-45bf-891c-c20b68415e11", "address": "fa:16:3e:b0:12:84", "network": {"id": "c5765401-4948-42dc-bfce-fe0e5ebf3a42", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-751579203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ab6435-5c", "ovs_interfaceid": "68ab6435-5cd9-45bf-891c-c20b68415e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Converting VIF {"id": "68ab6435-5cd9-45bf-891c-c20b68415e11", "address": "fa:16:3e:b0:12:84", "network": {"id": "c5765401-4948-42dc-bfce-fe0e5ebf3a42", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-751579203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ab6435-5c", "ovs_interfaceid": "68ab6435-5cd9-45bf-891c-c20b68415e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:12:84,bridge_name='br-int',has_traffic_filtering=True,id=68ab6435-5cd9-45bf-891c-c20b68415e11,network=Network(c5765401-4948-42dc-bfce-fe0e5ebf3a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68ab6435-5c') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG os_vif [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:12:84,bridge_name='br-int',has_traffic_filtering=True,id=68ab6435-5cd9-45bf-891c-c20b68415e11,network=Network(c5765401-4948-42dc-bfce-fe0e5ebf3a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68ab6435-5c') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'accc2a49-5cc3-5944-883e-2a8e5bed17da', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68ab6435-5c, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap68ab6435-5c, col_values=(('qos', UUID('d2d64155-b44c-4942-bba4-7293b5eb45ce')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap68ab6435-5c, col_values=(('external_ids', {'iface-id': '68ab6435-5cd9-45bf-891c-c20b68415e11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:12:84', 'vm-uuid': 'f2e75618-9164-4527-a6a3-5f5195effccf'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:51 user nova-compute[75247]: INFO os_vif [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:12:84,bridge_name='br-int',has_traffic_filtering=True,id=68ab6435-5cd9-45bf-891c-c20b68415e11,network=Network(c5765401-4948-42dc-bfce-fe0e5ebf3a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68ab6435-5c')
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] No BDM found with device name hda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] No VIF found with MAC fa:16:3e:b0:12:84, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:40:51 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Using config drive
Dec 06 12:40:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:52 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:40:52 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:40:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.826s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:52 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:40:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:52 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Creating config drive at /opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk.config
Dec 06 12:40:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpafucjovt {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpafucjovt" returned: 0 in 0.074s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:52 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:40:52 user nova-compute[75247]: DEBUG nova.network.neutron [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:40:52 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:40:52 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:40:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:52 user nova-compute[75247]: DEBUG nova.policy [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91f7ee4ab7cf416ba6e806db970133e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b039f4b1235348e9b27104df9753f5be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:40:52 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:40:52 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:40:52 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Creating image(s)
Dec 06 12:40:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Acquiring lock "/opt/stack/data/nova/instances/12f40dad-65dc-4281-aa53-6036aa7e26d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Lock "/opt/stack/data/nova/instances/12f40dad-65dc-4281-aa53-6036aa7e26d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Lock "/opt/stack/data/nova/instances/12f40dad-65dc-4281-aa53-6036aa7e26d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.220s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG nova.network.neutron [req-8f568d41-34be-4293-9119-f34c26dff5b5 req-b1446e86-1277-499e-9fdd-fd9af46f8f54 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Updated VIF entry in instance network info cache for port 68ab6435-5cd9-45bf-891c-c20b68415e11. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG nova.network.neutron [req-8f568d41-34be-4293-9119-f34c26dff5b5 req-b1446e86-1277-499e-9fdd-fd9af46f8f54 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Updating instance_info_cache with network_info: [{"id": "68ab6435-5cd9-45bf-891c-c20b68415e11", "address": "fa:16:3e:b0:12:84", "network": {"id": "c5765401-4948-42dc-bfce-fe0e5ebf3a42", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-751579203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ab6435-5c", "ovs_interfaceid": "68ab6435-5cd9-45bf-891c-c20b68415e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-8f568d41-34be-4293-9119-f34c26dff5b5 req-b1446e86-1277-499e-9fdd-fd9af46f8f54 service nova] Releasing lock "refresh_cache-f2e75618-9164-4527-a6a3-5f5195effccf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.265s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/12f40dad-65dc-4281-aa53-6036aa7e26d9/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/12f40dad-65dc-4281-aa53-6036aa7e26d9/disk 1073741824" returned: 0 in 0.086s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.360s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.217s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Checking if we can resize image /opt/stack/data/nova/instances/12f40dad-65dc-4281-aa53-6036aa7e26d9/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12f40dad-65dc-4281-aa53-6036aa7e26d9/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG nova.compute.manager [req-2f7e6e26-0e0d-42be-af60-04c2e04c87be req-ba921647-69da-4241-8a6f-93568741d1d4 service nova] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Received event network-vif-plugged-7ec9c7ac-57f1-42a5-b2ff-df899a930efd {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2f7e6e26-0e0d-42be-af60-04c2e04c87be req-ba921647-69da-4241-8a6f-93568741d1d4 service nova] Acquiring lock "f0e26668-e253-409a-a011-a54e8ad3ebb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2f7e6e26-0e0d-42be-af60-04c2e04c87be req-ba921647-69da-4241-8a6f-93568741d1d4 service nova] Lock "f0e26668-e253-409a-a011-a54e8ad3ebb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2f7e6e26-0e0d-42be-af60-04c2e04c87be req-ba921647-69da-4241-8a6f-93568741d1d4 service nova] Lock "f0e26668-e253-409a-a011-a54e8ad3ebb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG nova.compute.manager [req-2f7e6e26-0e0d-42be-af60-04c2e04c87be req-ba921647-69da-4241-8a6f-93568741d1d4 service nova] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] No waiting events found dispatching network-vif-plugged-7ec9c7ac-57f1-42a5-b2ff-df899a930efd {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:40:53 user nova-compute[75247]: WARNING nova.compute.manager [req-2f7e6e26-0e0d-42be-af60-04c2e04c87be req-ba921647-69da-4241-8a6f-93568741d1d4 service nova] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Received unexpected event network-vif-plugged-7ec9c7ac-57f1-42a5-b2ff-df899a930efd for instance with vm_state building and task_state spawning.
Dec 06 12:40:53 user nova-compute[75247]: DEBUG nova.compute.manager [req-2f7e6e26-0e0d-42be-af60-04c2e04c87be req-ba921647-69da-4241-8a6f-93568741d1d4 service nova] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Received event network-vif-plugged-7ec9c7ac-57f1-42a5-b2ff-df899a930efd {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2f7e6e26-0e0d-42be-af60-04c2e04c87be req-ba921647-69da-4241-8a6f-93568741d1d4 service nova] Acquiring lock "f0e26668-e253-409a-a011-a54e8ad3ebb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2f7e6e26-0e0d-42be-af60-04c2e04c87be req-ba921647-69da-4241-8a6f-93568741d1d4 service nova] Lock "f0e26668-e253-409a-a011-a54e8ad3ebb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2f7e6e26-0e0d-42be-af60-04c2e04c87be req-ba921647-69da-4241-8a6f-93568741d1d4 service nova] Lock "f0e26668-e253-409a-a011-a54e8ad3ebb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG nova.compute.manager [req-2f7e6e26-0e0d-42be-af60-04c2e04c87be req-ba921647-69da-4241-8a6f-93568741d1d4 service nova] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] No waiting events found dispatching network-vif-plugged-7ec9c7ac-57f1-42a5-b2ff-df899a930efd {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:40:53 user nova-compute[75247]: WARNING nova.compute.manager [req-2f7e6e26-0e0d-42be-af60-04c2e04c87be req-ba921647-69da-4241-8a6f-93568741d1d4 service nova] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Received unexpected event network-vif-plugged-7ec9c7ac-57f1-42a5-b2ff-df899a930efd for instance with vm_state building and task_state spawning.
Dec 06 12:40:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12f40dad-65dc-4281-aa53-6036aa7e26d9/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Cannot resize image /opt/stack/data/nova/instances/12f40dad-65dc-4281-aa53-6036aa7e26d9/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Ensure instance console log exists: /opt/stack/data/nova/instances/12f40dad-65dc-4281-aa53-6036aa7e26d9/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:53 user nova-compute[75247]: DEBUG nova.network.neutron [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Successfully created port: bf793824-98be-4226-82eb-5e37152fcb2a {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:40:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:54 user nova-compute[75247]: DEBUG nova.network.neutron [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Successfully updated port: bf793824-98be-4226-82eb-5e37152fcb2a {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:40:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Acquiring lock "refresh_cache-12f40dad-65dc-4281-aa53-6036aa7e26d9" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:40:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Acquired lock "refresh_cache-12f40dad-65dc-4281-aa53-6036aa7e26d9" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:40:54 user nova-compute[75247]: DEBUG nova.network.neutron [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.network.neutron [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.network.neutron [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Updating instance_info_cache with network_info: [{"id": "bf793824-98be-4226-82eb-5e37152fcb2a", "address": "fa:16:3e:0d:07:76", "network": {"id": "cd593cd1-d7c8-41f9-89eb-844e385dcbac", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1184891647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b039f4b1235348e9b27104df9753f5be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf793824-98", "ovs_interfaceid": "bf793824-98be-4226-82eb-5e37152fcb2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Releasing lock "refresh_cache-12f40dad-65dc-4281-aa53-6036aa7e26d9" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Instance network_info: |[{"id": "bf793824-98be-4226-82eb-5e37152fcb2a", "address": "fa:16:3e:0d:07:76", "network": {"id": "cd593cd1-d7c8-41f9-89eb-844e385dcbac", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1184891647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b039f4b1235348e9b27104df9753f5be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf793824-98", "ovs_interfaceid": "bf793824-98be-4226-82eb-5e37152fcb2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Start _get_guest_xml network_info=[{"id": "bf793824-98be-4226-82eb-5e37152fcb2a", "address": "fa:16:3e:0d:07:76", "network": {"id": "cd593cd1-d7c8-41f9-89eb-844e385dcbac", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1184891647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b039f4b1235348e9b27104df9753f5be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf793824-98", "ovs_interfaceid": "bf793824-98be-4226-82eb-5e37152fcb2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:40:55 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:40:55 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-420503403',display_name='tempest-VolumesAssistedSnapshotsTest-server-420503403',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-420503403',id=10,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbj1/Kgv5W+6xLfvIlI+GDJ12fcktlvoLGi4BJ6NWoyqPhMVBUFH79JnEi2/xmBxMixju/9rV5asHLS6uB98jXCJD1IsSMnQqapcqUueJBxT6DXf8kXGat2P0MDNjXFEA==',key_name='tempest-keypair-562827463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b039f4b1235348e9b27104df9753f5be',ramdisk_id='',reservation_id='r-0smjx46r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-368900782',owner_user_name='tempest-VolumesAssistedSnapshotsTest-368900782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:40:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91f7ee4ab7cf416ba6e806db970133e9',uuid=12f40dad-65dc-4281-aa53-6036aa7e26d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf793824-98be-4226-82eb-5e37152fcb2a", "address": "fa:16:3e:0d:07:76", "network": {"id": "cd593cd1-d7c8-41f9-89eb-844e385dcbac", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1184891647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b039f4b1235348e9b27104df9753f5be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf793824-98", "ovs_interfaceid": "bf793824-98be-4226-82eb-5e37152fcb2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Converting VIF {"id": "bf793824-98be-4226-82eb-5e37152fcb2a", "address": "fa:16:3e:0d:07:76", "network": {"id": "cd593cd1-d7c8-41f9-89eb-844e385dcbac", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1184891647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b039f4b1235348e9b27104df9753f5be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf793824-98", "ovs_interfaceid": "bf793824-98be-4226-82eb-5e37152fcb2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:07:76,bridge_name='br-int',has_traffic_filtering=True,id=bf793824-98be-4226-82eb-5e37152fcb2a,network=Network(cd593cd1-d7c8-41f9-89eb-844e385dcbac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf793824-98') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.objects.instance [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Lazy-loading 'pci_devices' on Instance uuid 12f40dad-65dc-4281-aa53-6036aa7e26d9 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:40:55 user nova-compute[75247]:   <uuid>12f40dad-65dc-4281-aa53-6036aa7e26d9</uuid>
Dec 06 12:40:55 user nova-compute[75247]:   <name>instance-0000000a</name>
Dec 06 12:40:55 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:40:55 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:40:55 user nova-compute[75247]:   <metadata>
Dec 06 12:40:55 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:40:55 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:40:55 user nova-compute[75247]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-420503403</nova:name>
Dec 06 12:40:55 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:40:55</nova:creationTime>
Dec 06 12:40:55 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:40:55 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:40:55 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:40:55 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:40:55 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:40:55 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:40:55 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:40:55 user nova-compute[75247]:       <nova:owner>
Dec 06 12:40:55 user nova-compute[75247]:         <nova:user uuid="91f7ee4ab7cf416ba6e806db970133e9">tempest-VolumesAssistedSnapshotsTest-368900782-project-member</nova:user>
Dec 06 12:40:55 user nova-compute[75247]:         <nova:project uuid="b039f4b1235348e9b27104df9753f5be">tempest-VolumesAssistedSnapshotsTest-368900782</nova:project>
Dec 06 12:40:55 user nova-compute[75247]:       </nova:owner>
Dec 06 12:40:55 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:40:55 user nova-compute[75247]:       <nova:ports>
Dec 06 12:40:55 user nova-compute[75247]:         <nova:port uuid="bf793824-98be-4226-82eb-5e37152fcb2a">
Dec 06 12:40:55 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 06 12:40:55 user nova-compute[75247]:         </nova:port>
Dec 06 12:40:55 user nova-compute[75247]:       </nova:ports>
Dec 06 12:40:55 user nova-compute[75247]:     </nova:instance>
Dec 06 12:40:55 user nova-compute[75247]:   </metadata>
Dec 06 12:40:55 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:40:55 user nova-compute[75247]:     <system>
Dec 06 12:40:55 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:40:55 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:40:55 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:40:55 user nova-compute[75247]:       <entry name="serial">12f40dad-65dc-4281-aa53-6036aa7e26d9</entry>
Dec 06 12:40:55 user nova-compute[75247]:       <entry name="uuid">12f40dad-65dc-4281-aa53-6036aa7e26d9</entry>
Dec 06 12:40:55 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:40:55 user nova-compute[75247]:     </system>
Dec 06 12:40:55 user nova-compute[75247]:   </sysinfo>
Dec 06 12:40:55 user nova-compute[75247]:   <os>
Dec 06 12:40:55 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:40:55 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:40:55 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:40:55 user nova-compute[75247]:   </os>
Dec 06 12:40:55 user nova-compute[75247]:   <features>
Dec 06 12:40:55 user nova-compute[75247]:     <acpi/>
Dec 06 12:40:55 user nova-compute[75247]:     <apic/>
Dec 06 12:40:55 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:40:55 user nova-compute[75247]:   </features>
Dec 06 12:40:55 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:40:55 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:40:55 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:40:55 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:40:55 user nova-compute[75247]:   </clock>
Dec 06 12:40:55 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:40:55 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:40:55 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:40:55 user nova-compute[75247]:   </cpu>
Dec 06 12:40:55 user nova-compute[75247]:   <devices>
Dec 06 12:40:55 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:40:55 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:40:55 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/12f40dad-65dc-4281-aa53-6036aa7e26d9/disk"/>
Dec 06 12:40:55 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:40:55 user nova-compute[75247]:     </disk>
Dec 06 12:40:55 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:40:55 user nova-compute[75247]:       <mac address="fa:16:3e:0d:07:76"/>
Dec 06 12:40:55 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:40:55 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:40:55 user nova-compute[75247]:       <target dev="tapbf793824-98"/>
Dec 06 12:40:55 user nova-compute[75247]:     </interface>
Dec 06 12:40:55 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:40:55 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/12f40dad-65dc-4281-aa53-6036aa7e26d9/console.log" append="off"/>
Dec 06 12:40:55 user nova-compute[75247]:     </serial>
Dec 06 12:40:55 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:40:55 user nova-compute[75247]:     <video>
Dec 06 12:40:55 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:40:55 user nova-compute[75247]:     </video>
Dec 06 12:40:55 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:40:55 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:40:55 user nova-compute[75247]:     </rng>
Dec 06 12:40:55 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:40:55 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:40:55 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:40:55 user nova-compute[75247]:     </memballoon>
Dec 06 12:40:55 user nova-compute[75247]:   </devices>
Dec 06 12:40:55 user nova-compute[75247]: </domain>
Dec 06 12:40:55 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-420503403',display_name='tempest-VolumesAssistedSnapshotsTest-server-420503403',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-420503403',id=10,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbj1/Kgv5W+6xLfvIlI+GDJ12fcktlvoLGi4BJ6NWoyqPhMVBUFH79JnEi2/xmBxMixju/9rV5asHLS6uB98jXCJD1IsSMnQqapcqUueJBxT6DXf8kXGat2P0MDNjXFEA==',key_name='tempest-keypair-562827463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b039f4b1235348e9b27104df9753f5be',ramdisk_id='',reservation_id='r-0smjx46r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-368900782',owner_user_name='tempest-VolumesAssistedSnapshotsTest-368900782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:40:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91f7ee4ab7cf416ba6e806db970133e9',uuid=12f40dad-65dc-4281-aa53-6036aa7e26d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf793824-98be-4226-82eb-5e37152fcb2a", "address": "fa:16:3e:0d:07:76", "network": {"id": "cd593cd1-d7c8-41f9-89eb-844e385dcbac", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1184891647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b039f4b1235348e9b27104df9753f5be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf793824-98", "ovs_interfaceid": "bf793824-98be-4226-82eb-5e37152fcb2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Converting VIF {"id": "bf793824-98be-4226-82eb-5e37152fcb2a", "address": "fa:16:3e:0d:07:76", "network": {"id": "cd593cd1-d7c8-41f9-89eb-844e385dcbac", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1184891647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b039f4b1235348e9b27104df9753f5be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf793824-98", "ovs_interfaceid": "bf793824-98be-4226-82eb-5e37152fcb2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:07:76,bridge_name='br-int',has_traffic_filtering=True,id=bf793824-98be-4226-82eb-5e37152fcb2a,network=Network(cd593cd1-d7c8-41f9-89eb-844e385dcbac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf793824-98') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG os_vif [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:07:76,bridge_name='br-int',has_traffic_filtering=True,id=bf793824-98be-4226-82eb-5e37152fcb2a,network=Network(cd593cd1-d7c8-41f9-89eb-844e385dcbac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf793824-98') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '996aba88-40d8-5d93-aaa3-185acf08f54f', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf793824-98, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf793824-98, col_values=(('qos', UUID('f99aa6d8-6bef-4da3-a82e-dc84be38180d')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf793824-98, col_values=(('external_ids', {'iface-id': 'bf793824-98be-4226-82eb-5e37152fcb2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:07:76', 'vm-uuid': '12f40dad-65dc-4281-aa53-6036aa7e26d9'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:55 user nova-compute[75247]: INFO os_vif [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:07:76,bridge_name='br-int',has_traffic_filtering=True,id=bf793824-98be-4226-82eb-5e37152fcb2a,network=Network(cd593cd1-d7c8-41f9-89eb-844e385dcbac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf793824-98')
Dec 06 12:40:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.compute.manager [req-56e55b77-c1d0-45db-aedb-a18cd9326d07 req-fc8705a9-d9e7-44f7-a90f-d55dfd61966c service nova] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Received event network-changed-bf793824-98be-4226-82eb-5e37152fcb2a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.compute.manager [req-56e55b77-c1d0-45db-aedb-a18cd9326d07 req-fc8705a9-d9e7-44f7-a90f-d55dfd61966c service nova] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Refreshing instance network info cache due to event network-changed-bf793824-98be-4226-82eb-5e37152fcb2a. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-56e55b77-c1d0-45db-aedb-a18cd9326d07 req-fc8705a9-d9e7-44f7-a90f-d55dfd61966c service nova] Acquiring lock "refresh_cache-12f40dad-65dc-4281-aa53-6036aa7e26d9" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-56e55b77-c1d0-45db-aedb-a18cd9326d07 req-fc8705a9-d9e7-44f7-a90f-d55dfd61966c service nova] Acquired lock "refresh_cache-12f40dad-65dc-4281-aa53-6036aa7e26d9" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.network.neutron [req-56e55b77-c1d0-45db-aedb-a18cd9326d07 req-fc8705a9-d9e7-44f7-a90f-d55dfd61966c service nova] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Refreshing network info cache for port bf793824-98be-4226-82eb-5e37152fcb2a {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:40:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] No VIF found with MAC fa:16:3e:0d:07:76, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:40:56 user nova-compute[75247]: DEBUG nova.network.neutron [req-56e55b77-c1d0-45db-aedb-a18cd9326d07 req-fc8705a9-d9e7-44f7-a90f-d55dfd61966c service nova] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Updated VIF entry in instance network info cache for port bf793824-98be-4226-82eb-5e37152fcb2a. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:40:56 user nova-compute[75247]: DEBUG nova.network.neutron [req-56e55b77-c1d0-45db-aedb-a18cd9326d07 req-fc8705a9-d9e7-44f7-a90f-d55dfd61966c service nova] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Updating instance_info_cache with network_info: [{"id": "bf793824-98be-4226-82eb-5e37152fcb2a", "address": "fa:16:3e:0d:07:76", "network": {"id": "cd593cd1-d7c8-41f9-89eb-844e385dcbac", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1184891647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b039f4b1235348e9b27104df9753f5be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf793824-98", "ovs_interfaceid": "bf793824-98be-4226-82eb-5e37152fcb2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:40:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-56e55b77-c1d0-45db-aedb-a18cd9326d07 req-fc8705a9-d9e7-44f7-a90f-d55dfd61966c service nova] Releasing lock "refresh_cache-12f40dad-65dc-4281-aa53-6036aa7e26d9" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:40:56 user nova-compute[75247]: DEBUG nova.compute.manager [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:40:56 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:40:56 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Instance spawned successfully.
Dec 06 12:40:56 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:40:56 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:56 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:56 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:56 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:56 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:56 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:56 user nova-compute[75247]: INFO nova.compute.manager [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Took 11.85 seconds to spawn the instance on the hypervisor.
Dec 06 12:40:56 user nova-compute[75247]: DEBUG nova.compute.manager [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:40:56 user nova-compute[75247]: DEBUG nova.compute.manager [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:40:56 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:40:56 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Instance spawned successfully.
Dec 06 12:40:56 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:40:56 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:56 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:56 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:56 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:56 user nova-compute[75247]: INFO nova.compute.manager [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Took 13.54 seconds to build instance.
Dec 06 12:40:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d57d0981-9268-44ac-8de8-75d8f8f394f4 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.897s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:56 user nova-compute[75247]: INFO nova.compute.manager [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Took 15.03 seconds to spawn the instance on the hypervisor.
Dec 06 12:40:56 user nova-compute[75247]: DEBUG nova.compute.manager [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:40:57 user nova-compute[75247]: INFO nova.compute.manager [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Took 16.81 seconds to build instance.
Dec 06 12:40:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-48a4c179-46ac-4de9-ae54-3d63befed775 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "f0e26668-e253-409a-a011-a54e8ad3ebb7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.079s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:57 user nova-compute[75247]: DEBUG nova.compute.manager [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:40:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:40:57 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Instance spawned successfully.
Dec 06 12:40:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:40:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:57 user nova-compute[75247]: DEBUG nova.compute.manager [req-cff62d7f-6184-42aa-b5ab-4eae211211f1 req-68ff9d25-1d37-491c-8b4a-0627f7097bc6 service nova] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Received event network-vif-plugged-4f46192c-414a-4af4-b5de-5bd99d31d1fe {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:40:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-cff62d7f-6184-42aa-b5ab-4eae211211f1 req-68ff9d25-1d37-491c-8b4a-0627f7097bc6 service nova] Acquiring lock "70c4664e-ae7a-47de-bba7-18300391d209-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-cff62d7f-6184-42aa-b5ab-4eae211211f1 req-68ff9d25-1d37-491c-8b4a-0627f7097bc6 service nova] Lock "70c4664e-ae7a-47de-bba7-18300391d209-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-cff62d7f-6184-42aa-b5ab-4eae211211f1 req-68ff9d25-1d37-491c-8b4a-0627f7097bc6 service nova] Lock "70c4664e-ae7a-47de-bba7-18300391d209-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:57 user nova-compute[75247]: DEBUG nova.compute.manager [req-cff62d7f-6184-42aa-b5ab-4eae211211f1 req-68ff9d25-1d37-491c-8b4a-0627f7097bc6 service nova] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] No waiting events found dispatching network-vif-plugged-4f46192c-414a-4af4-b5de-5bd99d31d1fe {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:40:57 user nova-compute[75247]: WARNING nova.compute.manager [req-cff62d7f-6184-42aa-b5ab-4eae211211f1 req-68ff9d25-1d37-491c-8b4a-0627f7097bc6 service nova] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Received unexpected event network-vif-plugged-4f46192c-414a-4af4-b5de-5bd99d31d1fe for instance with vm_state active and task_state None.
Dec 06 12:40:57 user nova-compute[75247]: INFO nova.compute.manager [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Took 10.10 seconds to spawn the instance on the hypervisor.
Dec 06 12:40:57 user nova-compute[75247]: DEBUG nova.compute.manager [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:40:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:57 user nova-compute[75247]: INFO nova.compute.manager [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Took 11.77 seconds to build instance.
Dec 06 12:40:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-91f81c04-18f3-4149-8025-16c2e954e9bf tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "f2e75618-9164-4527-a6a3-5f5195effccf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.978s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:40:58 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:40:58 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Cleaning up deleted instances {{(pid=75247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 12:40:58 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] There are 0 instances to clean {{(pid=75247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 12:40:58 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:40:58 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75247) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 12:40:59 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:40:59 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:40:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:40:59 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Instance spawned successfully.
Dec 06 12:40:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:40:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:40:59 user nova-compute[75247]: INFO nova.compute.manager [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Took 7.06 seconds to spawn the instance on the hypervisor.
Dec 06 12:40:59 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:40:59 user nova-compute[75247]: DEBUG nova.compute.manager [req-5035eef5-3d1b-4b15-8c82-6a938952da75 req-b2fe3099-60ef-4a97-92fe-a482cc7dff37 service nova] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Received event network-vif-plugged-4f46192c-414a-4af4-b5de-5bd99d31d1fe {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:40:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5035eef5-3d1b-4b15-8c82-6a938952da75 req-b2fe3099-60ef-4a97-92fe-a482cc7dff37 service nova] Acquiring lock "70c4664e-ae7a-47de-bba7-18300391d209-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5035eef5-3d1b-4b15-8c82-6a938952da75 req-b2fe3099-60ef-4a97-92fe-a482cc7dff37 service nova] Lock "70c4664e-ae7a-47de-bba7-18300391d209-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5035eef5-3d1b-4b15-8c82-6a938952da75 req-b2fe3099-60ef-4a97-92fe-a482cc7dff37 service nova] Lock "70c4664e-ae7a-47de-bba7-18300391d209-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:59 user nova-compute[75247]: DEBUG nova.compute.manager [req-5035eef5-3d1b-4b15-8c82-6a938952da75 req-b2fe3099-60ef-4a97-92fe-a482cc7dff37 service nova] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] No waiting events found dispatching network-vif-plugged-4f46192c-414a-4af4-b5de-5bd99d31d1fe {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:40:59 user nova-compute[75247]: WARNING nova.compute.manager [req-5035eef5-3d1b-4b15-8c82-6a938952da75 req-b2fe3099-60ef-4a97-92fe-a482cc7dff37 service nova] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Received unexpected event network-vif-plugged-4f46192c-414a-4af4-b5de-5bd99d31d1fe for instance with vm_state active and task_state None.
Dec 06 12:40:59 user nova-compute[75247]: DEBUG nova.compute.manager [req-5035eef5-3d1b-4b15-8c82-6a938952da75 req-b2fe3099-60ef-4a97-92fe-a482cc7dff37 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received event network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:40:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5035eef5-3d1b-4b15-8c82-6a938952da75 req-b2fe3099-60ef-4a97-92fe-a482cc7dff37 service nova] Acquiring lock "4531bf11-b948-4d57-bf55-f33563815e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5035eef5-3d1b-4b15-8c82-6a938952da75 req-b2fe3099-60ef-4a97-92fe-a482cc7dff37 service nova] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5035eef5-3d1b-4b15-8c82-6a938952da75 req-b2fe3099-60ef-4a97-92fe-a482cc7dff37 service nova] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:59 user nova-compute[75247]: DEBUG nova.compute.manager [req-5035eef5-3d1b-4b15-8c82-6a938952da75 req-b2fe3099-60ef-4a97-92fe-a482cc7dff37 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] No waiting events found dispatching network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:40:59 user nova-compute[75247]: WARNING nova.compute.manager [req-5035eef5-3d1b-4b15-8c82-6a938952da75 req-b2fe3099-60ef-4a97-92fe-a482cc7dff37 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received unexpected event network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 for instance with vm_state active and task_state None.
Dec 06 12:40:59 user nova-compute[75247]: DEBUG nova.compute.manager [req-5035eef5-3d1b-4b15-8c82-6a938952da75 req-b2fe3099-60ef-4a97-92fe-a482cc7dff37 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received event network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:40:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5035eef5-3d1b-4b15-8c82-6a938952da75 req-b2fe3099-60ef-4a97-92fe-a482cc7dff37 service nova] Acquiring lock "4531bf11-b948-4d57-bf55-f33563815e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:40:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5035eef5-3d1b-4b15-8c82-6a938952da75 req-b2fe3099-60ef-4a97-92fe-a482cc7dff37 service nova] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:40:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5035eef5-3d1b-4b15-8c82-6a938952da75 req-b2fe3099-60ef-4a97-92fe-a482cc7dff37 service nova] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:40:59 user nova-compute[75247]: DEBUG nova.compute.manager [req-5035eef5-3d1b-4b15-8c82-6a938952da75 req-b2fe3099-60ef-4a97-92fe-a482cc7dff37 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] No waiting events found dispatching network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:40:59 user nova-compute[75247]: WARNING nova.compute.manager [req-5035eef5-3d1b-4b15-8c82-6a938952da75 req-b2fe3099-60ef-4a97-92fe-a482cc7dff37 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received unexpected event network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 for instance with vm_state active and task_state None.
Dec 06 12:40:59 user nova-compute[75247]: INFO nova.compute.manager [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Took 8.49 seconds to build instance.
Dec 06 12:40:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ff4b52ff-9d70-47de-9aed-2ea181fd95f6 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Lock "12f40dad-65dc-4281-aa53-6036aa7e26d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.684s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:41:00 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:41:00 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:41:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:00 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:41:00 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:41:00 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 12:41:00 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 12:41:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-0a07dcbb-573e-4835-a4d2-3cae1d3446e3" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:41:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-0a07dcbb-573e-4835-a4d2-3cae1d3446e3" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:41:01 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 12:41:01 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lazy-loading 'info_cache' on Instance uuid 0a07dcbb-573e-4835-a4d2-3cae1d3446e3 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:41:01 user nova-compute[75247]: DEBUG nova.compute.manager [req-355ee2ca-b245-4be4-9cbe-beca605bb098 req-6d9329f2-b697-4414-bf19-e9ae454e5f28 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received event network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:41:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-355ee2ca-b245-4be4-9cbe-beca605bb098 req-6d9329f2-b697-4414-bf19-e9ae454e5f28 service nova] Acquiring lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:41:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-355ee2ca-b245-4be4-9cbe-beca605bb098 req-6d9329f2-b697-4414-bf19-e9ae454e5f28 service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:41:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-355ee2ca-b245-4be4-9cbe-beca605bb098 req-6d9329f2-b697-4414-bf19-e9ae454e5f28 service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:41:01 user nova-compute[75247]: DEBUG nova.compute.manager [req-355ee2ca-b245-4be4-9cbe-beca605bb098 req-6d9329f2-b697-4414-bf19-e9ae454e5f28 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] No waiting events found dispatching network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:41:01 user nova-compute[75247]: WARNING nova.compute.manager [req-355ee2ca-b245-4be4-9cbe-beca605bb098 req-6d9329f2-b697-4414-bf19-e9ae454e5f28 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received unexpected event network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc for instance with vm_state active and task_state None.
Dec 06 12:41:01 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Updating instance_info_cache with network_info: [{"id": "2c3b146f-74ce-47d5-9bca-54c20e685cdb", "address": "fa:16:3e:77:4d:71", "network": {"id": "b814ddee-1e11-441b-aa6f-c96e6aae965e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-831812673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ddbb56f5d94b0cb91768e9c9a7aa62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c3b146f-74", "ovs_interfaceid": "2c3b146f-74ce-47d5-9bca-54c20e685cdb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:41:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-0a07dcbb-573e-4835-a4d2-3cae1d3446e3" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:41:01 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 12:41:01 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:41:01 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:41:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:41:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:41:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:41:02 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 12:41:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received event network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] Acquiring lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] No waiting events found dispatching network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:41:03 user nova-compute[75247]: WARNING nova.compute.manager [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received unexpected event network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc for instance with vm_state active and task_state None.
Dec 06 12:41:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Received event network-vif-plugged-a205065f-e23d-46b2-9f34-f77ff2b3ebb1 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] Acquiring lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] Lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] Lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] No waiting events found dispatching network-vif-plugged-a205065f-e23d-46b2-9f34-f77ff2b3ebb1 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:41:03 user nova-compute[75247]: WARNING nova.compute.manager [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Received unexpected event network-vif-plugged-a205065f-e23d-46b2-9f34-f77ff2b3ebb1 for instance with vm_state active and task_state None.
Dec 06 12:41:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Received event network-vif-plugged-a205065f-e23d-46b2-9f34-f77ff2b3ebb1 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] Acquiring lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] Lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] Lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] No waiting events found dispatching network-vif-plugged-a205065f-e23d-46b2-9f34-f77ff2b3ebb1 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:41:03 user nova-compute[75247]: WARNING nova.compute.manager [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Received unexpected event network-vif-plugged-a205065f-e23d-46b2-9f34-f77ff2b3ebb1 for instance with vm_state active and task_state None.
Dec 06 12:41:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Received event network-vif-plugged-ee42c358-3097-4050-a477-8a48b500de81 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] Acquiring lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] No waiting events found dispatching network-vif-plugged-ee42c358-3097-4050-a477-8a48b500de81 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:41:03 user nova-compute[75247]: WARNING nova.compute.manager [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Received unexpected event network-vif-plugged-ee42c358-3097-4050-a477-8a48b500de81 for instance with vm_state active and task_state None.
Dec 06 12:41:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Received event network-vif-plugged-ee42c358-3097-4050-a477-8a48b500de81 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] Acquiring lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] No waiting events found dispatching network-vif-plugged-ee42c358-3097-4050-a477-8a48b500de81 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:41:03 user nova-compute[75247]: WARNING nova.compute.manager [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Received unexpected event network-vif-plugged-ee42c358-3097-4050-a477-8a48b500de81 for instance with vm_state active and task_state None.
Dec 06 12:41:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Received event network-vif-plugged-68ab6435-5cd9-45bf-891c-c20b68415e11 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] Acquiring lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] Lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] Lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] No waiting events found dispatching network-vif-plugged-68ab6435-5cd9-45bf-891c-c20b68415e11 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:41:03 user nova-compute[75247]: WARNING nova.compute.manager [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Received unexpected event network-vif-plugged-68ab6435-5cd9-45bf-891c-c20b68415e11 for instance with vm_state active and task_state None.
Dec 06 12:41:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Received event network-vif-plugged-68ab6435-5cd9-45bf-891c-c20b68415e11 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] Acquiring lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] Lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] Lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] No waiting events found dispatching network-vif-plugged-68ab6435-5cd9-45bf-891c-c20b68415e11 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:41:03 user nova-compute[75247]: WARNING nova.compute.manager [req-3ad2ed46-03e0-43e4-8b00-928907da8adb req-e37e257f-9e06-4857-a7c0-f2110a5cacb4 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Received unexpected event network-vif-plugged-68ab6435-5cd9-45bf-891c-c20b68415e11 for instance with vm_state active and task_state None.
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Acquiring lock "ed721541-3a94-496f-8b9d-88c74ac83ef7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:41:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "ed721541-3a94-496f-8b9d-88c74ac83ef7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:41:04 user nova-compute[75247]: DEBUG nova.compute.manager [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:41:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:41:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:41:04 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:41:04 user nova-compute[75247]: INFO nova.compute.claims [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Claim successful on node user
Dec 06 12:41:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:04 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:41:04 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:41:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.709s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:41:04 user nova-compute[75247]: DEBUG nova.compute.manager [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:41:05 user nova-compute[75247]: DEBUG nova.compute.manager [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:41:05 user nova-compute[75247]: DEBUG nova.network.neutron [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:41:05 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:41:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:05 user nova-compute[75247]: DEBUG nova.compute.manager [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:41:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-5c174480-f2f7-4177-8f72-a4a5a0a04a16 req-9b72ee95-4ef1-476d-9a89-1d52af384b95 service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Received event network-vif-plugged-b924c627-a11e-4fc4-8e23-d1a974c4de3d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:41:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5c174480-f2f7-4177-8f72-a4a5a0a04a16 req-9b72ee95-4ef1-476d-9a89-1d52af384b95 service nova] Acquiring lock "782289e2-91cd-4aee-9a08-eadfb2a5965b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:41:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5c174480-f2f7-4177-8f72-a4a5a0a04a16 req-9b72ee95-4ef1-476d-9a89-1d52af384b95 service nova] Lock "782289e2-91cd-4aee-9a08-eadfb2a5965b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:41:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5c174480-f2f7-4177-8f72-a4a5a0a04a16 req-9b72ee95-4ef1-476d-9a89-1d52af384b95 service nova] Lock "782289e2-91cd-4aee-9a08-eadfb2a5965b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:41:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-5c174480-f2f7-4177-8f72-a4a5a0a04a16 req-9b72ee95-4ef1-476d-9a89-1d52af384b95 service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] No waiting events found dispatching network-vif-plugged-b924c627-a11e-4fc4-8e23-d1a974c4de3d {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:41:05 user nova-compute[75247]: WARNING nova.compute.manager [req-5c174480-f2f7-4177-8f72-a4a5a0a04a16 req-9b72ee95-4ef1-476d-9a89-1d52af384b95 service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Received unexpected event network-vif-plugged-b924c627-a11e-4fc4-8e23-d1a974c4de3d for instance with vm_state active and task_state None.
Dec 06 12:41:05 user nova-compute[75247]: DEBUG nova.policy [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c12dc589ceb3429b8ae09c1413589709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d12120b32e41b891fd25ca49f9553a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:41:05 user nova-compute[75247]: INFO nova.virt.block_device [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Booting with volume f5d30437-2abd-41f4-9626-a1ce202bacb0 at /dev/vda
Dec 06 12:41:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/disk --force-share --output=json" returned: 0 in 0.329s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:05 user nova-compute[75247]: DEBUG os_brick.utils [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:41:05 user nova-compute[75247]: INFO oslo.privsep.daemon [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpwv8toh_9/privsep.sock']
Dec 06 12:41:05 user sudo[86336]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpwv8toh_9/privsep.sock
Dec 06 12:41:05 user sudo[86336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 06 12:41:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12f40dad-65dc-4281-aa53-6036aa7e26d9/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12f40dad-65dc-4281-aa53-6036aa7e26d9/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12f40dad-65dc-4281-aa53-6036aa7e26d9/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:06 user nova-compute[75247]: DEBUG nova.network.neutron [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Successfully created port: 795878af-3950-4253-83f2-7656b6ce8fb0 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:41:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12f40dad-65dc-4281-aa53-6036aa7e26d9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a07dcbb-573e-4835-a4d2-3cae1d3446e3/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a07dcbb-573e-4835-a4d2-3cae1d3446e3/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a07dcbb-573e-4835-a4d2-3cae1d3446e3/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a07dcbb-573e-4835-a4d2-3cae1d3446e3/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG nova.network.neutron [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Successfully updated port: 795878af-3950-4253-83f2-7656b6ce8fb0 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG nova.compute.manager [req-e762816d-2fb8-4e60-befd-d1bdc8acd2ad req-570513cc-d1f8-459b-bbbf-993025f0c56e service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Received event network-changed-795878af-3950-4253-83f2-7656b6ce8fb0 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG nova.compute.manager [req-e762816d-2fb8-4e60-befd-d1bdc8acd2ad req-570513cc-d1f8-459b-bbbf-993025f0c56e service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Refreshing instance network info cache due to event network-changed-795878af-3950-4253-83f2-7656b6ce8fb0. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e762816d-2fb8-4e60-befd-d1bdc8acd2ad req-570513cc-d1f8-459b-bbbf-993025f0c56e service nova] Acquiring lock "refresh_cache-ed721541-3a94-496f-8b9d-88c74ac83ef7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e762816d-2fb8-4e60-befd-d1bdc8acd2ad req-570513cc-d1f8-459b-bbbf-993025f0c56e service nova] Acquired lock "refresh_cache-ed721541-3a94-496f-8b9d-88c74ac83ef7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG nova.network.neutron [req-e762816d-2fb8-4e60-befd-d1bdc8acd2ad req-570513cc-d1f8-459b-bbbf-993025f0c56e service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Refreshing network info cache for port 795878af-3950-4253-83f2-7656b6ce8fb0 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:41:07 user sudo[86336]: pam_unix(sudo:session): session closed for user root
Dec 06 12:41:07 user nova-compute[75247]: INFO oslo.privsep.daemon [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Spawned new privsep daemon via rootwrap
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Acquiring lock "refresh_cache-ed721541-3a94-496f-8b9d-88c74ac83ef7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:41:07 user nova-compute[75247]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 06 12:41:07 user nova-compute[75247]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 06 12:41:07 user nova-compute[75247]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Dec 06 12:41:07 user nova-compute[75247]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86354
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb88cc5b-af94-4904-bee6-3b58327804ab]: (2,) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG nova.network.neutron [req-e762816d-2fb8-4e60-befd-d1bdc8acd2ad req-570513cc-d1f8-459b-bbbf-993025f0c56e service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG nova.compute.manager [req-64f04596-049e-4e29-a086-89614d8e992c req-73db6ff0-0ca4-467a-8ff2-a40976fd1090 service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Received event network-vif-plugged-b924c627-a11e-4fc4-8e23-d1a974c4de3d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-64f04596-049e-4e29-a086-89614d8e992c req-73db6ff0-0ca4-467a-8ff2-a40976fd1090 service nova] Acquiring lock "782289e2-91cd-4aee-9a08-eadfb2a5965b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-64f04596-049e-4e29-a086-89614d8e992c req-73db6ff0-0ca4-467a-8ff2-a40976fd1090 service nova] Lock "782289e2-91cd-4aee-9a08-eadfb2a5965b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-64f04596-049e-4e29-a086-89614d8e992c req-73db6ff0-0ca4-467a-8ff2-a40976fd1090 service nova] Lock "782289e2-91cd-4aee-9a08-eadfb2a5965b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG nova.compute.manager [req-64f04596-049e-4e29-a086-89614d8e992c req-73db6ff0-0ca4-467a-8ff2-a40976fd1090 service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] No waiting events found dispatching network-vif-plugged-b924c627-a11e-4fc4-8e23-d1a974c4de3d {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:41:07 user nova-compute[75247]: WARNING nova.compute.manager [req-64f04596-049e-4e29-a086-89614d8e992c req-73db6ff0-0ca4-467a-8ff2-a40976fd1090 service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Received unexpected event network-vif-plugged-b924c627-a11e-4fc4-8e23-d1a974c4de3d for instance with vm_state active and task_state None.
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0ccdca-7da0-467d-907f-341488c3792f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:07 user nova-compute[75247]: WARNING os_brick.initiator.connectors.nvmeof [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafbca62-af9e-41af-afef-7c0e876bcf2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3889d26a-b5b7-4957-92ab-0b9412f5531b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5279cb-a7bd-451b-a947-929db4640e4c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG nova.network.neutron [req-e762816d-2fb8-4e60-befd-d1bdc8acd2ad req-570513cc-d1f8-459b-bbbf-993025f0c56e service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e762816d-2fb8-4e60-befd-d1bdc8acd2ad req-570513cc-d1f8-459b-bbbf-993025f0c56e service nova] Releasing lock "refresh_cache-ed721541-3a94-496f-8b9d-88c74ac83ef7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Acquired lock "refresh_cache-ed721541-3a94-496f-8b9d-88c74ac83ef7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG nova.network.neutron [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:41:07 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b035ca65-4e7a-4144-ab10-2448d0b3c3dc]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG os_brick.utils [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] <== get_connector_properties: return (1988ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Updating existing volume attachment record: 0c55b243-74e5-4385-b97e-bd5a7abeb88a {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:41:07 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:41:07 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:41:07 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=7692MB free_disk=25.57952117919922GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:41:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:41:08 user nova-compute[75247]: DEBUG nova.network.neutron [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:41:08 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 0a07dcbb-573e-4835-a4d2-3cae1d3446e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:41:08 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 70c4664e-ae7a-47de-bba7-18300391d209 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:41:08 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 782289e2-91cd-4aee-9a08-eadfb2a5965b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:41:08 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:41:08 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 4531bf11-b948-4d57-bf55-f33563815e26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:41:08 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance ec9eea5d-dc9a-4a65-881a-a89538e3a593 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:41:08 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance f0e26668-e253-409a-a011-a54e8ad3ebb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:41:08 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance dbb64a66-f500-407b-ae92-80f27eb6ce2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:41:08 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance f2e75618-9164-4527-a6a3-5f5195effccf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:41:08 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 12f40dad-65dc-4281-aa53-6036aa7e26d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:41:08 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance ed721541-3a94-496f-8b9d-88c74ac83ef7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:41:08 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 12:41:08 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 12:41:08 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Refreshing inventories for resource provider d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 12:41:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:08 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Updating ProviderTree inventory for provider d326b140-3450-4409-964c-9eafc6cc025d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 12:41:08 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Updating inventory in ProviderTree for provider d326b140-3450-4409-964c-9eafc6cc025d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 12:41:08 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Refreshing aggregate associations for resource provider d326b140-3450-4409-964c-9eafc6cc025d, aggregates: None {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 12:41:08 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Refreshing trait associations for resource provider d326b140-3450-4409-964c-9eafc6cc025d, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 12:41:08 user nova-compute[75247]: DEBUG nova.network.neutron [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Updating instance_info_cache with network_info: [{"id": "795878af-3950-4253-83f2-7656b6ce8fb0", "address": "fa:16:3e:39:75:70", "network": {"id": "b8c04077-286f-434c-a3a6-cde7a124f301", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-378433228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d12120b32e41b891fd25ca49f9553a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795878af-39", "ovs_interfaceid": "795878af-3950-4253-83f2-7656b6ce8fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:41:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Releasing lock "refresh_cache-ed721541-3a94-496f-8b9d-88c74ac83ef7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:41:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Instance network_info: |[{"id": "795878af-3950-4253-83f2-7656b6ce8fb0", "address": "fa:16:3e:39:75:70", "network": {"id": "b8c04077-286f-434c-a3a6-cde7a124f301", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-378433228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d12120b32e41b891fd25ca49f9553a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795878af-39", "ovs_interfaceid": "795878af-3950-4253-83f2-7656b6ce8fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:41:09 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:41:09 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:41:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 12:41:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.360s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:41:10 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:41:10 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:41:10 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:41:10 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 12:41:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:11 user nova-compute[75247]: DEBUG nova.compute.manager [req-3346f719-952d-47f5-ba25-e17e0db75a24 req-8597fd03-b9db-440c-8bf2-17b30c9f5121 service nova] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Received event network-vif-plugged-bf793824-98be-4226-82eb-5e37152fcb2a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:41:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3346f719-952d-47f5-ba25-e17e0db75a24 req-8597fd03-b9db-440c-8bf2-17b30c9f5121 service nova] Acquiring lock "12f40dad-65dc-4281-aa53-6036aa7e26d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:41:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3346f719-952d-47f5-ba25-e17e0db75a24 req-8597fd03-b9db-440c-8bf2-17b30c9f5121 service nova] Lock "12f40dad-65dc-4281-aa53-6036aa7e26d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:41:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3346f719-952d-47f5-ba25-e17e0db75a24 req-8597fd03-b9db-440c-8bf2-17b30c9f5121 service nova] Lock "12f40dad-65dc-4281-aa53-6036aa7e26d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:41:11 user nova-compute[75247]: DEBUG nova.compute.manager [req-3346f719-952d-47f5-ba25-e17e0db75a24 req-8597fd03-b9db-440c-8bf2-17b30c9f5121 service nova] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] No waiting events found dispatching network-vif-plugged-bf793824-98be-4226-82eb-5e37152fcb2a {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:41:11 user nova-compute[75247]: WARNING nova.compute.manager [req-3346f719-952d-47f5-ba25-e17e0db75a24 req-8597fd03-b9db-440c-8bf2-17b30c9f5121 service nova] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Received unexpected event network-vif-plugged-bf793824-98be-4226-82eb-5e37152fcb2a for instance with vm_state active and task_state None.
Dec 06 12:41:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-abad1fa5-74ff-4eca-adfa-8452fabebea0 req-88a0beda-5dcc-4b46-b8b7-18d1f8f337ee service nova] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Received event network-vif-plugged-bf793824-98be-4226-82eb-5e37152fcb2a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:41:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-abad1fa5-74ff-4eca-adfa-8452fabebea0 req-88a0beda-5dcc-4b46-b8b7-18d1f8f337ee service nova] Acquiring lock "12f40dad-65dc-4281-aa53-6036aa7e26d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:41:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-abad1fa5-74ff-4eca-adfa-8452fabebea0 req-88a0beda-5dcc-4b46-b8b7-18d1f8f337ee service nova] Lock "12f40dad-65dc-4281-aa53-6036aa7e26d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:41:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-abad1fa5-74ff-4eca-adfa-8452fabebea0 req-88a0beda-5dcc-4b46-b8b7-18d1f8f337ee service nova] Lock "12f40dad-65dc-4281-aa53-6036aa7e26d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:41:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-abad1fa5-74ff-4eca-adfa-8452fabebea0 req-88a0beda-5dcc-4b46-b8b7-18d1f8f337ee service nova] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] No waiting events found dispatching network-vif-plugged-bf793824-98be-4226-82eb-5e37152fcb2a {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:41:13 user nova-compute[75247]: WARNING nova.compute.manager [req-abad1fa5-74ff-4eca-adfa-8452fabebea0 req-88a0beda-5dcc-4b46-b8b7-18d1f8f337ee service nova] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Received unexpected event network-vif-plugged-bf793824-98be-4226-82eb-5e37152fcb2a for instance with vm_state active and task_state None.
Dec 06 12:41:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG nova.compute.manager [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:41:18 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Creating image(s)
Dec 06 12:41:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Did not create local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Ensure instance console log exists: /opt/stack/data/nova/instances/ed721541-3a94-496f-8b9d-88c74ac83ef7/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Start _get_guest_xml network_info=[{"id": "795878af-3950-4253-83f2-7656b6ce8fb0", "address": "fa:16:3e:39:75:70", "network": {"id": "b8c04077-286f-434c-a3a6-cde7a124f301", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-378433228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d12120b32e41b891fd25ca49f9553a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795878af-39", "ovs_interfaceid": "795878af-3950-4253-83f2-7656b6ce8fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '0c55b243-74e5-4385-b97e-bd5a7abeb88a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'teobKPCy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ed721541-3a94-496f-8b9d-88c74ac83ef7', 'attached_at': '', 'detached_at': '', 'volume_id': 'f5d30437-2abd-41f4-9626-a1ce202bacb0', 'serial': 'f5d30437-2abd-41f4-9626-a1ce202bacb0'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:41:18 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:41:18 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:41:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG os_brick.initiator.connector [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Factory for ISCSI on None {{(pid=75247) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'teobKPCy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:41:18 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:41:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:41:18 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:41:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:41:18 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e8aefe-6c74-4576-b58c-88a77bdce9d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:41:18 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[764fef12-4869-4a4c-8f3b-8678cb242b12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0] added
Dec 06 12:41:18 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfe6b8c-ca0b-46f5-b86c-03f68e65a495]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[61595105-b258-42a6-b25d-1004d2b96c6c]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v teobKPCy {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v teobKPCy" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7d157f-6026-4992-9852-8d22bf53fcc8]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'teobKPCy'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[58547d79-c305-4156-b0e2-0606bc199e39]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ad2f81-a878-4f69-bba0-c7f7dbe695db]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 12:41:18 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:41:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 12:41:18 user nova-compute[75247]:  {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:41:18 user nova-compute[75247]: WARNING os_brick.initiator.connectors.iscsi [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 12:41:18 user nova-compute[75247]: 
Dec 06 12:41:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --login" returned: 0 in 1.050s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea11bb1-9725-42f1-83c3-c97039dbeb5a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0, portal: 172.16.0.220,3260]
Dec 06 12:41:20 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0, portal: 172.16.0.220,3260] successful.
Dec 06 12:41:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[58dc23e7-5359-4eae-a1ad-3ffa3bff5156]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e764c7a4-2200-42ae-b3c1-b426df38f2c4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:41:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:41:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:41:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:41:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.238s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:41:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:41:20 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:41:20 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:41:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0e7263-b5cb-4eb5-9c4d-55a555fb6ddd]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:20 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:41:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'teobKPCy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:41:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.270s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] <== connect_volume: return (2271ms) {'type': 'block', 'scsi_wwn': '23933303631366262', 'path': '/dev/sdb'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933303631366262', 'path': '/dev/sdb'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2112362070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2112362070',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAvGjqKGelHMukSgIEWiaJYGvjKnXCgFhWE2e9opkG+MtYR0JDGRdm7aO7xPBVUPfutpJlFkjfqa+5bgZXZpZP3Yy5+bfGop2oLmWOnvB+kyfjNOJ8IAYFrs9oEZQCG4w==',key_name='tempest-keypair-863855062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05d12120b32e41b891fd25ca49f9553a',ramdisk_id='',reservation_id='r-ouvdxg8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-888686040',owner_user_name='tempest-ServerActionsV293TestJSON-888686040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:41:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12dc589ceb3429b8ae09c1413589709',uuid=ed721541-3a94-496f-8b9d-88c74ac83ef7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "795878af-3950-4253-83f2-7656b6ce8fb0", "address": "fa:16:3e:39:75:70", "network": {"id": "b8c04077-286f-434c-a3a6-cde7a124f301", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-378433228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d12120b32e41b891fd25ca49f9553a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795878af-39", "ovs_interfaceid": "795878af-3950-4253-83f2-7656b6ce8fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Converting VIF {"id": "795878af-3950-4253-83f2-7656b6ce8fb0", "address": "fa:16:3e:39:75:70", "network": {"id": "b8c04077-286f-434c-a3a6-cde7a124f301", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-378433228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d12120b32e41b891fd25ca49f9553a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795878af-39", "ovs_interfaceid": "795878af-3950-4253-83f2-7656b6ce8fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:75:70,bridge_name='br-int',has_traffic_filtering=True,id=795878af-3950-4253-83f2-7656b6ce8fb0,network=Network(b8c04077-286f-434c-a3a6-cde7a124f301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap795878af-39') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG nova.objects.instance [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lazy-loading 'pci_devices' on Instance uuid ed721541-3a94-496f-8b9d-88c74ac83ef7 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:41:21 user nova-compute[75247]:   <uuid>ed721541-3a94-496f-8b9d-88c74ac83ef7</uuid>
Dec 06 12:41:21 user nova-compute[75247]:   <name>instance-0000000b</name>
Dec 06 12:41:21 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:41:21 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:41:21 user nova-compute[75247]:   <metadata>
Dec 06 12:41:21 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:41:21 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:41:21 user nova-compute[75247]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2112362070</nova:name>
Dec 06 12:41:21 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:41:18</nova:creationTime>
Dec 06 12:41:21 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:41:21 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:41:21 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:41:21 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:41:21 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:41:21 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:41:21 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:41:21 user nova-compute[75247]:       <nova:owner>
Dec 06 12:41:21 user nova-compute[75247]:         <nova:user uuid="c12dc589ceb3429b8ae09c1413589709">tempest-ServerActionsV293TestJSON-888686040-project-member</nova:user>
Dec 06 12:41:21 user nova-compute[75247]:         <nova:project uuid="05d12120b32e41b891fd25ca49f9553a">tempest-ServerActionsV293TestJSON-888686040</nova:project>
Dec 06 12:41:21 user nova-compute[75247]:       </nova:owner>
Dec 06 12:41:21 user nova-compute[75247]:       <nova:ports>
Dec 06 12:41:21 user nova-compute[75247]:         <nova:port uuid="795878af-3950-4253-83f2-7656b6ce8fb0">
Dec 06 12:41:21 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 06 12:41:21 user nova-compute[75247]:         </nova:port>
Dec 06 12:41:21 user nova-compute[75247]:       </nova:ports>
Dec 06 12:41:21 user nova-compute[75247]:     </nova:instance>
Dec 06 12:41:21 user nova-compute[75247]:   </metadata>
Dec 06 12:41:21 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:41:21 user nova-compute[75247]:     <system>
Dec 06 12:41:21 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:41:21 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:41:21 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:41:21 user nova-compute[75247]:       <entry name="serial">ed721541-3a94-496f-8b9d-88c74ac83ef7</entry>
Dec 06 12:41:21 user nova-compute[75247]:       <entry name="uuid">ed721541-3a94-496f-8b9d-88c74ac83ef7</entry>
Dec 06 12:41:21 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:41:21 user nova-compute[75247]:     </system>
Dec 06 12:41:21 user nova-compute[75247]:   </sysinfo>
Dec 06 12:41:21 user nova-compute[75247]:   <os>
Dec 06 12:41:21 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:41:21 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:41:21 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:41:21 user nova-compute[75247]:   </os>
Dec 06 12:41:21 user nova-compute[75247]:   <features>
Dec 06 12:41:21 user nova-compute[75247]:     <acpi/>
Dec 06 12:41:21 user nova-compute[75247]:     <apic/>
Dec 06 12:41:21 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:41:21 user nova-compute[75247]:   </features>
Dec 06 12:41:21 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:41:21 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:41:21 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:41:21 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:41:21 user nova-compute[75247]:   </clock>
Dec 06 12:41:21 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:41:21 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:41:21 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:41:21 user nova-compute[75247]:   </cpu>
Dec 06 12:41:21 user nova-compute[75247]:   <devices>
Dec 06 12:41:21 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 12:41:21 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:41:21 user nova-compute[75247]:       <source dev="/dev/sdb"/>
Dec 06 12:41:21 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:41:21 user nova-compute[75247]:       <serial>f5d30437-2abd-41f4-9626-a1ce202bacb0</serial>
Dec 06 12:41:21 user nova-compute[75247]:     </disk>
Dec 06 12:41:21 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:41:21 user nova-compute[75247]:       <mac address="fa:16:3e:39:75:70"/>
Dec 06 12:41:21 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:41:21 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:41:21 user nova-compute[75247]:       <target dev="tap795878af-39"/>
Dec 06 12:41:21 user nova-compute[75247]:     </interface>
Dec 06 12:41:21 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:41:21 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/ed721541-3a94-496f-8b9d-88c74ac83ef7/console.log" append="off"/>
Dec 06 12:41:21 user nova-compute[75247]:     </serial>
Dec 06 12:41:21 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:41:21 user nova-compute[75247]:     <video>
Dec 06 12:41:21 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:41:21 user nova-compute[75247]:     </video>
Dec 06 12:41:21 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:41:21 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:41:21 user nova-compute[75247]:     </rng>
Dec 06 12:41:21 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:41:21 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:41:21 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:41:21 user nova-compute[75247]:     </memballoon>
Dec 06 12:41:21 user nova-compute[75247]:   </devices>
Dec 06 12:41:21 user nova-compute[75247]: </domain>
Dec 06 12:41:21 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2112362070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2112362070',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAvGjqKGelHMukSgIEWiaJYGvjKnXCgFhWE2e9opkG+MtYR0JDGRdm7aO7xPBVUPfutpJlFkjfqa+5bgZXZpZP3Yy5+bfGop2oLmWOnvB+kyfjNOJ8IAYFrs9oEZQCG4w==',key_name='tempest-keypair-863855062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05d12120b32e41b891fd25ca49f9553a',ramdisk_id='',reservation_id='r-ouvdxg8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-888686040',owner_user_name='tempest-ServerActionsV293TestJSON-888686040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:41:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12dc589ceb3429b8ae09c1413589709',uuid=ed721541-3a94-496f-8b9d-88c74ac83ef7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "795878af-3950-4253-83f2-7656b6ce8fb0", "address": "fa:16:3e:39:75:70", "network": {"id": "b8c04077-286f-434c-a3a6-cde7a124f301", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-378433228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d12120b32e41b891fd25ca49f9553a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795878af-39", "ovs_interfaceid": "795878af-3950-4253-83f2-7656b6ce8fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Converting VIF {"id": "795878af-3950-4253-83f2-7656b6ce8fb0", "address": "fa:16:3e:39:75:70", "network": {"id": "b8c04077-286f-434c-a3a6-cde7a124f301", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-378433228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d12120b32e41b891fd25ca49f9553a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795878af-39", "ovs_interfaceid": "795878af-3950-4253-83f2-7656b6ce8fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:75:70,bridge_name='br-int',has_traffic_filtering=True,id=795878af-3950-4253-83f2-7656b6ce8fb0,network=Network(b8c04077-286f-434c-a3a6-cde7a124f301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap795878af-39') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG os_vif [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:75:70,bridge_name='br-int',has_traffic_filtering=True,id=795878af-3950-4253-83f2-7656b6ce8fb0,network=Network(b8c04077-286f-434c-a3a6-cde7a124f301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap795878af-39') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '20314134-4086-5bb0-8246-57ead8c0e1cd', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap795878af-39, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap795878af-39, col_values=(('qos', UUID('82ed0343-b1ba-4966-8ca4-a398b9a4d4f0')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap795878af-39, col_values=(('external_ids', {'iface-id': '795878af-3950-4253-83f2-7656b6ce8fb0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:75:70', 'vm-uuid': 'ed721541-3a94-496f-8b9d-88c74ac83ef7'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:21 user nova-compute[75247]: INFO os_vif [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:75:70,bridge_name='br-int',has_traffic_filtering=True,id=795878af-3950-4253-83f2-7656b6ce8fb0,network=Network(b8c04077-286f-434c-a3a6-cde7a124f301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap795878af-39')
Dec 06 12:41:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:41:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] No VIF found with MAC fa:16:3e:39:75:70, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:41:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-eb4fd7db-972f-49da-860a-c4fec2dd768e req-c369684c-cfb4-49cc-a7df-367a643e00b7 service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Received event network-vif-plugged-795878af-3950-4253-83f2-7656b6ce8fb0 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:41:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-eb4fd7db-972f-49da-860a-c4fec2dd768e req-c369684c-cfb4-49cc-a7df-367a643e00b7 service nova] Acquiring lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:41:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-eb4fd7db-972f-49da-860a-c4fec2dd768e req-c369684c-cfb4-49cc-a7df-367a643e00b7 service nova] Lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:41:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-eb4fd7db-972f-49da-860a-c4fec2dd768e req-c369684c-cfb4-49cc-a7df-367a643e00b7 service nova] Lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:41:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-eb4fd7db-972f-49da-860a-c4fec2dd768e req-c369684c-cfb4-49cc-a7df-367a643e00b7 service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] No waiting events found dispatching network-vif-plugged-795878af-3950-4253-83f2-7656b6ce8fb0 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:41:22 user nova-compute[75247]: WARNING nova.compute.manager [req-eb4fd7db-972f-49da-860a-c4fec2dd768e req-c369684c-cfb4-49cc-a7df-367a643e00b7 service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Received unexpected event network-vif-plugged-795878af-3950-4253-83f2-7656b6ce8fb0 for instance with vm_state building and task_state spawning.
Dec 06 12:41:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:41:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:41:22 user nova-compute[75247]: DEBUG nova.compute.manager [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:41:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:41:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:41:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:23 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:41:23 user nova-compute[75247]: INFO nova.compute.claims [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Claim successful on node user
Dec 06 12:41:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:23 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:41:23 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:41:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:41:23 user nova-compute[75247]: DEBUG nova.compute.manager [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:41:23 user nova-compute[75247]: DEBUG nova.compute.manager [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:41:23 user nova-compute[75247]: DEBUG nova.network.neutron [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:41:23 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:41:23 user nova-compute[75247]: DEBUG nova.compute.manager [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:41:23 user nova-compute[75247]: INFO nova.virt.block_device [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Booting with volume eb5461f8-6a34-42f7-975e-bf166e43dbd4 at /dev/vda
Dec 06 12:41:23 user nova-compute[75247]: DEBUG nova.policy [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b81d6b6eeb741bc9c76444729f6d6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2611cfbe440d98fc54a3c186152be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:41:23 user nova-compute[75247]: DEBUG os_brick.utils [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:41:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:23 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbc1d90-341f-4a4a-9e4c-2beb1e4cd209]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:23 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d78318-5d5d-49a6-bc25-da8c8102302a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:23 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0787ae6-f3d7-4bf4-902b-8c663b11d173]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:23 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f988f0-768b-4b04-9841-0017e5946eb0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:41:24 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:41:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:41:24 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:41:24 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9769d81a-6149-4438-8103-46958ab1376f]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:24 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:41:24 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:41:24 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:41:24 user nova-compute[75247]: DEBUG os_brick.utils [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:41:24 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Updating existing volume attachment record: 51c1e5e6-380f-40d6-ac1b-f6806a5bfb62 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:41:24 user nova-compute[75247]: DEBUG nova.network.neutron [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Successfully created port: ce9cf139-5123-474a-b4ea-0880d5b48d27 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:41:24 user nova-compute[75247]: DEBUG nova.compute.manager [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:41:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:41:24 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Instance spawned successfully.
Dec 06 12:41:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:41:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:41:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:41:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:41:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:41:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:41:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:41:24 user nova-compute[75247]: DEBUG nova.compute.manager [req-270d5395-c896-480d-aa2d-08bfdd550d9b req-c03a3353-948c-4e4c-8266-c717aca29159 service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Received event network-vif-plugged-795878af-3950-4253-83f2-7656b6ce8fb0 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:41:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-270d5395-c896-480d-aa2d-08bfdd550d9b req-c03a3353-948c-4e4c-8266-c717aca29159 service nova] Acquiring lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:41:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-270d5395-c896-480d-aa2d-08bfdd550d9b req-c03a3353-948c-4e4c-8266-c717aca29159 service nova] Lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:41:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-270d5395-c896-480d-aa2d-08bfdd550d9b req-c03a3353-948c-4e4c-8266-c717aca29159 service nova] Lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:41:24 user nova-compute[75247]: DEBUG nova.compute.manager [req-270d5395-c896-480d-aa2d-08bfdd550d9b req-c03a3353-948c-4e4c-8266-c717aca29159 service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] No waiting events found dispatching network-vif-plugged-795878af-3950-4253-83f2-7656b6ce8fb0 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:41:24 user nova-compute[75247]: WARNING nova.compute.manager [req-270d5395-c896-480d-aa2d-08bfdd550d9b req-c03a3353-948c-4e4c-8266-c717aca29159 service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Received unexpected event network-vif-plugged-795878af-3950-4253-83f2-7656b6ce8fb0 for instance with vm_state building and task_state spawning.
Dec 06 12:41:24 user nova-compute[75247]: INFO nova.compute.manager [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Took 6.05 seconds to spawn the instance on the hypervisor.
Dec 06 12:41:24 user nova-compute[75247]: DEBUG nova.compute.manager [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:41:24 user nova-compute[75247]: INFO nova.compute.manager [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Took 20.76 seconds to build instance.
Dec 06 12:41:24 user nova-compute[75247]: DEBUG nova.network.neutron [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Successfully created port: 3d9b37b6-a28d-4028-ac06-9cd7685d403f {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:41:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-481604e9-8742-4f12-9a43-137a38c8f9bb tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "ed721541-3a94-496f-8b9d-88c74ac83ef7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.897s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:41:25 user nova-compute[75247]: DEBUG nova.network.neutron [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Successfully created port: 7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:41:25 user nova-compute[75247]: DEBUG nova.network.neutron [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Successfully created port: f9384778-27c0-459c-90f1-512f3f1bbda5 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:41:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:26 user nova-compute[75247]: DEBUG nova.network.neutron [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Successfully created port: 0b94c5e7-0a3d-43d9-9c8a-35badae08754 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:41:26 user nova-compute[75247]: DEBUG nova.network.neutron [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Successfully updated port: ce9cf139-5123-474a-b4ea-0880d5b48d27 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:41:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-57fb358a-0df7-49a8-8cad-46f6e5a73a26 req-a8a27a24-7309-489f-9899-3de820f65bf0 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-changed-ce9cf139-5123-474a-b4ea-0880d5b48d27 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:41:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-57fb358a-0df7-49a8-8cad-46f6e5a73a26 req-a8a27a24-7309-489f-9899-3de820f65bf0 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Refreshing instance network info cache due to event network-changed-ce9cf139-5123-474a-b4ea-0880d5b48d27. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:41:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-57fb358a-0df7-49a8-8cad-46f6e5a73a26 req-a8a27a24-7309-489f-9899-3de820f65bf0 service nova] Acquiring lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:41:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-57fb358a-0df7-49a8-8cad-46f6e5a73a26 req-a8a27a24-7309-489f-9899-3de820f65bf0 service nova] Acquired lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:41:26 user nova-compute[75247]: DEBUG nova.network.neutron [req-57fb358a-0df7-49a8-8cad-46f6e5a73a26 req-a8a27a24-7309-489f-9899-3de820f65bf0 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Refreshing network info cache for port ce9cf139-5123-474a-b4ea-0880d5b48d27 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:41:27 user nova-compute[75247]: DEBUG nova.network.neutron [req-57fb358a-0df7-49a8-8cad-46f6e5a73a26 req-a8a27a24-7309-489f-9899-3de820f65bf0 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:41:27 user nova-compute[75247]: DEBUG nova.network.neutron [req-57fb358a-0df7-49a8-8cad-46f6e5a73a26 req-a8a27a24-7309-489f-9899-3de820f65bf0 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:41:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-57fb358a-0df7-49a8-8cad-46f6e5a73a26 req-a8a27a24-7309-489f-9899-3de820f65bf0 service nova] Releasing lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:41:27 user nova-compute[75247]: DEBUG nova.network.neutron [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Successfully updated port: a20eb2f0-1219-4738-9733-7bf8618ac75d {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:41:28 user nova-compute[75247]: DEBUG nova.network.neutron [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Successfully updated port: 650ff76d-5da3-40b6-a2f7-3c9bcfa49a51 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:41:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:29 user nova-compute[75247]: DEBUG nova.compute.manager [req-c137d215-71ea-4396-8919-d56559a83d8f req-a272ee02-3638-4288-8c6e-864fec4afca2 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-changed-a20eb2f0-1219-4738-9733-7bf8618ac75d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:41:29 user nova-compute[75247]: DEBUG nova.compute.manager [req-c137d215-71ea-4396-8919-d56559a83d8f req-a272ee02-3638-4288-8c6e-864fec4afca2 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Refreshing instance network info cache due to event network-changed-a20eb2f0-1219-4738-9733-7bf8618ac75d. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:41:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c137d215-71ea-4396-8919-d56559a83d8f req-a272ee02-3638-4288-8c6e-864fec4afca2 service nova] Acquiring lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:41:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c137d215-71ea-4396-8919-d56559a83d8f req-a272ee02-3638-4288-8c6e-864fec4afca2 service nova] Acquired lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:41:29 user nova-compute[75247]: DEBUG nova.network.neutron [req-c137d215-71ea-4396-8919-d56559a83d8f req-a272ee02-3638-4288-8c6e-864fec4afca2 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Refreshing network info cache for port a20eb2f0-1219-4738-9733-7bf8618ac75d {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:41:29 user nova-compute[75247]: DEBUG nova.network.neutron [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Successfully updated port: 3d9b37b6-a28d-4028-ac06-9cd7685d403f {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:41:29 user nova-compute[75247]: DEBUG nova.network.neutron [req-c137d215-71ea-4396-8919-d56559a83d8f req-a272ee02-3638-4288-8c6e-864fec4afca2 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:41:29 user nova-compute[75247]: DEBUG nova.network.neutron [req-c137d215-71ea-4396-8919-d56559a83d8f req-a272ee02-3638-4288-8c6e-864fec4afca2 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:41:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c137d215-71ea-4396-8919-d56559a83d8f req-a272ee02-3638-4288-8c6e-864fec4afca2 service nova] Releasing lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:41:29 user nova-compute[75247]: DEBUG nova.compute.manager [req-c137d215-71ea-4396-8919-d56559a83d8f req-a272ee02-3638-4288-8c6e-864fec4afca2 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-changed-650ff76d-5da3-40b6-a2f7-3c9bcfa49a51 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:41:29 user nova-compute[75247]: DEBUG nova.compute.manager [req-c137d215-71ea-4396-8919-d56559a83d8f req-a272ee02-3638-4288-8c6e-864fec4afca2 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Refreshing instance network info cache due to event network-changed-650ff76d-5da3-40b6-a2f7-3c9bcfa49a51. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:41:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c137d215-71ea-4396-8919-d56559a83d8f req-a272ee02-3638-4288-8c6e-864fec4afca2 service nova] Acquiring lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:41:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c137d215-71ea-4396-8919-d56559a83d8f req-a272ee02-3638-4288-8c6e-864fec4afca2 service nova] Acquired lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:41:29 user nova-compute[75247]: DEBUG nova.network.neutron [req-c137d215-71ea-4396-8919-d56559a83d8f req-a272ee02-3638-4288-8c6e-864fec4afca2 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Refreshing network info cache for port 650ff76d-5da3-40b6-a2f7-3c9bcfa49a51 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:41:29 user nova-compute[75247]: DEBUG nova.network.neutron [req-c137d215-71ea-4396-8919-d56559a83d8f req-a272ee02-3638-4288-8c6e-864fec4afca2 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:41:29 user nova-compute[75247]: DEBUG nova.network.neutron [req-c137d215-71ea-4396-8919-d56559a83d8f req-a272ee02-3638-4288-8c6e-864fec4afca2 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:41:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c137d215-71ea-4396-8919-d56559a83d8f req-a272ee02-3638-4288-8c6e-864fec4afca2 service nova] Releasing lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:41:30 user nova-compute[75247]: DEBUG nova.network.neutron [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Successfully updated port: 7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:41:30 user nova-compute[75247]: DEBUG nova.network.neutron [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Successfully updated port: f9384778-27c0-459c-90f1-512f3f1bbda5 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:41:31 user nova-compute[75247]: DEBUG nova.compute.manager [req-ef4d41aa-960c-41f8-9d1a-84461ac903c6 req-a105679d-e1bb-47ca-8fb2-1781aa1a5532 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-changed-3d9b37b6-a28d-4028-ac06-9cd7685d403f {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:41:31 user nova-compute[75247]: DEBUG nova.compute.manager [req-ef4d41aa-960c-41f8-9d1a-84461ac903c6 req-a105679d-e1bb-47ca-8fb2-1781aa1a5532 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Refreshing instance network info cache due to event network-changed-3d9b37b6-a28d-4028-ac06-9cd7685d403f. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:41:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ef4d41aa-960c-41f8-9d1a-84461ac903c6 req-a105679d-e1bb-47ca-8fb2-1781aa1a5532 service nova] Acquiring lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:41:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ef4d41aa-960c-41f8-9d1a-84461ac903c6 req-a105679d-e1bb-47ca-8fb2-1781aa1a5532 service nova] Acquired lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:41:31 user nova-compute[75247]: DEBUG nova.network.neutron [req-ef4d41aa-960c-41f8-9d1a-84461ac903c6 req-a105679d-e1bb-47ca-8fb2-1781aa1a5532 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Refreshing network info cache for port 3d9b37b6-a28d-4028-ac06-9cd7685d403f {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:41:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:31 user nova-compute[75247]: DEBUG nova.network.neutron [req-ef4d41aa-960c-41f8-9d1a-84461ac903c6 req-a105679d-e1bb-47ca-8fb2-1781aa1a5532 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:41:31 user nova-compute[75247]: DEBUG nova.network.neutron [req-ef4d41aa-960c-41f8-9d1a-84461ac903c6 req-a105679d-e1bb-47ca-8fb2-1781aa1a5532 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:41:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ef4d41aa-960c-41f8-9d1a-84461ac903c6 req-a105679d-e1bb-47ca-8fb2-1781aa1a5532 service nova] Releasing lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:41:31 user nova-compute[75247]: DEBUG nova.compute.manager [req-ef4d41aa-960c-41f8-9d1a-84461ac903c6 req-a105679d-e1bb-47ca-8fb2-1781aa1a5532 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-changed-7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:41:31 user nova-compute[75247]: DEBUG nova.compute.manager [req-ef4d41aa-960c-41f8-9d1a-84461ac903c6 req-a105679d-e1bb-47ca-8fb2-1781aa1a5532 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Refreshing instance network info cache due to event network-changed-7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:41:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ef4d41aa-960c-41f8-9d1a-84461ac903c6 req-a105679d-e1bb-47ca-8fb2-1781aa1a5532 service nova] Acquiring lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:41:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ef4d41aa-960c-41f8-9d1a-84461ac903c6 req-a105679d-e1bb-47ca-8fb2-1781aa1a5532 service nova] Acquired lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:41:31 user nova-compute[75247]: DEBUG nova.network.neutron [req-ef4d41aa-960c-41f8-9d1a-84461ac903c6 req-a105679d-e1bb-47ca-8fb2-1781aa1a5532 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Refreshing network info cache for port 7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:41:31 user nova-compute[75247]: DEBUG nova.network.neutron [req-ef4d41aa-960c-41f8-9d1a-84461ac903c6 req-a105679d-e1bb-47ca-8fb2-1781aa1a5532 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:41:31 user nova-compute[75247]: DEBUG nova.network.neutron [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Successfully updated port: 0b94c5e7-0a3d-43d9-9c8a-35badae08754 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:41:31 user nova-compute[75247]: DEBUG nova.network.neutron [req-ef4d41aa-960c-41f8-9d1a-84461ac903c6 req-a105679d-e1bb-47ca-8fb2-1781aa1a5532 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:41:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Acquiring lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:41:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ef4d41aa-960c-41f8-9d1a-84461ac903c6 req-a105679d-e1bb-47ca-8fb2-1781aa1a5532 service nova] Releasing lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:41:31 user nova-compute[75247]: DEBUG nova.compute.manager [req-ef4d41aa-960c-41f8-9d1a-84461ac903c6 req-a105679d-e1bb-47ca-8fb2-1781aa1a5532 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-changed-f9384778-27c0-459c-90f1-512f3f1bbda5 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:41:31 user nova-compute[75247]: DEBUG nova.compute.manager [req-ef4d41aa-960c-41f8-9d1a-84461ac903c6 req-a105679d-e1bb-47ca-8fb2-1781aa1a5532 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Refreshing instance network info cache due to event network-changed-f9384778-27c0-459c-90f1-512f3f1bbda5. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:41:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ef4d41aa-960c-41f8-9d1a-84461ac903c6 req-a105679d-e1bb-47ca-8fb2-1781aa1a5532 service nova] Acquiring lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:41:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ef4d41aa-960c-41f8-9d1a-84461ac903c6 req-a105679d-e1bb-47ca-8fb2-1781aa1a5532 service nova] Acquired lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:41:31 user nova-compute[75247]: DEBUG nova.network.neutron [req-ef4d41aa-960c-41f8-9d1a-84461ac903c6 req-a105679d-e1bb-47ca-8fb2-1781aa1a5532 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Refreshing network info cache for port f9384778-27c0-459c-90f1-512f3f1bbda5 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:41:31 user nova-compute[75247]: DEBUG nova.network.neutron [req-ef4d41aa-960c-41f8-9d1a-84461ac903c6 req-a105679d-e1bb-47ca-8fb2-1781aa1a5532 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:41:32 user nova-compute[75247]: DEBUG nova.network.neutron [req-ef4d41aa-960c-41f8-9d1a-84461ac903c6 req-a105679d-e1bb-47ca-8fb2-1781aa1a5532 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:41:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ef4d41aa-960c-41f8-9d1a-84461ac903c6 req-a105679d-e1bb-47ca-8fb2-1781aa1a5532 service nova] Releasing lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:41:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Acquired lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:41:32 user nova-compute[75247]: DEBUG nova.network.neutron [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:41:32 user nova-compute[75247]: DEBUG nova.network.neutron [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:41:33 user nova-compute[75247]: DEBUG nova.compute.manager [req-4652351b-4267-4a96-a220-09513731452d req-d8dc1584-0208-40b0-bbad-b78cc6d8b4ef service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-changed-0b94c5e7-0a3d-43d9-9c8a-35badae08754 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:41:33 user nova-compute[75247]: DEBUG nova.compute.manager [req-4652351b-4267-4a96-a220-09513731452d req-d8dc1584-0208-40b0-bbad-b78cc6d8b4ef service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Refreshing instance network info cache due to event network-changed-0b94c5e7-0a3d-43d9-9c8a-35badae08754. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:41:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4652351b-4267-4a96-a220-09513731452d req-d8dc1584-0208-40b0-bbad-b78cc6d8b4ef service nova] Acquiring lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:41:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG nova.network.neutron [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Updating instance_info_cache with network_info: [{"id": "ce9cf139-5123-474a-b4ea-0880d5b48d27", "address": "fa:16:3e:67:4c:8e", "network": {"id": "c6a1a892-2161-4aae-9790-3c6e03f34389", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1604742206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9cf139-51", "ovs_interfaceid": "ce9cf139-5123-474a-b4ea-0880d5b48d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a20eb2f0-1219-4738-9733-7bf8618ac75d", "address": "fa:16:3e:81:34:c2", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20eb2f0-12", "ovs_interfaceid": "a20eb2f0-1219-4738-9733-7bf8618ac75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "650ff76d-5da3-40b6-a2f7-3c9bcfa49a51", "address": "fa:16:3e:6b:d5:f0", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650ff76d-5d", "ovs_interfaceid": "650ff76d-5da3-40b6-a2f7-3c9bcfa49a51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d9b37b6-a28d-4028-ac06-9cd7685d403f", "address": "fa:16:3e:59:b1:a2", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9b37b6-a2", "ovs_interfaceid": "3d9b37b6-a28d-4028-ac06-9cd7685d403f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6", "address": "fa:16:3e:ad:ba:c7", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa60734-d8", "ovs_interfaceid": "7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9384778-27c0-459c-90f1-512f3f1bbda5", "address": "fa:16:3e:6e:01:3c", "network": {"id": "25876878-6a68-4cc1-9332-822c5778b8da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1585990936", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9384778-27", "ovs_interfaceid": "f9384778-27c0-459c-90f1-512f3f1bbda5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b94c5e7-0a3d-43d9-9c8a-35badae08754", "address": "fa:16:3e:e1:9f:73", "network": {"id": "25876878-6a68-4cc1-9332-822c5778b8da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1585990936", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b94c5e7-0a", "ovs_interfaceid": "0b94c5e7-0a3d-43d9-9c8a-35badae08754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:41:34 user nova-compute[75247]: INFO nova.virt.block_device [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Booting with volume 886c0221-91a2-4e23-9fb5-686b92c3f90c at /dev/vdb
Dec 06 12:41:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Releasing lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG nova.compute.manager [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Instance network_info: |[{"id": "ce9cf139-5123-474a-b4ea-0880d5b48d27", "address": "fa:16:3e:67:4c:8e", "network": {"id": "c6a1a892-2161-4aae-9790-3c6e03f34389", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1604742206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9cf139-51", "ovs_interfaceid": "ce9cf139-5123-474a-b4ea-0880d5b48d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a20eb2f0-1219-4738-9733-7bf8618ac75d", "address": "fa:16:3e:81:34:c2", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20eb2f0-12", "ovs_interfaceid": "a20eb2f0-1219-4738-9733-7bf8618ac75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "650ff76d-5da3-40b6-a2f7-3c9bcfa49a51", "address": "fa:16:3e:6b:d5:f0", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650ff76d-5d", "ovs_interfaceid": "650ff76d-5da3-40b6-a2f7-3c9bcfa49a51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d9b37b6-a28d-4028-ac06-9cd7685d403f", "address": "fa:16:3e:59:b1:a2", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9b37b6-a2", "ovs_interfaceid": "3d9b37b6-a28d-4028-ac06-9cd7685d403f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6", "address": "fa:16:3e:ad:ba:c7", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa60734-d8", "ovs_interfaceid": "7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9384778-27c0-459c-90f1-512f3f1bbda5", "address": "fa:16:3e:6e:01:3c", "network": {"id": "25876878-6a68-4cc1-9332-822c5778b8da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1585990936", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9384778-27", "ovs_interfaceid": "f9384778-27c0-459c-90f1-512f3f1bbda5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b94c5e7-0a3d-43d9-9c8a-35badae08754", "address": "fa:16:3e:e1:9f:73", "network": {"id": "25876878-6a68-4cc1-9332-822c5778b8da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1585990936", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b94c5e7-0a", "ovs_interfaceid": "0b94c5e7-0a3d-43d9-9c8a-35badae08754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4652351b-4267-4a96-a220-09513731452d req-d8dc1584-0208-40b0-bbad-b78cc6d8b4ef service nova] Acquired lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG nova.network.neutron [req-4652351b-4267-4a96-a220-09513731452d req-d8dc1584-0208-40b0-bbad-b78cc6d8b4ef service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Refreshing network info cache for port 0b94c5e7-0a3d-43d9-9c8a-35badae08754 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG os_brick.utils [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f20a18-38d2-41a1-a602-151ad66fffe8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d03258-70af-4807-a4fc-ccb9a5cd9a00]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec93020-6778-4f25-a9bd-c81f349a58e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcca781e-588c-4719-b2fb-d4077c106d1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:41:34 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:41:34 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f22a3d-7ead-4396-bc85-de97bcad0f65]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG os_brick.utils [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Updating existing volume attachment record: 3bf7afb8-3cf4-4a27-94ab-a075ba84c1ce {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG nova.network.neutron [req-4652351b-4267-4a96-a220-09513731452d req-d8dc1584-0208-40b0-bbad-b78cc6d8b4ef service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Updated VIF entry in instance network info cache for port 0b94c5e7-0a3d-43d9-9c8a-35badae08754. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG nova.network.neutron [req-4652351b-4267-4a96-a220-09513731452d req-d8dc1584-0208-40b0-bbad-b78cc6d8b4ef service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Updating instance_info_cache with network_info: [{"id": "ce9cf139-5123-474a-b4ea-0880d5b48d27", "address": "fa:16:3e:67:4c:8e", "network": {"id": "c6a1a892-2161-4aae-9790-3c6e03f34389", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1604742206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9cf139-51", "ovs_interfaceid": "ce9cf139-5123-474a-b4ea-0880d5b48d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a20eb2f0-1219-4738-9733-7bf8618ac75d", "address": "fa:16:3e:81:34:c2", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20eb2f0-12", "ovs_interfaceid": "a20eb2f0-1219-4738-9733-7bf8618ac75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "650ff76d-5da3-40b6-a2f7-3c9bcfa49a51", "address": "fa:16:3e:6b:d5:f0", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650ff76d-5d", "ovs_interfaceid": "650ff76d-5da3-40b6-a2f7-3c9bcfa49a51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d9b37b6-a28d-4028-ac06-9cd7685d403f", "address": "fa:16:3e:59:b1:a2", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9b37b6-a2", "ovs_interfaceid": "3d9b37b6-a28d-4028-ac06-9cd7685d403f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6", "address": "fa:16:3e:ad:ba:c7", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa60734-d8", "ovs_interfaceid": "7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9384778-27c0-459c-90f1-512f3f1bbda5", "address": "fa:16:3e:6e:01:3c", "network": {"id": "25876878-6a68-4cc1-9332-822c5778b8da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1585990936", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9384778-27", "ovs_interfaceid": "f9384778-27c0-459c-90f1-512f3f1bbda5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b94c5e7-0a3d-43d9-9c8a-35badae08754", "address": "fa:16:3e:e1:9f:73", "network": {"id": "25876878-6a68-4cc1-9332-822c5778b8da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1585990936", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b94c5e7-0a", "ovs_interfaceid": "0b94c5e7-0a3d-43d9-9c8a-35badae08754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:41:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4652351b-4267-4a96-a220-09513731452d req-d8dc1584-0208-40b0-bbad-b78cc6d8b4ef service nova] Releasing lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:41:36 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:41:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 12:41:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 12:41:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 12:41:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:41:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:43 user nova-compute[75247]: INFO nova.virt.block_device [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Booting with volume 92aa917b-0d45-40bc-89df-37e22cc3afd8 at /dev/vdc
Dec 06 12:41:43 user nova-compute[75247]: DEBUG os_brick.utils [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:41:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:43 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[223ede4a-dd79-4768-9dfa-bedd8ce7fb5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:43 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[122ab21b-b6d5-4080-a000-7866521780e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:43 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef461db5-bdf9-4c08-a193-bdc3a68f6293]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:43 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[165e7ad6-8757-4149-964c-8df31ea12b18]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:41:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:41:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:41:44 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:41:44 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce552aa3-ea13-4105-a1fe-4ea7a0d7d3c0]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:41:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:41:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:41:44 user nova-compute[75247]: DEBUG os_brick.utils [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:41:44 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Updating existing volume attachment record: bb45fa96-1a0b-44d0-8313-6628470400fe {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:41:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG nova.compute.manager [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:41:53 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Creating image(s)
Dec 06 12:41:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Did not create local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Ensure instance console log exists: /opt/stack/data/nova/instances/51c56231-9ff5-45a6-ad38-e7ac68124ed4/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Start _get_guest_xml network_info=[{"id": "ce9cf139-5123-474a-b4ea-0880d5b48d27", "address": "fa:16:3e:67:4c:8e", "network": {"id": "c6a1a892-2161-4aae-9790-3c6e03f34389", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1604742206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9cf139-51", "ovs_interfaceid": "ce9cf139-5123-474a-b4ea-0880d5b48d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a20eb2f0-1219-4738-9733-7bf8618ac75d", "address": "fa:16:3e:81:34:c2", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20eb2f0-12", "ovs_interfaceid": "a20eb2f0-1219-4738-9733-7bf8618ac75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "650ff76d-5da3-40b6-a2f7-3c9bcfa49a51", "address": "fa:16:3e:6b:d5:f0", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650ff76d-5d", "ovs_interfaceid": "650ff76d-5da3-40b6-a2f7-3c9bcfa49a51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d9b37b6-a28d-4028-ac06-9cd7685d403f", "address": "fa:16:3e:59:b1:a2", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9b37b6-a2", "ovs_interfaceid": "3d9b37b6-a28d-4028-ac06-9cd7685d403f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6", "address": "fa:16:3e:ad:ba:c7", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa60734-d8", "ovs_interfaceid": "7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9384778-27c0-459c-90f1-512f3f1bbda5", "address": "fa:16:3e:6e:01:3c", "network": {"id": "25876878-6a68-4cc1-9332-822c5778b8da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1585990936", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9384778-27", "ovs_interfaceid": "f9384778-27c0-459c-90f1-512f3f1bbda5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b94c5e7-0a3d-43d9-9c8a-35badae08754", "address": "fa:16:3e:e1:9f:73", "network": {"id": "25876878-6a68-4cc1-9332-822c5778b8da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1585990936", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b94c5e7-0a", "ovs_interfaceid": "0b94c5e7-0a3d-43d9-9c8a-35badae08754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '51c1e5e6-380f-40d6-ac1b-f6806a5bfb62', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFiVLhsU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '51c56231-9ff5-45a6-ad38-e7ac68124ed4', 'attached_at': '', 'detached_at': '', 'volume_id': 'eb5461f8-6a34-42f7-975e-bf166e43dbd4', 'serial': 'eb5461f8-6a34-42f7-975e-bf166e43dbd4'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None}, {'boot_index': 1, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '3bf7afb8-3cf4-4a27-94ab-a075ba84c1ce', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShrDetyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '51c56231-9ff5-45a6-ad38-e7ac68124ed4', 'attached_at': '', 'detached_at': '', 'volume_id': '886c0221-91a2-4e23-9fb5-686b92c3f90c', 'serial': '886c0221-91a2-4e23-9fb5-686b92c3f90c'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None}, {'boot_index': 2, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'bb45fa96-1a0b-44d0-8313-6628470400fe', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mEWgvkVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '51c56231-9ff5-45a6-ad38-e7ac68124ed4', 'attached_at': '', 'detached_at': '', 'volume_id': '92aa917b-0d45-40bc-89df-37e22cc3afd8', 'serial': '92aa917b-0d45-40bc-89df-37e22cc3afd8'}, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:41:53 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:41:53 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:41:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFiVLhsU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:41:53 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:41:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:41:53 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:41:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:41:53 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d023a36d-40e0-49fd-8e38-8620f6c4e2fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:41:53 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8c439f-43a9-4ee8-aac9-6aa793a697b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4] added
Dec 06 12:41:53 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fe04fb-e647-4b5f-bce6-44b68bebe3b1]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d76a12-79a9-4777-89cb-7ea61e982e62]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TFiVLhsU {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TFiVLhsU" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[702813b4-5fc7-443c-8d92-689377ee245d]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TFiVLhsU'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4d84a0-334b-4bc3-ae11-edd7dbfa3950]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4542baec-87a6-49f5-872b-084a6cab95f3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:41:53 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:41:53 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5967c17d-89a1-405d-88cf-7426835d0168]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4, portal: 172.16.0.220,3260]
Dec 06 12:41:53 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4, portal: 172.16.0.220,3260] successful.
Dec 06 12:41:53 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfd2ae7-d355-4285-b93e-89dc4b633809]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58d3f18-2360-44f8-b358-c2cdc9b5a7a7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:41:53 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:41:53 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:41:53 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:41:53 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[af28b947-6246-456d-b577-19a2a52a59ca]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:41:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFiVLhsU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:41:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:41:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23133343663303663', 'path': '/dev/sdc'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:41:54 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133343663303663', 'path': '/dev/sdc'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShrDetyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:41:55 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:41:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:41:55 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:41:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:41:55 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0317c06f-8025-467b-9afe-7265f3e93aff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:41:55 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6f030b-78fa-4541-a637-4d6e93298d76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c] added
Dec 06 12:41:55 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[43da1ecb-35d7-404b-944d-c9ed3b0dd8d7]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3ad8c4-8712-41fe-a047-38e36b15a75b]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ShrDetyR {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ShrDetyR" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb534b6-8752-4b41-a38e-a4d98c28ee16]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ShrDetyR'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[280e637a-88ee-4e86-a805-43e98e259f9f]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e5842b-240c-419a-a5ba-934b23eba60e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:41:55 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:41:55 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:41:55 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:41:55 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[97067bf2-456e-48d1-9626-bcab84681cc9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c, portal: 172.16.0.220,3260]
Dec 06 12:41:55 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c, portal: 172.16.0.220,3260] successful.
Dec 06 12:41:55 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[937439e7-8177-4a05-a663-59e4a107b619]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[68309f79-6d67-45c4-a8f1-4f62fae7a8cb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:41:55 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:41:55 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:41:55 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:41:55 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:41:55 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:41:55 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[70038fd5-dbf4-43c2-a658-87ef0e258762]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:55 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShrDetyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '26234653663666536', 'path': '/dev/sdd'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234653663666536', 'path': '/dev/sdd'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mEWgvkVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:41:56 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:41:56 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:41:56 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[295d7515-3eef-40a1-9316-3e0d177b50a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:41:56 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e20c84-d8a5-4b2b-9d4e-328ab3b77124]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8] added
Dec 06 12:41:56 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6ec72e-8ec5-4b39-8602-6c4278153ae4]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1cd0e7-b290-45ee-97f9-00f5dc8a3544]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mEWgvkVA {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mEWgvkVA" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6569f475-c0db-4349-bb9b-c3d0dc28c097]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mEWgvkVA'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b719515-8866-4c8a-94f2-ee9377019193]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c74791-08d3-4658-9ac2-9fa8abcfba17]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:41:56 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:41:56 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:41:56 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:41:56 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:41:56 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:41:56 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b7e319-3001-4d18-a020-71fbf5ca727c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8, portal: 172.16.0.220,3260]
Dec 06 12:41:56 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8, portal: 172.16.0.220,3260] successful.
Dec 06 12:41:56 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14103ae-8df4-4f42-804f-7fc4e6cf92bb]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaefddcc-f1bf-449c-a904-61329a800509]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:41:56 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:41:56 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:41:56 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:41:56 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:41:56 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:41:56 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:41:56 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:41:56 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7475ae-7043-4bec-ba2c-56e1c27ee94b]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:41:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mEWgvkVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23561386335633037', 'path': '/dev/sde'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561386335633037', 'path': '/dev/sde'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1395602794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1395602794',id=12,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsK0o8hX3LL+8iByCifdWMM6pAHxt20WAEEgA8mlwjBPURbQRsot6wD8XjKgQH8TLAMnzdTfdz2RGsIRYV1pqbYCOnbI3PxxqRs9khNrYSibxJQ7UqBr8VORAImcLPxPw==',key_name='tempest-keypair-1087121586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5f2611cfbe440d98fc54a3c186152be',ramdisk_id='',reservation_id='r-p7hvmoiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1984999958',owner_user_name='tempest-TaggedBootDevicesTest-1984999958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:41:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b81d6b6eeb741bc9c76444729f6d6f2',uuid=51c56231-9ff5-45a6-ad38-e7ac68124ed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce9cf139-5123-474a-b4ea-0880d5b48d27", "address": "fa:16:3e:67:4c:8e", "network": {"id": "c6a1a892-2161-4aae-9790-3c6e03f34389", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1604742206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9cf139-51", "ovs_interfaceid": "ce9cf139-5123-474a-b4ea-0880d5b48d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converting VIF {"id": "ce9cf139-5123-474a-b4ea-0880d5b48d27", "address": "fa:16:3e:67:4c:8e", "network": {"id": "c6a1a892-2161-4aae-9790-3c6e03f34389", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1604742206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9cf139-51", "ovs_interfaceid": "ce9cf139-5123-474a-b4ea-0880d5b48d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:4c:8e,bridge_name='br-int',has_traffic_filtering=True,id=ce9cf139-5123-474a-b4ea-0880d5b48d27,network=Network(c6a1a892-2161-4aae-9790-3c6e03f34389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9cf139-51') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1395602794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1395602794',id=12,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsK0o8hX3LL+8iByCifdWMM6pAHxt20WAEEgA8mlwjBPURbQRsot6wD8XjKgQH8TLAMnzdTfdz2RGsIRYV1pqbYCOnbI3PxxqRs9khNrYSibxJQ7UqBr8VORAImcLPxPw==',key_name='tempest-keypair-1087121586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5f2611cfbe440d98fc54a3c186152be',ramdisk_id='',reservation_id='r-p7hvmoiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1984999958',owner_user_name='tempest-TaggedBootDevicesTest-1984999958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:41:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b81d6b6eeb741bc9c76444729f6d6f2',uuid=51c56231-9ff5-45a6-ad38-e7ac68124ed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a20eb2f0-1219-4738-9733-7bf8618ac75d", "address": "fa:16:3e:81:34:c2", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20eb2f0-12", "ovs_interfaceid": "a20eb2f0-1219-4738-9733-7bf8618ac75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converting VIF {"id": "a20eb2f0-1219-4738-9733-7bf8618ac75d", "address": "fa:16:3e:81:34:c2", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20eb2f0-12", "ovs_interfaceid": "a20eb2f0-1219-4738-9733-7bf8618ac75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:34:c2,bridge_name='br-int',has_traffic_filtering=True,id=a20eb2f0-1219-4738-9733-7bf8618ac75d,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa20eb2f0-12') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1395602794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1395602794',id=12,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsK0o8hX3LL+8iByCifdWMM6pAHxt20WAEEgA8mlwjBPURbQRsot6wD8XjKgQH8TLAMnzdTfdz2RGsIRYV1pqbYCOnbI3PxxqRs9khNrYSibxJQ7UqBr8VORAImcLPxPw==',key_name='tempest-keypair-1087121586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5f2611cfbe440d98fc54a3c186152be',ramdisk_id='',reservation_id='r-p7hvmoiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1984999958',owner_user_name='tempest-TaggedBootDevicesTest-1984999958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:41:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b81d6b6eeb741bc9c76444729f6d6f2',uuid=51c56231-9ff5-45a6-ad38-e7ac68124ed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "650ff76d-5da3-40b6-a2f7-3c9bcfa49a51", "address": "fa:16:3e:6b:d5:f0", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650ff76d-5d", "ovs_interfaceid": "650ff76d-5da3-40b6-a2f7-3c9bcfa49a51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converting VIF {"id": "650ff76d-5da3-40b6-a2f7-3c9bcfa49a51", "address": "fa:16:3e:6b:d5:f0", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650ff76d-5d", "ovs_interfaceid": "650ff76d-5da3-40b6-a2f7-3c9bcfa49a51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:d5:f0,bridge_name='br-int',has_traffic_filtering=True,id=650ff76d-5da3-40b6-a2f7-3c9bcfa49a51,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap650ff76d-5d') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1395602794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1395602794',id=12,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsK0o8hX3LL+8iByCifdWMM6pAHxt20WAEEgA8mlwjBPURbQRsot6wD8XjKgQH8TLAMnzdTfdz2RGsIRYV1pqbYCOnbI3PxxqRs9khNrYSibxJQ7UqBr8VORAImcLPxPw==',key_name='tempest-keypair-1087121586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5f2611cfbe440d98fc54a3c186152be',ramdisk_id='',reservation_id='r-p7hvmoiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1984999958',owner_user_name='tempest-TaggedBootDevicesTest-1984999958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:41:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b81d6b6eeb741bc9c76444729f6d6f2',uuid=51c56231-9ff5-45a6-ad38-e7ac68124ed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d9b37b6-a28d-4028-ac06-9cd7685d403f", "address": "fa:16:3e:59:b1:a2", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9b37b6-a2", "ovs_interfaceid": "3d9b37b6-a28d-4028-ac06-9cd7685d403f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converting VIF {"id": "3d9b37b6-a28d-4028-ac06-9cd7685d403f", "address": "fa:16:3e:59:b1:a2", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9b37b6-a2", "ovs_interfaceid": "3d9b37b6-a28d-4028-ac06-9cd7685d403f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:b1:a2,bridge_name='br-int',has_traffic_filtering=True,id=3d9b37b6-a28d-4028-ac06-9cd7685d403f,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9b37b6-a2') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1395602794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1395602794',id=12,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsK0o8hX3LL+8iByCifdWMM6pAHxt20WAEEgA8mlwjBPURbQRsot6wD8XjKgQH8TLAMnzdTfdz2RGsIRYV1pqbYCOnbI3PxxqRs9khNrYSibxJQ7UqBr8VORAImcLPxPw==',key_name='tempest-keypair-1087121586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5f2611cfbe440d98fc54a3c186152be',ramdisk_id='',reservation_id='r-p7hvmoiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1984999958',owner_user_name='tempest-TaggedBootDevicesTest-1984999958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:41:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b81d6b6eeb741bc9c76444729f6d6f2',uuid=51c56231-9ff5-45a6-ad38-e7ac68124ed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6", "address": "fa:16:3e:ad:ba:c7", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa60734-d8", "ovs_interfaceid": "7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converting VIF {"id": "7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6", "address": "fa:16:3e:ad:ba:c7", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa60734-d8", "ovs_interfaceid": "7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:ba:c7,bridge_name='br-int',has_traffic_filtering=True,id=7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fa60734-d8') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1395602794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1395602794',id=12,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsK0o8hX3LL+8iByCifdWMM6pAHxt20WAEEgA8mlwjBPURbQRsot6wD8XjKgQH8TLAMnzdTfdz2RGsIRYV1pqbYCOnbI3PxxqRs9khNrYSibxJQ7UqBr8VORAImcLPxPw==',key_name='tempest-keypair-1087121586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5f2611cfbe440d98fc54a3c186152be',ramdisk_id='',reservation_id='r-p7hvmoiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1984999958',owner_user_name='tempest-TaggedBootDevicesTest-1984999958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:41:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b81d6b6eeb741bc9c76444729f6d6f2',uuid=51c56231-9ff5-45a6-ad38-e7ac68124ed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9384778-27c0-459c-90f1-512f3f1bbda5", "address": "fa:16:3e:6e:01:3c", "network": {"id": "25876878-6a68-4cc1-9332-822c5778b8da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1585990936", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9384778-27", "ovs_interfaceid": "f9384778-27c0-459c-90f1-512f3f1bbda5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converting VIF {"id": "f9384778-27c0-459c-90f1-512f3f1bbda5", "address": "fa:16:3e:6e:01:3c", "network": {"id": "25876878-6a68-4cc1-9332-822c5778b8da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1585990936", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9384778-27", "ovs_interfaceid": "f9384778-27c0-459c-90f1-512f3f1bbda5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:01:3c,bridge_name='br-int',has_traffic_filtering=True,id=f9384778-27c0-459c-90f1-512f3f1bbda5,network=Network(25876878-6a68-4cc1-9332-822c5778b8da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9384778-27') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1395602794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1395602794',id=12,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsK0o8hX3LL+8iByCifdWMM6pAHxt20WAEEgA8mlwjBPURbQRsot6wD8XjKgQH8TLAMnzdTfdz2RGsIRYV1pqbYCOnbI3PxxqRs9khNrYSibxJQ7UqBr8VORAImcLPxPw==',key_name='tempest-keypair-1087121586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5f2611cfbe440d98fc54a3c186152be',ramdisk_id='',reservation_id='r-p7hvmoiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1984999958',owner_user_name='tempest-TaggedBootDevicesTest-1984999958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:41:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b81d6b6eeb741bc9c76444729f6d6f2',uuid=51c56231-9ff5-45a6-ad38-e7ac68124ed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b94c5e7-0a3d-43d9-9c8a-35badae08754", "address": "fa:16:3e:e1:9f:73", "network": {"id": "25876878-6a68-4cc1-9332-822c5778b8da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1585990936", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b94c5e7-0a", "ovs_interfaceid": "0b94c5e7-0a3d-43d9-9c8a-35badae08754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converting VIF {"id": "0b94c5e7-0a3d-43d9-9c8a-35badae08754", "address": "fa:16:3e:e1:9f:73", "network": {"id": "25876878-6a68-4cc1-9332-822c5778b8da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1585990936", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b94c5e7-0a", "ovs_interfaceid": "0b94c5e7-0a3d-43d9-9c8a-35badae08754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:9f:73,bridge_name='br-int',has_traffic_filtering=True,id=0b94c5e7-0a3d-43d9-9c8a-35badae08754,network=Network(25876878-6a68-4cc1-9332-822c5778b8da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b94c5e7-0a') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.objects.instance [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lazy-loading 'pci_devices' on Instance uuid 51c56231-9ff5-45a6-ad38-e7ac68124ed4 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:41:57 user nova-compute[75247]:   <uuid>51c56231-9ff5-45a6-ad38-e7ac68124ed4</uuid>
Dec 06 12:41:57 user nova-compute[75247]:   <name>instance-0000000c</name>
Dec 06 12:41:57 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:41:57 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:41:57 user nova-compute[75247]:   <metadata>
Dec 06 12:41:57 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:41:57 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:41:57 user nova-compute[75247]:       <nova:name>tempest-device-tagging-server-1395602794</nova:name>
Dec 06 12:41:57 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:41:53</nova:creationTime>
Dec 06 12:41:57 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:41:57 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:41:57 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:41:57 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:41:57 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:41:57 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:41:57 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:41:57 user nova-compute[75247]:       <nova:owner>
Dec 06 12:41:57 user nova-compute[75247]:         <nova:user uuid="5b81d6b6eeb741bc9c76444729f6d6f2">tempest-TaggedBootDevicesTest-1984999958-project-member</nova:user>
Dec 06 12:41:57 user nova-compute[75247]:         <nova:project uuid="c5f2611cfbe440d98fc54a3c186152be">tempest-TaggedBootDevicesTest-1984999958</nova:project>
Dec 06 12:41:57 user nova-compute[75247]:       </nova:owner>
Dec 06 12:41:57 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:41:57 user nova-compute[75247]:       <nova:ports>
Dec 06 12:41:57 user nova-compute[75247]:         <nova:port uuid="ce9cf139-5123-474a-b4ea-0880d5b48d27">
Dec 06 12:41:57 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 06 12:41:57 user nova-compute[75247]:         </nova:port>
Dec 06 12:41:57 user nova-compute[75247]:         <nova:port uuid="a20eb2f0-1219-4738-9733-7bf8618ac75d">
Dec 06 12:41:57 user nova-compute[75247]:           <nova:ip type="fixed" address="10.1.1.28" ipVersion="4"/>
Dec 06 12:41:57 user nova-compute[75247]:         </nova:port>
Dec 06 12:41:57 user nova-compute[75247]:         <nova:port uuid="650ff76d-5da3-40b6-a2f7-3c9bcfa49a51">
Dec 06 12:41:57 user nova-compute[75247]:           <nova:ip type="fixed" address="10.1.1.179" ipVersion="4"/>
Dec 06 12:41:57 user nova-compute[75247]:         </nova:port>
Dec 06 12:41:57 user nova-compute[75247]:         <nova:port uuid="3d9b37b6-a28d-4028-ac06-9cd7685d403f">
Dec 06 12:41:57 user nova-compute[75247]:           <nova:ip type="fixed" address="10.1.1.42" ipVersion="4"/>
Dec 06 12:41:57 user nova-compute[75247]:         </nova:port>
Dec 06 12:41:57 user nova-compute[75247]:         <nova:port uuid="7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6">
Dec 06 12:41:57 user nova-compute[75247]:           <nova:ip type="fixed" address="10.1.1.57" ipVersion="4"/>
Dec 06 12:41:57 user nova-compute[75247]:         </nova:port>
Dec 06 12:41:57 user nova-compute[75247]:         <nova:port uuid="f9384778-27c0-459c-90f1-512f3f1bbda5">
Dec 06 12:41:57 user nova-compute[75247]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Dec 06 12:41:57 user nova-compute[75247]:         </nova:port>
Dec 06 12:41:57 user nova-compute[75247]:         <nova:port uuid="0b94c5e7-0a3d-43d9-9c8a-35badae08754">
Dec 06 12:41:57 user nova-compute[75247]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Dec 06 12:41:57 user nova-compute[75247]:         </nova:port>
Dec 06 12:41:57 user nova-compute[75247]:       </nova:ports>
Dec 06 12:41:57 user nova-compute[75247]:     </nova:instance>
Dec 06 12:41:57 user nova-compute[75247]:   </metadata>
Dec 06 12:41:57 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:41:57 user nova-compute[75247]:     <system>
Dec 06 12:41:57 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:41:57 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:41:57 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:41:57 user nova-compute[75247]:       <entry name="serial">51c56231-9ff5-45a6-ad38-e7ac68124ed4</entry>
Dec 06 12:41:57 user nova-compute[75247]:       <entry name="uuid">51c56231-9ff5-45a6-ad38-e7ac68124ed4</entry>
Dec 06 12:41:57 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:41:57 user nova-compute[75247]:     </system>
Dec 06 12:41:57 user nova-compute[75247]:   </sysinfo>
Dec 06 12:41:57 user nova-compute[75247]:   <os>
Dec 06 12:41:57 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:41:57 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:41:57 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:41:57 user nova-compute[75247]:   </os>
Dec 06 12:41:57 user nova-compute[75247]:   <features>
Dec 06 12:41:57 user nova-compute[75247]:     <acpi/>
Dec 06 12:41:57 user nova-compute[75247]:     <apic/>
Dec 06 12:41:57 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:41:57 user nova-compute[75247]:   </features>
Dec 06 12:41:57 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:41:57 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:41:57 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:41:57 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:41:57 user nova-compute[75247]:   </clock>
Dec 06 12:41:57 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:41:57 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:41:57 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:41:57 user nova-compute[75247]:   </cpu>
Dec 06 12:41:57 user nova-compute[75247]:   <devices>
Dec 06 12:41:57 user nova-compute[75247]:     <disk type="file" device="cdrom">
Dec 06 12:41:57 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none"/>
Dec 06 12:41:57 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/51c56231-9ff5-45a6-ad38-e7ac68124ed4/disk.config"/>
Dec 06 12:41:57 user nova-compute[75247]:       <target dev="hda" bus="ide"/>
Dec 06 12:41:57 user nova-compute[75247]:     </disk>
Dec 06 12:41:57 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 12:41:57 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:41:57 user nova-compute[75247]:       <source dev="/dev/sdc"/>
Dec 06 12:41:57 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:41:57 user nova-compute[75247]:       <serial>eb5461f8-6a34-42f7-975e-bf166e43dbd4</serial>
Dec 06 12:41:57 user nova-compute[75247]:     </disk>
Dec 06 12:41:57 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 12:41:57 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:41:57 user nova-compute[75247]:       <source dev="/dev/sdd"/>
Dec 06 12:41:57 user nova-compute[75247]:       <target dev="vdb" bus="virtio"/>
Dec 06 12:41:57 user nova-compute[75247]:       <serial>886c0221-91a2-4e23-9fb5-686b92c3f90c</serial>
Dec 06 12:41:57 user nova-compute[75247]:     </disk>
Dec 06 12:41:57 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 12:41:57 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:41:57 user nova-compute[75247]:       <source dev="/dev/sde"/>
Dec 06 12:41:57 user nova-compute[75247]:       <target dev="vdc" bus="virtio"/>
Dec 06 12:41:57 user nova-compute[75247]:       <serial>92aa917b-0d45-40bc-89df-37e22cc3afd8</serial>
Dec 06 12:41:57 user nova-compute[75247]:     </disk>
Dec 06 12:41:57 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:41:57 user nova-compute[75247]:       <mac address="fa:16:3e:67:4c:8e"/>
Dec 06 12:41:57 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:41:57 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:41:57 user nova-compute[75247]:       <target dev="tapce9cf139-51"/>
Dec 06 12:41:57 user nova-compute[75247]:     </interface>
Dec 06 12:41:57 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:41:57 user nova-compute[75247]:       <mac address="fa:16:3e:81:34:c2"/>
Dec 06 12:41:57 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:41:57 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:41:57 user nova-compute[75247]:       <target dev="tapa20eb2f0-12"/>
Dec 06 12:41:57 user nova-compute[75247]:     </interface>
Dec 06 12:41:57 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:41:57 user nova-compute[75247]:       <mac address="fa:16:3e:6b:d5:f0"/>
Dec 06 12:41:57 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:41:57 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:41:57 user nova-compute[75247]:       <target dev="tap650ff76d-5d"/>
Dec 06 12:41:57 user nova-compute[75247]:     </interface>
Dec 06 12:41:57 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:41:57 user nova-compute[75247]:       <mac address="fa:16:3e:59:b1:a2"/>
Dec 06 12:41:57 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:41:57 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:41:57 user nova-compute[75247]:       <target dev="tap3d9b37b6-a2"/>
Dec 06 12:41:57 user nova-compute[75247]:     </interface>
Dec 06 12:41:57 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:41:57 user nova-compute[75247]:       <mac address="fa:16:3e:ad:ba:c7"/>
Dec 06 12:41:57 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:41:57 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:41:57 user nova-compute[75247]:       <target dev="tap7fa60734-d8"/>
Dec 06 12:41:57 user nova-compute[75247]:     </interface>
Dec 06 12:41:57 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:41:57 user nova-compute[75247]:       <mac address="fa:16:3e:6e:01:3c"/>
Dec 06 12:41:57 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:41:57 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:41:57 user nova-compute[75247]:       <target dev="tapf9384778-27"/>
Dec 06 12:41:57 user nova-compute[75247]:     </interface>
Dec 06 12:41:57 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:41:57 user nova-compute[75247]:       <mac address="fa:16:3e:e1:9f:73"/>
Dec 06 12:41:57 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:41:57 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:41:57 user nova-compute[75247]:       <target dev="tap0b94c5e7-0a"/>
Dec 06 12:41:57 user nova-compute[75247]:     </interface>
Dec 06 12:41:57 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:41:57 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/51c56231-9ff5-45a6-ad38-e7ac68124ed4/console.log" append="off"/>
Dec 06 12:41:57 user nova-compute[75247]:     </serial>
Dec 06 12:41:57 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:41:57 user nova-compute[75247]:     <video>
Dec 06 12:41:57 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:41:57 user nova-compute[75247]:     </video>
Dec 06 12:41:57 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:41:57 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:41:57 user nova-compute[75247]:     </rng>
Dec 06 12:41:57 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:41:57 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:41:57 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:41:57 user nova-compute[75247]:     </memballoon>
Dec 06 12:41:57 user nova-compute[75247]:   </devices>
Dec 06 12:41:57 user nova-compute[75247]: </domain>
Dec 06 12:41:57 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1395602794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1395602794',id=12,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsK0o8hX3LL+8iByCifdWMM6pAHxt20WAEEgA8mlwjBPURbQRsot6wD8XjKgQH8TLAMnzdTfdz2RGsIRYV1pqbYCOnbI3PxxqRs9khNrYSibxJQ7UqBr8VORAImcLPxPw==',key_name='tempest-keypair-1087121586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5f2611cfbe440d98fc54a3c186152be',ramdisk_id='',reservation_id='r-p7hvmoiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1984999958',owner_user_name='tempest-TaggedBootDevicesTest-1984999958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:41:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b81d6b6eeb741bc9c76444729f6d6f2',uuid=51c56231-9ff5-45a6-ad38-e7ac68124ed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce9cf139-5123-474a-b4ea-0880d5b48d27", "address": "fa:16:3e:67:4c:8e", "network": {"id": "c6a1a892-2161-4aae-9790-3c6e03f34389", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1604742206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9cf139-51", "ovs_interfaceid": "ce9cf139-5123-474a-b4ea-0880d5b48d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converting VIF {"id": "ce9cf139-5123-474a-b4ea-0880d5b48d27", "address": "fa:16:3e:67:4c:8e", "network": {"id": "c6a1a892-2161-4aae-9790-3c6e03f34389", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1604742206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9cf139-51", "ovs_interfaceid": "ce9cf139-5123-474a-b4ea-0880d5b48d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:4c:8e,bridge_name='br-int',has_traffic_filtering=True,id=ce9cf139-5123-474a-b4ea-0880d5b48d27,network=Network(c6a1a892-2161-4aae-9790-3c6e03f34389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9cf139-51') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG os_vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:4c:8e,bridge_name='br-int',has_traffic_filtering=True,id=ce9cf139-5123-474a-b4ea-0880d5b48d27,network=Network(c6a1a892-2161-4aae-9790-3c6e03f34389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9cf139-51') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f51b751a-b8eb-595a-8944-b78ad4be64f6', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce9cf139-51, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce9cf139-51, col_values=(('qos', UUID('8f22fbb2-460f-4a33-beb2-37fd7812e390')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce9cf139-51, col_values=(('external_ids', {'iface-id': 'ce9cf139-5123-474a-b4ea-0880d5b48d27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:4c:8e', 'vm-uuid': '51c56231-9ff5-45a6-ad38-e7ac68124ed4'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:57 user nova-compute[75247]: INFO os_vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:4c:8e,bridge_name='br-int',has_traffic_filtering=True,id=ce9cf139-5123-474a-b4ea-0880d5b48d27,network=Network(c6a1a892-2161-4aae-9790-3c6e03f34389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9cf139-51')
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1395602794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1395602794',id=12,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsK0o8hX3LL+8iByCifdWMM6pAHxt20WAEEgA8mlwjBPURbQRsot6wD8XjKgQH8TLAMnzdTfdz2RGsIRYV1pqbYCOnbI3PxxqRs9khNrYSibxJQ7UqBr8VORAImcLPxPw==',key_name='tempest-keypair-1087121586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5f2611cfbe440d98fc54a3c186152be',ramdisk_id='',reservation_id='r-p7hvmoiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1984999958',owner_user_name='tempest-TaggedBootDevicesTest-1984999958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:41:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b81d6b6eeb741bc9c76444729f6d6f2',uuid=51c56231-9ff5-45a6-ad38-e7ac68124ed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a20eb2f0-1219-4738-9733-7bf8618ac75d", "address": "fa:16:3e:81:34:c2", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20eb2f0-12", "ovs_interfaceid": "a20eb2f0-1219-4738-9733-7bf8618ac75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converting VIF {"id": "a20eb2f0-1219-4738-9733-7bf8618ac75d", "address": "fa:16:3e:81:34:c2", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20eb2f0-12", "ovs_interfaceid": "a20eb2f0-1219-4738-9733-7bf8618ac75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:34:c2,bridge_name='br-int',has_traffic_filtering=True,id=a20eb2f0-1219-4738-9733-7bf8618ac75d,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa20eb2f0-12') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG os_vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:34:c2,bridge_name='br-int',has_traffic_filtering=True,id=a20eb2f0-1219-4738-9733-7bf8618ac75d,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa20eb2f0-12') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6006052e-08bf-5f15-809d-7adea72b2b7b', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa20eb2f0-12, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa20eb2f0-12, col_values=(('qos', UUID('fa3d2d56-6972-4f55-b5b2-85dc61e984f7')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa20eb2f0-12, col_values=(('external_ids', {'iface-id': 'a20eb2f0-1219-4738-9733-7bf8618ac75d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:34:c2', 'vm-uuid': '51c56231-9ff5-45a6-ad38-e7ac68124ed4'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:57 user nova-compute[75247]: INFO os_vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:34:c2,bridge_name='br-int',has_traffic_filtering=True,id=a20eb2f0-1219-4738-9733-7bf8618ac75d,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa20eb2f0-12')
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1395602794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1395602794',id=12,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsK0o8hX3LL+8iByCifdWMM6pAHxt20WAEEgA8mlwjBPURbQRsot6wD8XjKgQH8TLAMnzdTfdz2RGsIRYV1pqbYCOnbI3PxxqRs9khNrYSibxJQ7UqBr8VORAImcLPxPw==',key_name='tempest-keypair-1087121586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5f2611cfbe440d98fc54a3c186152be',ramdisk_id='',reservation_id='r-p7hvmoiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1984999958',owner_user_name='tempest-TaggedBootDevicesTest-1984999958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:41:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b81d6b6eeb741bc9c76444729f6d6f2',uuid=51c56231-9ff5-45a6-ad38-e7ac68124ed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "650ff76d-5da3-40b6-a2f7-3c9bcfa49a51", "address": "fa:16:3e:6b:d5:f0", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650ff76d-5d", "ovs_interfaceid": "650ff76d-5da3-40b6-a2f7-3c9bcfa49a51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converting VIF {"id": "650ff76d-5da3-40b6-a2f7-3c9bcfa49a51", "address": "fa:16:3e:6b:d5:f0", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650ff76d-5d", "ovs_interfaceid": "650ff76d-5da3-40b6-a2f7-3c9bcfa49a51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:d5:f0,bridge_name='br-int',has_traffic_filtering=True,id=650ff76d-5da3-40b6-a2f7-3c9bcfa49a51,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap650ff76d-5d') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG os_vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:d5:f0,bridge_name='br-int',has_traffic_filtering=True,id=650ff76d-5da3-40b6-a2f7-3c9bcfa49a51,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap650ff76d-5d') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b0f3f976-983b-5e58-9a74-dbb37c397cc5', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap650ff76d-5d, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap650ff76d-5d, col_values=(('qos', UUID('6b207c0d-8850-4fd1-b3fb-4883ca5e4824')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap650ff76d-5d, col_values=(('external_ids', {'iface-id': '650ff76d-5da3-40b6-a2f7-3c9bcfa49a51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:d5:f0', 'vm-uuid': '51c56231-9ff5-45a6-ad38-e7ac68124ed4'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:57 user nova-compute[75247]: INFO os_vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:d5:f0,bridge_name='br-int',has_traffic_filtering=True,id=650ff76d-5da3-40b6-a2f7-3c9bcfa49a51,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap650ff76d-5d')
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1395602794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1395602794',id=12,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsK0o8hX3LL+8iByCifdWMM6pAHxt20WAEEgA8mlwjBPURbQRsot6wD8XjKgQH8TLAMnzdTfdz2RGsIRYV1pqbYCOnbI3PxxqRs9khNrYSibxJQ7UqBr8VORAImcLPxPw==',key_name='tempest-keypair-1087121586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5f2611cfbe440d98fc54a3c186152be',ramdisk_id='',reservation_id='r-p7hvmoiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1984999958',owner_user_name='tempest-TaggedBootDevicesTest-1984999958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:41:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b81d6b6eeb741bc9c76444729f6d6f2',uuid=51c56231-9ff5-45a6-ad38-e7ac68124ed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d9b37b6-a28d-4028-ac06-9cd7685d403f", "address": "fa:16:3e:59:b1:a2", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9b37b6-a2", "ovs_interfaceid": "3d9b37b6-a28d-4028-ac06-9cd7685d403f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converting VIF {"id": "3d9b37b6-a28d-4028-ac06-9cd7685d403f", "address": "fa:16:3e:59:b1:a2", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9b37b6-a2", "ovs_interfaceid": "3d9b37b6-a28d-4028-ac06-9cd7685d403f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:b1:a2,bridge_name='br-int',has_traffic_filtering=True,id=3d9b37b6-a28d-4028-ac06-9cd7685d403f,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9b37b6-a2') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG os_vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:b1:a2,bridge_name='br-int',has_traffic_filtering=True,id=3d9b37b6-a28d-4028-ac06-9cd7685d403f,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9b37b6-a2') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3cf18bba-d9c6-56ce-bb96-02f905a15df2', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d9b37b6-a2, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d9b37b6-a2, col_values=(('qos', UUID('e5add9b7-d7b8-45b3-85cc-c74137065cc6')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d9b37b6-a2, col_values=(('external_ids', {'iface-id': '3d9b37b6-a28d-4028-ac06-9cd7685d403f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:b1:a2', 'vm-uuid': '51c56231-9ff5-45a6-ad38-e7ac68124ed4'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:57 user nova-compute[75247]: INFO os_vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:b1:a2,bridge_name='br-int',has_traffic_filtering=True,id=3d9b37b6-a28d-4028-ac06-9cd7685d403f,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9b37b6-a2')
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1395602794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1395602794',id=12,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsK0o8hX3LL+8iByCifdWMM6pAHxt20WAEEgA8mlwjBPURbQRsot6wD8XjKgQH8TLAMnzdTfdz2RGsIRYV1pqbYCOnbI3PxxqRs9khNrYSibxJQ7UqBr8VORAImcLPxPw==',key_name='tempest-keypair-1087121586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5f2611cfbe440d98fc54a3c186152be',ramdisk_id='',reservation_id='r-p7hvmoiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1984999958',owner_user_name='tempest-TaggedBootDevicesTest-1984999958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:41:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b81d6b6eeb741bc9c76444729f6d6f2',uuid=51c56231-9ff5-45a6-ad38-e7ac68124ed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6", "address": "fa:16:3e:ad:ba:c7", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa60734-d8", "ovs_interfaceid": "7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converting VIF {"id": "7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6", "address": "fa:16:3e:ad:ba:c7", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa60734-d8", "ovs_interfaceid": "7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:ba:c7,bridge_name='br-int',has_traffic_filtering=True,id=7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fa60734-d8') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG os_vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:ba:c7,bridge_name='br-int',has_traffic_filtering=True,id=7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fa60734-d8') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b363864b-f22d-520f-967e-54789bb0c1c5', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7fa60734-d8, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7fa60734-d8, col_values=(('qos', UUID('b2b03b5a-344b-45a3-86fd-af01e2fade35')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7fa60734-d8, col_values=(('external_ids', {'iface-id': '7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:ba:c7', 'vm-uuid': '51c56231-9ff5-45a6-ad38-e7ac68124ed4'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:58 user nova-compute[75247]: INFO os_vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:ba:c7,bridge_name='br-int',has_traffic_filtering=True,id=7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fa60734-d8')
Dec 06 12:41:58 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1395602794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1395602794',id=12,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsK0o8hX3LL+8iByCifdWMM6pAHxt20WAEEgA8mlwjBPURbQRsot6wD8XjKgQH8TLAMnzdTfdz2RGsIRYV1pqbYCOnbI3PxxqRs9khNrYSibxJQ7UqBr8VORAImcLPxPw==',key_name='tempest-keypair-1087121586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5f2611cfbe440d98fc54a3c186152be',ramdisk_id='',reservation_id='r-p7hvmoiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1984999958',owner_user_name='tempest-TaggedBootDevicesTest-1984999958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:41:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b81d6b6eeb741bc9c76444729f6d6f2',uuid=51c56231-9ff5-45a6-ad38-e7ac68124ed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9384778-27c0-459c-90f1-512f3f1bbda5", "address": "fa:16:3e:6e:01:3c", "network": {"id": "25876878-6a68-4cc1-9332-822c5778b8da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1585990936", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9384778-27", "ovs_interfaceid": "f9384778-27c0-459c-90f1-512f3f1bbda5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converting VIF {"id": "f9384778-27c0-459c-90f1-512f3f1bbda5", "address": "fa:16:3e:6e:01:3c", "network": {"id": "25876878-6a68-4cc1-9332-822c5778b8da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1585990936", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9384778-27", "ovs_interfaceid": "f9384778-27c0-459c-90f1-512f3f1bbda5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:01:3c,bridge_name='br-int',has_traffic_filtering=True,id=f9384778-27c0-459c-90f1-512f3f1bbda5,network=Network(25876878-6a68-4cc1-9332-822c5778b8da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9384778-27') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG os_vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:01:3c,bridge_name='br-int',has_traffic_filtering=True,id=f9384778-27c0-459c-90f1-512f3f1bbda5,network=Network(25876878-6a68-4cc1-9332-822c5778b8da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9384778-27') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bfc674e8-5d3a-5a79-b578-51d91e09f208', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9384778-27, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9384778-27, col_values=(('qos', UUID('68f1eb29-3128-4f2a-a1d4-e11a744096fa')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9384778-27, col_values=(('external_ids', {'iface-id': 'f9384778-27c0-459c-90f1-512f3f1bbda5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:01:3c', 'vm-uuid': '51c56231-9ff5-45a6-ad38-e7ac68124ed4'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:58 user nova-compute[75247]: INFO os_vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:01:3c,bridge_name='br-int',has_traffic_filtering=True,id=f9384778-27c0-459c-90f1-512f3f1bbda5,network=Network(25876878-6a68-4cc1-9332-822c5778b8da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9384778-27')
Dec 06 12:41:58 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1395602794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1395602794',id=12,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsK0o8hX3LL+8iByCifdWMM6pAHxt20WAEEgA8mlwjBPURbQRsot6wD8XjKgQH8TLAMnzdTfdz2RGsIRYV1pqbYCOnbI3PxxqRs9khNrYSibxJQ7UqBr8VORAImcLPxPw==',key_name='tempest-keypair-1087121586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5f2611cfbe440d98fc54a3c186152be',ramdisk_id='',reservation_id='r-p7hvmoiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1984999958',owner_user_name='tempest-TaggedBootDevicesTest-1984999958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:41:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b81d6b6eeb741bc9c76444729f6d6f2',uuid=51c56231-9ff5-45a6-ad38-e7ac68124ed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b94c5e7-0a3d-43d9-9c8a-35badae08754", "address": "fa:16:3e:e1:9f:73", "network": {"id": "25876878-6a68-4cc1-9332-822c5778b8da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1585990936", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b94c5e7-0a", "ovs_interfaceid": "0b94c5e7-0a3d-43d9-9c8a-35badae08754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converting VIF {"id": "0b94c5e7-0a3d-43d9-9c8a-35badae08754", "address": "fa:16:3e:e1:9f:73", "network": {"id": "25876878-6a68-4cc1-9332-822c5778b8da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1585990936", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b94c5e7-0a", "ovs_interfaceid": "0b94c5e7-0a3d-43d9-9c8a-35badae08754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:9f:73,bridge_name='br-int',has_traffic_filtering=True,id=0b94c5e7-0a3d-43d9-9c8a-35badae08754,network=Network(25876878-6a68-4cc1-9332-822c5778b8da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b94c5e7-0a') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG os_vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:9f:73,bridge_name='br-int',has_traffic_filtering=True,id=0b94c5e7-0a3d-43d9-9c8a-35badae08754,network=Network(25876878-6a68-4cc1-9332-822c5778b8da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b94c5e7-0a') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6f24f3e-28cf-5ac2-99dc-656167e21f30', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b94c5e7-0a, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b94c5e7-0a, col_values=(('qos', UUID('f5237358-14f2-4b6f-bad4-eb1a5fcc8fe2')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b94c5e7-0a, col_values=(('external_ids', {'iface-id': '0b94c5e7-0a3d-43d9-9c8a-35badae08754', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:9f:73', 'vm-uuid': '51c56231-9ff5-45a6-ad38-e7ac68124ed4'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:41:58 user nova-compute[75247]: INFO os_vif [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:9f:73,bridge_name='br-int',has_traffic_filtering=True,id=0b94c5e7-0a3d-43d9-9c8a-35badae08754,network=Network(25876878-6a68-4cc1-9332-822c5778b8da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b94c5e7-0a')
Dec 06 12:41:58 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] No BDM found with device name hda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] No VIF found with MAC fa:16:3e:67:4c:8e, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] No VIF found with MAC fa:16:3e:ad:ba:c7, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:41:58 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Using config drive
Dec 06 12:41:58 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Creating config drive at /opt/stack/data/nova/instances/51c56231-9ff5-45a6-ad38-e7ac68124ed4/disk.config
Dec 06 12:41:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/51c56231-9ff5-45a6-ad38-e7ac68124ed4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8v5286jo {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/51c56231-9ff5-45a6-ad38-e7ac68124ed4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8v5286jo" returned: 0 in 0.065s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:41:58 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:41:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:00 user nova-compute[75247]: DEBUG nova.compute.manager [req-37cd5ff3-f7c0-4a33-b139-69baa641bbf5 req-c989b0e2-f114-46cd-a4ba-05ec0ce44731 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-plugged-ce9cf139-5123-474a-b4ea-0880d5b48d27 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-37cd5ff3-f7c0-4a33-b139-69baa641bbf5 req-c989b0e2-f114-46cd-a4ba-05ec0ce44731 service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-37cd5ff3-f7c0-4a33-b139-69baa641bbf5 req-c989b0e2-f114-46cd-a4ba-05ec0ce44731 service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-37cd5ff3-f7c0-4a33-b139-69baa641bbf5 req-c989b0e2-f114-46cd-a4ba-05ec0ce44731 service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:00 user nova-compute[75247]: DEBUG nova.compute.manager [req-37cd5ff3-f7c0-4a33-b139-69baa641bbf5 req-c989b0e2-f114-46cd-a4ba-05ec0ce44731 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-plugged-ce9cf139-5123-474a-b4ea-0880d5b48d27 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:42:00 user nova-compute[75247]: WARNING nova.compute.manager [req-37cd5ff3-f7c0-4a33-b139-69baa641bbf5 req-c989b0e2-f114-46cd-a4ba-05ec0ce44731 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received unexpected event network-vif-plugged-ce9cf139-5123-474a-b4ea-0880d5b48d27 for instance with vm_state building and task_state spawning.
Dec 06 12:42:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:00 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:42:00 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:42:00 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:42:00 user nova-compute[75247]: DEBUG nova.compute.manager [req-3ca87378-3c74-4038-96e0-7003e35b674b req-c2f9a770-e854-44e0-97c3-770453acb370 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-plugged-650ff76d-5da3-40b6-a2f7-3c9bcfa49a51 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ca87378-3c74-4038-96e0-7003e35b674b req-c2f9a770-e854-44e0-97c3-770453acb370 service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ca87378-3c74-4038-96e0-7003e35b674b req-c2f9a770-e854-44e0-97c3-770453acb370 service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ca87378-3c74-4038-96e0-7003e35b674b req-c2f9a770-e854-44e0-97c3-770453acb370 service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:00 user nova-compute[75247]: DEBUG nova.compute.manager [req-3ca87378-3c74-4038-96e0-7003e35b674b req-c2f9a770-e854-44e0-97c3-770453acb370 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-plugged-650ff76d-5da3-40b6-a2f7-3c9bcfa49a51 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:42:00 user nova-compute[75247]: WARNING nova.compute.manager [req-3ca87378-3c74-4038-96e0-7003e35b674b req-c2f9a770-e854-44e0-97c3-770453acb370 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received unexpected event network-vif-plugged-650ff76d-5da3-40b6-a2f7-3c9bcfa49a51 for instance with vm_state building and task_state spawning.
Dec 06 12:42:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:01 user nova-compute[75247]: DEBUG nova.compute.manager [req-16a1a10e-c0b2-4a4f-91f9-a07e7767cd91 req-2068f8b3-e270-46a1-89e4-21c5be53bb77 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-plugged-3d9b37b6-a28d-4028-ac06-9cd7685d403f {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-16a1a10e-c0b2-4a4f-91f9-a07e7767cd91 req-2068f8b3-e270-46a1-89e4-21c5be53bb77 service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-16a1a10e-c0b2-4a4f-91f9-a07e7767cd91 req-2068f8b3-e270-46a1-89e4-21c5be53bb77 service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-16a1a10e-c0b2-4a4f-91f9-a07e7767cd91 req-2068f8b3-e270-46a1-89e4-21c5be53bb77 service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:01 user nova-compute[75247]: DEBUG nova.compute.manager [req-16a1a10e-c0b2-4a4f-91f9-a07e7767cd91 req-2068f8b3-e270-46a1-89e4-21c5be53bb77 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-plugged-3d9b37b6-a28d-4028-ac06-9cd7685d403f {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:42:01 user nova-compute[75247]: WARNING nova.compute.manager [req-16a1a10e-c0b2-4a4f-91f9-a07e7767cd91 req-2068f8b3-e270-46a1-89e4-21c5be53bb77 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received unexpected event network-vif-plugged-3d9b37b6-a28d-4028-ac06-9cd7685d403f for instance with vm_state building and task_state spawning.
Dec 06 12:42:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:01 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:42:01 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 12:42:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-70c4664e-ae7a-47de-bba7-18300391d209" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-70c4664e-ae7a-47de-bba7-18300391d209" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG nova.compute.manager [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-plugged-ce9cf139-5123-474a-b4ea-0880d5b48d27 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG nova.compute.manager [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-plugged-ce9cf139-5123-474a-b4ea-0880d5b48d27 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:42:02 user nova-compute[75247]: WARNING nova.compute.manager [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received unexpected event network-vif-plugged-ce9cf139-5123-474a-b4ea-0880d5b48d27 for instance with vm_state building and task_state spawning.
Dec 06 12:42:02 user nova-compute[75247]: DEBUG nova.compute.manager [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-plugged-a20eb2f0-1219-4738-9733-7bf8618ac75d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG nova.compute.manager [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-plugged-a20eb2f0-1219-4738-9733-7bf8618ac75d {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:42:02 user nova-compute[75247]: WARNING nova.compute.manager [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received unexpected event network-vif-plugged-a20eb2f0-1219-4738-9733-7bf8618ac75d for instance with vm_state building and task_state spawning.
Dec 06 12:42:02 user nova-compute[75247]: DEBUG nova.compute.manager [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-plugged-a20eb2f0-1219-4738-9733-7bf8618ac75d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG nova.compute.manager [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-plugged-a20eb2f0-1219-4738-9733-7bf8618ac75d {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:42:02 user nova-compute[75247]: WARNING nova.compute.manager [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received unexpected event network-vif-plugged-a20eb2f0-1219-4738-9733-7bf8618ac75d for instance with vm_state building and task_state spawning.
Dec 06 12:42:02 user nova-compute[75247]: DEBUG nova.compute.manager [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-plugged-f9384778-27c0-459c-90f1-512f3f1bbda5 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG nova.compute.manager [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-plugged-f9384778-27c0-459c-90f1-512f3f1bbda5 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:42:02 user nova-compute[75247]: WARNING nova.compute.manager [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received unexpected event network-vif-plugged-f9384778-27c0-459c-90f1-512f3f1bbda5 for instance with vm_state building and task_state spawning.
Dec 06 12:42:02 user nova-compute[75247]: DEBUG nova.compute.manager [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-plugged-f9384778-27c0-459c-90f1-512f3f1bbda5 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG nova.compute.manager [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-plugged-f9384778-27c0-459c-90f1-512f3f1bbda5 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:42:02 user nova-compute[75247]: WARNING nova.compute.manager [req-67afbc39-c29a-4896-8094-219ff23aa3df req-6a1249e3-0162-4c5d-b0ba-14d4228b18ae service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received unexpected event network-vif-plugged-f9384778-27c0-459c-90f1-512f3f1bbda5 for instance with vm_state building and task_state spawning.
Dec 06 12:42:02 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Updating instance_info_cache with network_info: [{"id": "4f46192c-414a-4af4-b5de-5bd99d31d1fe", "address": "fa:16:3e:b5:83:aa", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f46192c-41", "ovs_interfaceid": "4f46192c-414a-4af4-b5de-5bd99d31d1fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-70c4664e-ae7a-47de-bba7-18300391d209" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-06696ffb-fafc-4ff8-9f2e-80bdda96c708 req-b3bf6281-b820-4900-90d3-5986baf73c90 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-plugged-650ff76d-5da3-40b6-a2f7-3c9bcfa49a51 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-06696ffb-fafc-4ff8-9f2e-80bdda96c708 req-b3bf6281-b820-4900-90d3-5986baf73c90 service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-06696ffb-fafc-4ff8-9f2e-80bdda96c708 req-b3bf6281-b820-4900-90d3-5986baf73c90 service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-06696ffb-fafc-4ff8-9f2e-80bdda96c708 req-b3bf6281-b820-4900-90d3-5986baf73c90 service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-06696ffb-fafc-4ff8-9f2e-80bdda96c708 req-b3bf6281-b820-4900-90d3-5986baf73c90 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-plugged-650ff76d-5da3-40b6-a2f7-3c9bcfa49a51 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:42:03 user nova-compute[75247]: WARNING nova.compute.manager [req-06696ffb-fafc-4ff8-9f2e-80bdda96c708 req-b3bf6281-b820-4900-90d3-5986baf73c90 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received unexpected event network-vif-plugged-650ff76d-5da3-40b6-a2f7-3c9bcfa49a51 for instance with vm_state building and task_state spawning.
Dec 06 12:42:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-06696ffb-fafc-4ff8-9f2e-80bdda96c708 req-b3bf6281-b820-4900-90d3-5986baf73c90 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-plugged-7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-06696ffb-fafc-4ff8-9f2e-80bdda96c708 req-b3bf6281-b820-4900-90d3-5986baf73c90 service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-06696ffb-fafc-4ff8-9f2e-80bdda96c708 req-b3bf6281-b820-4900-90d3-5986baf73c90 service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-06696ffb-fafc-4ff8-9f2e-80bdda96c708 req-b3bf6281-b820-4900-90d3-5986baf73c90 service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-06696ffb-fafc-4ff8-9f2e-80bdda96c708 req-b3bf6281-b820-4900-90d3-5986baf73c90 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-plugged-7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:42:03 user nova-compute[75247]: WARNING nova.compute.manager [req-06696ffb-fafc-4ff8-9f2e-80bdda96c708 req-b3bf6281-b820-4900-90d3-5986baf73c90 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received unexpected event network-vif-plugged-7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6 for instance with vm_state building and task_state spawning.
Dec 06 12:42:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-06696ffb-fafc-4ff8-9f2e-80bdda96c708 req-b3bf6281-b820-4900-90d3-5986baf73c90 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-plugged-7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-06696ffb-fafc-4ff8-9f2e-80bdda96c708 req-b3bf6281-b820-4900-90d3-5986baf73c90 service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-06696ffb-fafc-4ff8-9f2e-80bdda96c708 req-b3bf6281-b820-4900-90d3-5986baf73c90 service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-06696ffb-fafc-4ff8-9f2e-80bdda96c708 req-b3bf6281-b820-4900-90d3-5986baf73c90 service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-06696ffb-fafc-4ff8-9f2e-80bdda96c708 req-b3bf6281-b820-4900-90d3-5986baf73c90 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-plugged-7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:42:03 user nova-compute[75247]: WARNING nova.compute.manager [req-06696ffb-fafc-4ff8-9f2e-80bdda96c708 req-b3bf6281-b820-4900-90d3-5986baf73c90 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received unexpected event network-vif-plugged-7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6 for instance with vm_state building and task_state spawning.
Dec 06 12:42:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-d6e83625-0329-440c-a8bf-757aef97837c req-0e8115d4-ba24-47cc-a30f-81667abc67b8 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-plugged-3d9b37b6-a28d-4028-ac06-9cd7685d403f {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d6e83625-0329-440c-a8bf-757aef97837c req-0e8115d4-ba24-47cc-a30f-81667abc67b8 service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d6e83625-0329-440c-a8bf-757aef97837c req-0e8115d4-ba24-47cc-a30f-81667abc67b8 service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d6e83625-0329-440c-a8bf-757aef97837c req-0e8115d4-ba24-47cc-a30f-81667abc67b8 service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-d6e83625-0329-440c-a8bf-757aef97837c req-0e8115d4-ba24-47cc-a30f-81667abc67b8 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-plugged-3d9b37b6-a28d-4028-ac06-9cd7685d403f {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:42:03 user nova-compute[75247]: WARNING nova.compute.manager [req-d6e83625-0329-440c-a8bf-757aef97837c req-0e8115d4-ba24-47cc-a30f-81667abc67b8 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received unexpected event network-vif-plugged-3d9b37b6-a28d-4028-ac06-9cd7685d403f for instance with vm_state building and task_state spawning.
Dec 06 12:42:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:03 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG nova.compute.manager [None req-19862853-f1c6-47e0-948c-eb4819210fbf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:04 user nova-compute[75247]: INFO nova.compute.manager [None req-19862853-f1c6-47e0-948c-eb4819210fbf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] instance snapshotting
Dec 06 12:42:04 user nova-compute[75247]: DEBUG nova.compute.manager [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:42:04 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Instance spawned successfully.
Dec 06 12:42:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:42:04 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-19862853-f1c6-47e0-948c-eb4819210fbf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Beginning live snapshot process
Dec 06 12:42:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG nova.compute.manager [req-14eebe9e-26d5-4157-b748-c6775d3e3a2a req-3505d3d7-7ff5-4376-a20e-607cfa0a980d service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-plugged-0b94c5e7-0a3d-43d9-9c8a-35badae08754 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-14eebe9e-26d5-4157-b748-c6775d3e3a2a req-3505d3d7-7ff5-4376-a20e-607cfa0a980d service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-14eebe9e-26d5-4157-b748-c6775d3e3a2a req-3505d3d7-7ff5-4376-a20e-607cfa0a980d service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-14eebe9e-26d5-4157-b748-c6775d3e3a2a req-3505d3d7-7ff5-4376-a20e-607cfa0a980d service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG nova.compute.manager [req-14eebe9e-26d5-4157-b748-c6775d3e3a2a req-3505d3d7-7ff5-4376-a20e-607cfa0a980d service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-plugged-0b94c5e7-0a3d-43d9-9c8a-35badae08754 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:42:04 user nova-compute[75247]: WARNING nova.compute.manager [req-14eebe9e-26d5-4157-b748-c6775d3e3a2a req-3505d3d7-7ff5-4376-a20e-607cfa0a980d service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received unexpected event network-vif-plugged-0b94c5e7-0a3d-43d9-9c8a-35badae08754 for instance with vm_state building and task_state spawning.
Dec 06 12:42:04 user nova-compute[75247]: DEBUG nova.compute.manager [req-14eebe9e-26d5-4157-b748-c6775d3e3a2a req-3505d3d7-7ff5-4376-a20e-607cfa0a980d service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-plugged-0b94c5e7-0a3d-43d9-9c8a-35badae08754 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-14eebe9e-26d5-4157-b748-c6775d3e3a2a req-3505d3d7-7ff5-4376-a20e-607cfa0a980d service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-14eebe9e-26d5-4157-b748-c6775d3e3a2a req-3505d3d7-7ff5-4376-a20e-607cfa0a980d service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-14eebe9e-26d5-4157-b748-c6775d3e3a2a req-3505d3d7-7ff5-4376-a20e-607cfa0a980d service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG nova.compute.manager [req-14eebe9e-26d5-4157-b748-c6775d3e3a2a req-3505d3d7-7ff5-4376-a20e-607cfa0a980d service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-plugged-0b94c5e7-0a3d-43d9-9c8a-35badae08754 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:42:04 user nova-compute[75247]: WARNING nova.compute.manager [req-14eebe9e-26d5-4157-b748-c6775d3e3a2a req-3505d3d7-7ff5-4376-a20e-607cfa0a980d service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received unexpected event network-vif-plugged-0b94c5e7-0a3d-43d9-9c8a-35badae08754 for instance with vm_state building and task_state spawning.
Dec 06 12:42:04 user nova-compute[75247]: INFO nova.compute.manager [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Took 10.88 seconds to spawn the instance on the hypervisor.
Dec 06 12:42:04 user nova-compute[75247]: DEBUG nova.compute.manager [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:04 user nova-compute[75247]: INFO nova.compute.manager [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Took 41.60 seconds to build instance.
Dec 06 12:42:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-19862853-f1c6-47e0-948c-eb4819210fbf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json -f qcow2 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-61d1d1dd-d63e-4ba4-a8c1-2f8b6a1a8f37 tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.749s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-19862853-f1c6-47e0-948c-eb4819210fbf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-19862853-f1c6-47e0-948c-eb4819210fbf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json -f qcow2 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-19862853-f1c6-47e0-948c-eb4819210fbf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-19862853-f1c6-47e0-948c-eb4819210fbf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-19862853-f1c6-47e0-948c-eb4819210fbf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.177s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-19862853-f1c6-47e0-948c-eb4819210fbf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4xto00q2/85ea67784a9c450baec7051f55495e88.delta 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-19862853-f1c6-47e0-948c-eb4819210fbf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4xto00q2/85ea67784a9c450baec7051f55495e88.delta 1073741824" returned: 0 in 0.047s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:05 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-19862853-f1c6-47e0-948c-eb4819210fbf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 06 12:42:05 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-19862853-f1c6-47e0-948c-eb4819210fbf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75247) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Dec 06 12:42:05 user nova-compute[75247]: INFO nova.virt.libvirt.host [None req-19862853-f1c6-47e0-948c-eb4819210fbf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] UEFI support detected
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Acquiring lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG nova.objects.instance [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lazy-loading 'flavor' on Instance uuid 0a07dcbb-573e-4835-a4d2-3cae1d3446e3 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.112s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Acquiring lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:05 user nova-compute[75247]: INFO nova.compute.manager [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Attaching volume 82497ed2-1d4b-41db-85b3-c29f7d23e1f4 to /dev/vdb
Dec 06 12:42:05 user nova-compute[75247]: DEBUG os_brick.utils [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14d5f65-c692-4ac1-af51-9359c5b13385]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[964e954f-6eef-44c6-bdf6-16085b0b121d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f489ad4-0588-472d-9583-ffc00606d55c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dbd885-ccfa-4145-aa3c-ab742576489b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:42:05 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[930d2b27-9843-4ec1-884d-320e4b4bbb7d]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG os_brick.utils [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Updating existing volume attachment record: 87874d8c-2266-4715-8481-26b326e58573 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:42:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-19862853-f1c6-47e0-948c-eb4819210fbf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] COPY block job progress, current cursor: 262144 final cursor: 75497472 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 12:42:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-19862853-f1c6-47e0-948c-eb4819210fbf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 12:42:06 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-19862853-f1c6-47e0-948c-eb4819210fbf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 06 12:42:06 user nova-compute[75247]: DEBUG nova.privsep.utils [None req-19862853-f1c6-47e0-948c-eb4819210fbf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 12:42:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-19862853-f1c6-47e0-948c-eb4819210fbf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4xto00q2/85ea67784a9c450baec7051f55495e88.delta /opt/stack/data/nova/instances/snapshots/tmp4xto00q2/85ea67784a9c450baec7051f55495e88 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12f40dad-65dc-4281-aa53-6036aa7e26d9/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-19862853-f1c6-47e0-948c-eb4819210fbf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4xto00q2/85ea67784a9c450baec7051f55495e88.delta /opt/stack/data/nova/instances/snapshots/tmp4xto00q2/85ea67784a9c450baec7051f55495e88" returned: 0 in 0.512s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:07 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-19862853-f1c6-47e0-948c-eb4819210fbf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Snapshot extracted, beginning image upload
Dec 06 12:42:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12f40dad-65dc-4281-aa53-6036aa7e26d9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12f40dad-65dc-4281-aa53-6036aa7e26d9/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12f40dad-65dc-4281-aa53-6036aa7e26d9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:42:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a07dcbb-573e-4835-a4d2-3cae1d3446e3/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a07dcbb-573e-4835-a4d2-3cae1d3446e3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a07dcbb-573e-4835-a4d2-3cae1d3446e3/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a07dcbb-573e-4835-a4d2-3cae1d3446e3/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:42:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:42:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:42:09 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:42:09 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:42:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=6824MB free_disk=25.448997497558594GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 12:42:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 0a07dcbb-573e-4835-a4d2-3cae1d3446e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:42:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 70c4664e-ae7a-47de-bba7-18300391d209 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:42:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 782289e2-91cd-4aee-9a08-eadfb2a5965b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:42:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:42:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 4531bf11-b948-4d57-bf55-f33563815e26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:42:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance ec9eea5d-dc9a-4a65-881a-a89538e3a593 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:42:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance f0e26668-e253-409a-a011-a54e8ad3ebb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:42:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance dbb64a66-f500-407b-ae92-80f27eb6ce2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:42:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance f2e75618-9164-4527-a6a3-5f5195effccf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:42:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 12f40dad-65dc-4281-aa53-6036aa7e26d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:42:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance ed721541-3a94-496f-8b9d-88c74ac83ef7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:42:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 51c56231-9ff5-45a6-ad38-e7ac68124ed4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:42:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 12:42:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 12:42:09 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:42:09 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:42:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 12:42:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.740s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-4dc869f3-d67b-45d6-9b5f-61764c79a2aa req-3896e98f-817c-468d-8ed8-6d68728add9d service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received event network-changed-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-4dc869f3-d67b-45d6-9b5f-61764c79a2aa req-3896e98f-817c-468d-8ed8-6d68728add9d service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Refreshing instance network info cache due to event network-changed-b7c5418b-5afb-45b5-af6c-c46f82ef72cc. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:42:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4dc869f3-d67b-45d6-9b5f-61764c79a2aa req-3896e98f-817c-468d-8ed8-6d68728add9d service nova] Acquiring lock "refresh_cache-a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:42:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4dc869f3-d67b-45d6-9b5f-61764c79a2aa req-3896e98f-817c-468d-8ed8-6d68728add9d service nova] Acquired lock "refresh_cache-a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:42:10 user nova-compute[75247]: DEBUG nova.network.neutron [req-4dc869f3-d67b-45d6-9b5f-61764c79a2aa req-3896e98f-817c-468d-8ed8-6d68728add9d service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Refreshing network info cache for port b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:42:10 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-19862853-f1c6-47e0-948c-eb4819210fbf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Snapshot image upload complete
Dec 06 12:42:10 user nova-compute[75247]: INFO nova.compute.manager [None req-19862853-f1c6-47e0-948c-eb4819210fbf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Took 6.67 seconds to snapshot the instance on the hypervisor.
Dec 06 12:42:10 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:42:11 user nova-compute[75247]: DEBUG nova.compute.manager [req-3b319199-0e65-48f5-b529-2ebd1a9c5fdc req-7d30c24a-89e2-4be5-904d-089a7643b1ba service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Received event network-changed-b924c627-a11e-4fc4-8e23-d1a974c4de3d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:11 user nova-compute[75247]: DEBUG nova.compute.manager [req-3b319199-0e65-48f5-b529-2ebd1a9c5fdc req-7d30c24a-89e2-4be5-904d-089a7643b1ba service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Refreshing instance network info cache due to event network-changed-b924c627-a11e-4fc4-8e23-d1a974c4de3d. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:42:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3b319199-0e65-48f5-b529-2ebd1a9c5fdc req-7d30c24a-89e2-4be5-904d-089a7643b1ba service nova] Acquiring lock "refresh_cache-782289e2-91cd-4aee-9a08-eadfb2a5965b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:42:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3b319199-0e65-48f5-b529-2ebd1a9c5fdc req-7d30c24a-89e2-4be5-904d-089a7643b1ba service nova] Acquired lock "refresh_cache-782289e2-91cd-4aee-9a08-eadfb2a5965b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:42:11 user nova-compute[75247]: DEBUG nova.network.neutron [req-3b319199-0e65-48f5-b529-2ebd1a9c5fdc req-7d30c24a-89e2-4be5-904d-089a7643b1ba service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Refreshing network info cache for port b924c627-a11e-4fc4-8e23-d1a974c4de3d {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:42:12 user nova-compute[75247]: DEBUG nova.network.neutron [req-4dc869f3-d67b-45d6-9b5f-61764c79a2aa req-3896e98f-817c-468d-8ed8-6d68728add9d service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Updated VIF entry in instance network info cache for port b7c5418b-5afb-45b5-af6c-c46f82ef72cc. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:42:12 user nova-compute[75247]: DEBUG nova.network.neutron [req-4dc869f3-d67b-45d6-9b5f-61764c79a2aa req-3896e98f-817c-468d-8ed8-6d68728add9d service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Updating instance_info_cache with network_info: [{"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:42:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4dc869f3-d67b-45d6-9b5f-61764c79a2aa req-3896e98f-817c-468d-8ed8-6d68728add9d service nova] Releasing lock "refresh_cache-a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:42:12 user nova-compute[75247]: DEBUG nova.network.neutron [req-3b319199-0e65-48f5-b529-2ebd1a9c5fdc req-7d30c24a-89e2-4be5-904d-089a7643b1ba service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Updated VIF entry in instance network info cache for port b924c627-a11e-4fc4-8e23-d1a974c4de3d. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:42:12 user nova-compute[75247]: DEBUG nova.network.neutron [req-3b319199-0e65-48f5-b529-2ebd1a9c5fdc req-7d30c24a-89e2-4be5-904d-089a7643b1ba service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Updating instance_info_cache with network_info: [{"id": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "address": "fa:16:3e:e4:cb:02", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924c627-a1", "ovs_interfaceid": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:42:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3b319199-0e65-48f5-b529-2ebd1a9c5fdc req-7d30c24a-89e2-4be5-904d-089a7643b1ba service nova] Releasing lock "refresh_cache-782289e2-91cd-4aee-9a08-eadfb2a5965b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:42:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-3f7095b8-3c02-45e8-8b5d-bd0cf120453c req-aa972b48-360d-41c8-b893-4a7228992586 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received event network-changed-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-3f7095b8-3c02-45e8-8b5d-bd0cf120453c req-aa972b48-360d-41c8-b893-4a7228992586 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Refreshing instance network info cache due to event network-changed-348d8e54-a814-4893-8636-de9e795794a2. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:42:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3f7095b8-3c02-45e8-8b5d-bd0cf120453c req-aa972b48-360d-41c8-b893-4a7228992586 service nova] Acquiring lock "refresh_cache-4531bf11-b948-4d57-bf55-f33563815e26" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:42:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3f7095b8-3c02-45e8-8b5d-bd0cf120453c req-aa972b48-360d-41c8-b893-4a7228992586 service nova] Acquired lock "refresh_cache-4531bf11-b948-4d57-bf55-f33563815e26" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:42:13 user nova-compute[75247]: DEBUG nova.network.neutron [req-3f7095b8-3c02-45e8-8b5d-bd0cf120453c req-aa972b48-360d-41c8-b893-4a7228992586 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Refreshing network info cache for port 348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:42:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:42:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-c3f3fb8d-7667-45e0-a547-ae52a04918fb req-4805b75b-5110-43cb-879f-e97dd798669f service nova] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Received event network-changed-a205065f-e23d-46b2-9f34-f77ff2b3ebb1 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-c3f3fb8d-7667-45e0-a547-ae52a04918fb req-4805b75b-5110-43cb-879f-e97dd798669f service nova] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Refreshing instance network info cache due to event network-changed-a205065f-e23d-46b2-9f34-f77ff2b3ebb1. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:42:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c3f3fb8d-7667-45e0-a547-ae52a04918fb req-4805b75b-5110-43cb-879f-e97dd798669f service nova] Acquiring lock "refresh_cache-ec9eea5d-dc9a-4a65-881a-a89538e3a593" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:42:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c3f3fb8d-7667-45e0-a547-ae52a04918fb req-4805b75b-5110-43cb-879f-e97dd798669f service nova] Acquired lock "refresh_cache-ec9eea5d-dc9a-4a65-881a-a89538e3a593" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:42:13 user nova-compute[75247]: DEBUG nova.network.neutron [req-c3f3fb8d-7667-45e0-a547-ae52a04918fb req-4805b75b-5110-43cb-879f-e97dd798669f service nova] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Refreshing network info cache for port a205065f-e23d-46b2-9f34-f77ff2b3ebb1 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:42:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:13 user nova-compute[75247]: DEBUG nova.objects.instance [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'flavor' on Instance uuid a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:42:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:13 user nova-compute[75247]: INFO nova.compute.manager [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Attaching volume cc33ee51-434a-4506-8266-17b7b706f482 to /dev/vdb
Dec 06 12:42:14 user nova-compute[75247]: DEBUG os_brick.utils [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:42:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:14 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bf4c6b-0a54-458f-9607-82dc1d94a5eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:14 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[26074c78-c981-4b44-bb31-32844ecdcf19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:14 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded742ba-8142-4d64-a590-3d74a79bead5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:14 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb2d5c7-33b5-475f-adf8-965b45b04074]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:42:14 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:42:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:42:14 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:42:14 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[814dcd53-7cec-498a-8154-d7ded69d9b35]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:14 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:42:14 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:42:14 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:42:14 user nova-compute[75247]: DEBUG os_brick.utils [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:42:14 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Updating existing volume attachment record: bc3fc00b-1541-462f-a44f-0af5ba7bd48a {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:42:14 user nova-compute[75247]: DEBUG nova.network.neutron [req-3f7095b8-3c02-45e8-8b5d-bd0cf120453c req-aa972b48-360d-41c8-b893-4a7228992586 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Updated VIF entry in instance network info cache for port 348d8e54-a814-4893-8636-de9e795794a2. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:42:14 user nova-compute[75247]: DEBUG nova.network.neutron [req-3f7095b8-3c02-45e8-8b5d-bd0cf120453c req-aa972b48-360d-41c8-b893-4a7228992586 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Updating instance_info_cache with network_info: [{"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:42:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3f7095b8-3c02-45e8-8b5d-bd0cf120453c req-aa972b48-360d-41c8-b893-4a7228992586 service nova] Releasing lock "refresh_cache-4531bf11-b948-4d57-bf55-f33563815e26" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:42:14 user nova-compute[75247]: DEBUG nova.network.neutron [req-c3f3fb8d-7667-45e0-a547-ae52a04918fb req-4805b75b-5110-43cb-879f-e97dd798669f service nova] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Updated VIF entry in instance network info cache for port a205065f-e23d-46b2-9f34-f77ff2b3ebb1. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:42:14 user nova-compute[75247]: DEBUG nova.network.neutron [req-c3f3fb8d-7667-45e0-a547-ae52a04918fb req-4805b75b-5110-43cb-879f-e97dd798669f service nova] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Updating instance_info_cache with network_info: [{"id": "a205065f-e23d-46b2-9f34-f77ff2b3ebb1", "address": "fa:16:3e:6b:3a:c0", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa205065f-e2", "ovs_interfaceid": "a205065f-e23d-46b2-9f34-f77ff2b3ebb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:42:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c3f3fb8d-7667-45e0-a547-ae52a04918fb req-4805b75b-5110-43cb-879f-e97dd798669f service nova] Releasing lock "refresh_cache-ec9eea5d-dc9a-4a65-881a-a89538e3a593" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:42:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:16 user nova-compute[75247]: DEBUG nova.objects.instance [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lazy-loading 'flavor' on Instance uuid ec9eea5d-dc9a-4a65-881a-a89538e3a593 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:42:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:16 user nova-compute[75247]: INFO nova.compute.manager [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Attaching volume f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 to /dev/vdb
Dec 06 12:42:16 user nova-compute[75247]: DEBUG os_brick.utils [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:42:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e283c6-e40d-4f54-9e57-43b627279ed2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e504d1b-8b44-43c7-a9f6-8f1910e9a20b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd29547-f20d-42f6-b174-872214cb6cda]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9efc70-2999-4c06-bd7a-740fdfce2aa5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:42:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:42:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:42:17 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:42:17 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[23529228-e478-4834-8f31-ebf4840863c5]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:17 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:42:17 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:42:17 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:42:17 user nova-compute[75247]: DEBUG os_brick.utils [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] <== get_connector_properties: return (277ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:42:17 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Updating existing volume attachment record: 41ea59d3-68c7-4d36-9746-239080dea93e {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:42:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScqRAIom', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:42:27 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:42:27 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:42:27 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0886edff-79a8-40a5-8985-6b8af58da0ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:42:27 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31bd4ca-b70b-4327-b42a-884ca2eb4aa5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496] added
Dec 06 12:42:27 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b7788e-1222-4e70-ba25-30091791ddb9]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7cd376-58fa-46d4-b9b6-a5ec6c2b8c32]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ScqRAIom {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ScqRAIom" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[56945e82-ea6e-4801-8fd6-56499cb41c99]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ScqRAIom'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2cd3e5-a026-4c0b-ba3b-97fbc32cb0c5]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecca850-181c-49eb-a823-bbe668fc1184]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:27 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:27 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:27 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:27 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:27 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:27 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:27 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:27 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd59de0-9a67-4070-b88c-66746fc09e62]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496, portal: 172.16.0.220,3260]
Dec 06 12:42:27 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496, portal: 172.16.0.220,3260] successful.
Dec 06 12:42:27 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1432f9-92d7-423f-82c2-8725603c6623]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[729bfe7d-e2b2-42bb-b19a-6288dc9f0432]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:27 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:27 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:27 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:27 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:27 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:27 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:27 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:27 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:27 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:27 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.425s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EaWFkAXr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:42:27 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b50304-65bc-4dec-8d37-ffb42ccd035c]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScqRAIom', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vtTPyWGA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:42:27 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:42:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.458s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] <== connect_volume: return (1460ms) {'type': 'block', 'scsi_wwn': '26239333131636661', 'path': '/dev/sdf'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239333131636661', 'path': '/dev/sdf'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.023s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:42:28 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:42:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:42:28 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:42:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG nova.objects.instance [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lazy-loading 'flavor' on Instance uuid ec9eea5d-dc9a-4a65-881a-a89538e3a593 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[76da11d2-780a-437e-8758-333c67f25155]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:42:28 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 12:42:28 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:42:28 user nova-compute[75247]:   <source dev="/dev/sdf"/>
Dec 06 12:42:28 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:42:28 user nova-compute[75247]:   <serial>f8aa1a77-9f7a-4984-bf5e-2a6d45b35496</serial>
Dec 06 12:42:28 user nova-compute[75247]: </disk>
Dec 06 12:42:28 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[55527588-1386-44c9-b946-adfaefaf2a31]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4] added
Dec 06 12:42:28 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6261785-4d91-4ca9-8c83-a867acf36053]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dba96d-21c7-441e-8145-02bb0072fbb3]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EaWFkAXr {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EaWFkAXr" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abcb15f-b337-40c3-8ee5-a06ecff33fa8]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EaWFkAXr'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7474f1-7a53-4851-8e24-45ea043139e7]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dde7000-7a5a-4ec6-a734-070ad1421a86]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:29 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:29 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:29 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:29 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:29 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:29 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:29 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:29 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:29 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:29 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5ecf43-7970-4623-a5d8-7544594ad580]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4, portal: 172.16.0.220,3260]
Dec 06 12:42:29 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4, portal: 172.16.0.220,3260] successful.
Dec 06 12:42:29 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0538dfed-7394-4db4-a334-0bc0f5280b41]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bfa547-48fa-435c-854d-4799da5f9b0f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:29 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:29 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:29 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:29 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:29 user nova-compute[75247]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 (non-flash)
Dec 06 12:42:29 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:29 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:29 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:29 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:29 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:29 user nova-compute[75247]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 (non-flash)
Dec 06 12:42:29 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5adfa9-aa19-4560-8170-1c5faee35496]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EaWFkAXr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] No VIF found with MAC fa:16:3e:6b:3a:c0, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:42:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-96cb6d55-2e72-44de-bcd7-44921d91dd3d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.864s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] <== connect_volume: return (2349ms) {'type': 'block', 'scsi_wwn': '23864356565383865', 'path': '/dev/sdg'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864356565383865', 'path': '/dev/sdg'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.263s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:42:30 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:42:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:42:30 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG nova.objects.instance [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lazy-loading 'flavor' on Instance uuid 0a07dcbb-573e-4835-a4d2-3cae1d3446e3 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e881d83-0f88-4bef-b278-a5ccfcbdd390]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:42:30 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b41cb3b-f029-4600-93b7-939a0f0325bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482] added
Dec 06 12:42:30 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 12:42:30 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:42:30 user nova-compute[75247]:   <source dev="/dev/sdg"/>
Dec 06 12:42:30 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:42:30 user nova-compute[75247]:   <serial>82497ed2-1d4b-41db-85b3-c29f7d23e1f4</serial>
Dec 06 12:42:30 user nova-compute[75247]: </disk>
Dec 06 12:42:30 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c874c1ce-ccbc-47ad-86da-c38ab89f9045]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f6c861-5162-4b84-afdf-0770a4eea731]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vtTPyWGA {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vtTPyWGA" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f3e286-085b-4e48-8510-918b61e7aed3]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vtTPyWGA'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaee1214-dd7d-4b3d-aa38-e466a4a74a16]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e71e554-bc05-4744-9149-a450a06e3bec]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:30 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:30 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:30 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:30 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:30 user nova-compute[75247]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 (non-flash)
Dec 06 12:42:30 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:30 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:30 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:30 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:30 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:30 user nova-compute[75247]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 (non-flash)
Dec 06 12:42:30 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[479006f5-0d75-4304-a17f-6f0a51527809]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482, portal: 172.16.0.220,3260]
Dec 06 12:42:30 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482, portal: 172.16.0.220,3260] successful.
Dec 06 12:42:30 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9463219-a083-4982-840e-a3ab5230194d]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bde79c5-baf8-4cac-9bce-61043f09ac52]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:30 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:30 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:30 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:30 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:30 user nova-compute[75247]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 (non-flash)
Dec 06 12:42:30 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:42:30 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:30 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:30 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:30 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:30 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:30 user nova-compute[75247]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 (non-flash)
Dec 06 12:42:30 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:42:30 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4052f7-20ac-4ea7-b0d5-e9870e9f2b6a]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vtTPyWGA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] No VIF found with MAC fa:16:3e:77:4d:71, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0c84c36a-ccad-4d65-989f-da6b78780f5d tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.199s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG nova.compute.manager [req-ad74d60e-6f60-49f4-b267-0b77ea0075ae req-9cf64231-f84c-4535-9d4a-c42bfbaca606 service nova] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Received event network-changed-7ec9c7ac-57f1-42a5-b2ff-df899a930efd {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG nova.compute.manager [req-ad74d60e-6f60-49f4-b267-0b77ea0075ae req-9cf64231-f84c-4535-9d4a-c42bfbaca606 service nova] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Refreshing instance network info cache due to event network-changed-7ec9c7ac-57f1-42a5-b2ff-df899a930efd. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ad74d60e-6f60-49f4-b267-0b77ea0075ae req-9cf64231-f84c-4535-9d4a-c42bfbaca606 service nova] Acquiring lock "refresh_cache-f0e26668-e253-409a-a011-a54e8ad3ebb7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ad74d60e-6f60-49f4-b267-0b77ea0075ae req-9cf64231-f84c-4535-9d4a-c42bfbaca606 service nova] Acquired lock "refresh_cache-f0e26668-e253-409a-a011-a54e8ad3ebb7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:42:30 user nova-compute[75247]: DEBUG nova.network.neutron [req-ad74d60e-6f60-49f4-b267-0b77ea0075ae req-9cf64231-f84c-4535-9d4a-c42bfbaca606 service nova] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Refreshing network info cache for port 7ec9c7ac-57f1-42a5-b2ff-df899a930efd {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:42:31 user nova-compute[75247]: DEBUG nova.network.neutron [req-ad74d60e-6f60-49f4-b267-0b77ea0075ae req-9cf64231-f84c-4535-9d4a-c42bfbaca606 service nova] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Updated VIF entry in instance network info cache for port 7ec9c7ac-57f1-42a5-b2ff-df899a930efd. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:42:31 user nova-compute[75247]: DEBUG nova.network.neutron [req-ad74d60e-6f60-49f4-b267-0b77ea0075ae req-9cf64231-f84c-4535-9d4a-c42bfbaca606 service nova] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Updating instance_info_cache with network_info: [{"id": "7ec9c7ac-57f1-42a5-b2ff-df899a930efd", "address": "fa:16:3e:ae:36:46", "network": {"id": "a3353b80-0ced-43e4-8cea-c98cd7d8c132", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638714784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ed07eb8a8d4dfe9ba6bd8af697f1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ec9c7ac-57", "ovs_interfaceid": "7ec9c7ac-57f1-42a5-b2ff-df899a930efd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:42:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ad74d60e-6f60-49f4-b267-0b77ea0075ae req-9cf64231-f84c-4535-9d4a-c42bfbaca606 service nova] Releasing lock "refresh_cache-f0e26668-e253-409a-a011-a54e8ad3ebb7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:42:31 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:42:31 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] <== connect_volume: return (3618ms) {'type': 'block', 'scsi_wwn': '23763626533373635', 'path': '/dev/sdh'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:42:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763626533373635', 'path': '/dev/sdh'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:42:31 user nova-compute[75247]: DEBUG nova.objects.instance [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'flavor' on Instance uuid a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:42:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 12:42:31 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:42:31 user nova-compute[75247]:   <source dev="/dev/sdh"/>
Dec 06 12:42:31 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:42:31 user nova-compute[75247]:   <serial>cc33ee51-434a-4506-8266-17b7b706f482</serial>
Dec 06 12:42:31 user nova-compute[75247]: </disk>
Dec 06 12:42:31 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Acquiring lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Acquiring lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:32 user nova-compute[75247]: INFO nova.compute.manager [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Terminating instance
Dec 06 12:42:32 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] No VIF found with MAC fa:16:3e:ae:2f:c5, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-259af182-3a6d-42ba-b882-da67334e10e0 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.346s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "940d69a3-4737-4e84-b077-fe2eff86753f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "940d69a3-4737-4e84-b077-fe2eff86753f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG nova.compute.manager [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-0e2c8c7f-cf2c-4ac8-a256-084012424acf req-7d130955-0f18-4e8b-9cfa-a7013de78da6 service nova] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Received event network-vif-unplugged-2c3b146f-74ce-47d5-9bca-54c20e685cdb {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0e2c8c7f-cf2c-4ac8-a256-084012424acf req-7d130955-0f18-4e8b-9cfa-a7013de78da6 service nova] Acquiring lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0e2c8c7f-cf2c-4ac8-a256-084012424acf req-7d130955-0f18-4e8b-9cfa-a7013de78da6 service nova] Lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0e2c8c7f-cf2c-4ac8-a256-084012424acf req-7d130955-0f18-4e8b-9cfa-a7013de78da6 service nova] Lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-0e2c8c7f-cf2c-4ac8-a256-084012424acf req-7d130955-0f18-4e8b-9cfa-a7013de78da6 service nova] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] No waiting events found dispatching network-vif-unplugged-2c3b146f-74ce-47d5-9bca-54c20e685cdb {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-0e2c8c7f-cf2c-4ac8-a256-084012424acf req-7d130955-0f18-4e8b-9cfa-a7013de78da6 service nova] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Received event network-vif-unplugged-2c3b146f-74ce-47d5-9bca-54c20e685cdb for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:42:32 user nova-compute[75247]: INFO nova.compute.claims [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Claim successful on node user
Dec 06 12:42:32 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Instance destroyed successfully.
Dec 06 12:42:32 user nova-compute[75247]: DEBUG nova.objects.instance [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lazy-loading 'resources' on Instance uuid 0a07dcbb-573e-4835-a4d2-3cae1d3446e3 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1358724081',display_name='tempest-DeleteServersTestJSON-server-1358724081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1358724081',id=1,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:40:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66ddbb56f5d94b0cb91768e9c9a7aa62',ramdisk_id='',reservation_id='r-rgzmc3il',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-2009001202',owner_user_name='tempest-DeleteServersTestJSON-2009001202-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:40:28Z,user_data=None,user_id='93fbc9a260f8468291684e31046c74c4',uuid=0a07dcbb-573e-4835-a4d2-3cae1d3446e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c3b146f-74ce-47d5-9bca-54c20e685cdb", "address": "fa:16:3e:77:4d:71", "network": {"id": "b814ddee-1e11-441b-aa6f-c96e6aae965e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-831812673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ddbb56f5d94b0cb91768e9c9a7aa62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c3b146f-74", "ovs_interfaceid": "2c3b146f-74ce-47d5-9bca-54c20e685cdb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Converting VIF {"id": "2c3b146f-74ce-47d5-9bca-54c20e685cdb", "address": "fa:16:3e:77:4d:71", "network": {"id": "b814ddee-1e11-441b-aa6f-c96e6aae965e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-831812673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ddbb56f5d94b0cb91768e9c9a7aa62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c3b146f-74", "ovs_interfaceid": "2c3b146f-74ce-47d5-9bca-54c20e685cdb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:4d:71,bridge_name='br-int',has_traffic_filtering=True,id=2c3b146f-74ce-47d5-9bca-54c20e685cdb,network=Network(b814ddee-1e11-441b-aa6f-c96e6aae965e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c3b146f-74') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG os_vif [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:4d:71,bridge_name='br-int',has_traffic_filtering=True,id=2c3b146f-74ce-47d5-9bca-54c20e685cdb,network=Network(b814ddee-1e11-441b-aa6f-c96e6aae965e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c3b146f-74') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c3b146f-74, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6913ffd-6d5b-4dc1-90ef-9771fd98a384) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:42:32 user nova-compute[75247]: INFO os_vif [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:4d:71,bridge_name='br-int',has_traffic_filtering=True,id=2c3b146f-74ce-47d5-9bca-54c20e685cdb,network=Network(b814ddee-1e11-441b-aa6f-c96e6aae965e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c3b146f-74')
Dec 06 12:42:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EaWFkAXr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:42:32 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:42:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd333343-0b82-422d-bf0e-099a514a49ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:42:32 user nova-compute[75247]: No targets found.
Dec 06 12:42:32 user nova-compute[75247]: iSNS:
Dec 06 12:42:32 user nova-compute[75247]: No targets found.
Dec 06 12:42:32 user nova-compute[75247]: STATIC:
Dec 06 12:42:32 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8
Dec 06 12:42:32 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:42:32 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:42:32 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496
Dec 06 12:42:32 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:42:32 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:42:32 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4
Dec 06 12:42:32 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:42:32 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:42:32 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0
Dec 06 12:42:32 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:42:32 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:42:32 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c
Dec 06 12:42:32 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:42:32 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:42:32 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4
Dec 06 12:42:32 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:42:32 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:42:32 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482
Dec 06 12:42:32 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:42:32 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:42:32 user nova-compute[75247]: FIRMWARE:
Dec 06 12:42:32 user nova-compute[75247]: No targets found.
Dec 06 12:42:32 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:42:32 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:42:32 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d344909-252f-48da-a5a8-41af662cc049]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8539d9-3d6e-4ae6-b57b-768861eb2480]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:32 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:32 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:32 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:32 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:32 user nova-compute[75247]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 (non-flash)
Dec 06 12:42:32 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:42:32 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:32 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:32 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:32 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:32 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:32 user nova-compute[75247]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 (non-flash)
Dec 06 12:42:32 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:42:32 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd740277250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4'): ({'sdg'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Removing single pathed devices sdg {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a391f11-bf0a-4251-8634-34398d9aa455]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.581s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG nova.compute.manager [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.028s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fe3f19-7e3b-4516-a8a5-6260264279d3]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Flushing IO for device /dev/sdg {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b7d988-ceec-4d1e-ba03-905efeb5f6b2]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.076s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[671147a0-b975-4fe8-9da8-3f9b1fe22a93]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] SCSI volumes sdg have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f3d913-d433-488e-8d09-27f5737f1f17]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-022a20ad-8676-45d1-9ded-e895a7526e9e tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-022a20ad-8676-45d1-9ded-e895a7526e9e tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG nova.compute.manager [None req-022a20ad-8676-45d1-9ded-e895a7526e9e tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG nova.compute.manager [None req-022a20ad-8676-45d1-9ded-e895a7526e9e tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75247) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG nova.objects.instance [None req-022a20ad-8676-45d1-9ded-e895a7526e9e tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'flavor' on Instance uuid a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG nova.compute.manager [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG nova.network.neutron [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:42:33 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:42:33 user nova-compute[75247]: DEBUG nova.compute.manager [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.100s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[45eb8670-7584-4a5c-8f4f-2aa70cdd1077]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4, portal: 172.16.0.220,3260]
Dec 06 12:42:33 user nova-compute[75247]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4, portal: 172.16.0.220,3260] successful.
Dec 06 12:42:33 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82497ed2-1d4b-41db-85b3-c29f7d23e1f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d6d5c5-cc3e-445b-85bf-366fc1a9db5b]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.436s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] <== disconnect_volume: return (437ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:42:33 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Deleting instance files /opt/stack/data/nova/instances/0a07dcbb-573e-4835-a4d2-3cae1d3446e3_del
Dec 06 12:42:33 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Deletion of /opt/stack/data/nova/instances/0a07dcbb-573e-4835-a4d2-3cae1d3446e3_del complete
Dec 06 12:42:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG nova.policy [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d7becd4d5734bc2b652e6f37492eb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6b077946334f1c8fd16d091a7738e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:33 user nova-compute[75247]: INFO nova.compute.manager [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Took 1.37 seconds to destroy the instance on the hypervisor.
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG nova.compute.manager [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:42:33 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Creating image(s)
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "/opt/stack/data/nova/instances/940d69a3-4737-4e84-b077-fe2eff86753f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "/opt/stack/data/nova/instances/940d69a3-4737-4e84-b077-fe2eff86753f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "/opt/stack/data/nova/instances/940d69a3-4737-4e84-b077-fe2eff86753f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.175s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Acquiring lock "f0e26668-e253-409a-a011-a54e8ad3ebb7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "f0e26668-e253-409a-a011-a54e8ad3ebb7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG nova.objects.instance [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lazy-loading 'flavor' on Instance uuid f0e26668-e253-409a-a011-a54e8ad3ebb7 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG nova.compute.manager [req-45bdf766-9a5a-40f3-b034-4577cc24c16b req-bec8d5fa-1741-4c6d-bf47-a211d4bef72f service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received event network-vif-unplugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-45bdf766-9a5a-40f3-b034-4577cc24c16b req-bec8d5fa-1741-4c6d-bf47-a211d4bef72f service nova] Acquiring lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-45bdf766-9a5a-40f3-b034-4577cc24c16b req-bec8d5fa-1741-4c6d-bf47-a211d4bef72f service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-45bdf766-9a5a-40f3-b034-4577cc24c16b req-bec8d5fa-1741-4c6d-bf47-a211d4bef72f service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG nova.compute.manager [req-45bdf766-9a5a-40f3-b034-4577cc24c16b req-bec8d5fa-1741-4c6d-bf47-a211d4bef72f service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] No waiting events found dispatching network-vif-unplugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:42:33 user nova-compute[75247]: WARNING nova.compute.manager [req-45bdf766-9a5a-40f3-b034-4577cc24c16b req-bec8d5fa-1741-4c6d-bf47-a211d4bef72f service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received unexpected event network-vif-unplugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc for instance with vm_state active and task_state powering-off.
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.184s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/940d69a3-4737-4e84-b077-fe2eff86753f/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "f0e26668-e253-409a-a011-a54e8ad3ebb7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.131s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/940d69a3-4737-4e84-b077-fe2eff86753f/disk 1073741824" returned: 0 in 0.049s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:33 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Instance destroyed successfully.
Dec 06 12:42:33 user nova-compute[75247]: DEBUG nova.compute.manager [None req-022a20ad-8676-45d1-9ded-e895a7526e9e tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Acquiring lock "f0e26668-e253-409a-a011-a54e8ad3ebb7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "f0e26668-e253-409a-a011-a54e8ad3ebb7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:34 user nova-compute[75247]: INFO nova.compute.manager [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Attaching volume 52f821cf-60c8-442a-aebe-b44741fb151e to /dev/sdc
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.207s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Checking if we can resize image /opt/stack/data/nova/instances/940d69a3-4737-4e84-b077-fe2eff86753f/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940d69a3-4737-4e84-b077-fe2eff86753f/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-022a20ad-8676-45d1-9ded-e895a7526e9e tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.920s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Acquiring lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG os_brick.utils [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG nova.objects.instance [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lazy-loading 'flavor' on Instance uuid dbb64a66-f500-407b-ae92-80f27eb6ce2e {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a734d6ce-1363-47a1-9873-3b758c9764e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f05c42-6a24-4b81-890d-e95bec343a9b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c42864a-32a0-4e72-aa10-fcee0986a1bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc60c9e-8dd2-49ca-8b8a-e724eb43194a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940d69a3-4737-4e84-b077-fe2eff86753f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Cannot resize image /opt/stack/data/nova/instances/940d69a3-4737-4e84-b077-fe2eff86753f/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Ensure instance console log exists: /opt/stack/data/nova/instances/940d69a3-4737-4e84-b077-fe2eff86753f/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:42:34 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecb9259-353f-4bf7-ac5d-c957fc686837]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG os_brick.utils [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Updating existing volume attachment record: 06c64fef-b6b4-4573-8fb8-7e1b5aa66830 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Acquiring lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:34 user nova-compute[75247]: INFO nova.compute.manager [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Attaching volume 82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 to /dev/vdb
Dec 06 12:42:34 user nova-compute[75247]: DEBUG nova.compute.manager [req-b485790d-646d-4432-bbf5-486d86dd9dc5 req-36758631-7c62-40ba-84dc-8586e70556f9 service nova] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Received event network-vif-plugged-2c3b146f-74ce-47d5-9bca-54c20e685cdb {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b485790d-646d-4432-bbf5-486d86dd9dc5 req-36758631-7c62-40ba-84dc-8586e70556f9 service nova] Acquiring lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b485790d-646d-4432-bbf5-486d86dd9dc5 req-36758631-7c62-40ba-84dc-8586e70556f9 service nova] Lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b485790d-646d-4432-bbf5-486d86dd9dc5 req-36758631-7c62-40ba-84dc-8586e70556f9 service nova] Lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG nova.compute.manager [req-b485790d-646d-4432-bbf5-486d86dd9dc5 req-36758631-7c62-40ba-84dc-8586e70556f9 service nova] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] No waiting events found dispatching network-vif-plugged-2c3b146f-74ce-47d5-9bca-54c20e685cdb {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:42:34 user nova-compute[75247]: WARNING nova.compute.manager [req-b485790d-646d-4432-bbf5-486d86dd9dc5 req-36758631-7c62-40ba-84dc-8586e70556f9 service nova] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Received unexpected event network-vif-plugged-2c3b146f-74ce-47d5-9bca-54c20e685cdb for instance with vm_state active and task_state deleting.
Dec 06 12:42:34 user nova-compute[75247]: DEBUG os_brick.utils [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d86939-f803-40b6-a1ba-3762822d9366]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc45afc-a840-43ae-b705-2bb28fff0034]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ebeb42-c1bc-4e09-9b70-197cbb773dd9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d93d504-b799-42cc-bd4e-f2a717cb068a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:42:34 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:42:34 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cfa14a-41c3-4fe9-af17-637eae616efb]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG os_brick.utils [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Updating existing volume attachment record: 5180d4a3-2c7f-4a89-9e64-c01ab63a12db {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:42:34 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:42:34 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Took 1.23 seconds to deallocate network for instance.
Dec 06 12:42:34 user nova-compute[75247]: DEBUG nova.network.neutron [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Successfully created port: 8e6e824b-bb71-493a-ac2d-b45b1a95fd69 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.network.neutron [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Successfully updated port: 8e6e824b-bb71-493a-ac2d-b45b1a95fd69 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "refresh_cache-940d69a3-4737-4e84-b077-fe2eff86753f" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquired lock "refresh_cache-940d69a3-4737-4e84-b077-fe2eff86753f" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.network.neutron [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.network.neutron [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:42:35 user nova-compute[75247]: INFO nova.compute.manager [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Took 0.84 seconds to detach 1 volumes for instance.
Dec 06 12:42:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.network.neutron [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Updating instance_info_cache with network_info: [{"id": "8e6e824b-bb71-493a-ac2d-b45b1a95fd69", "address": "fa:16:3e:ec:cd:d2", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e6e824b-bb", "ovs_interfaceid": "8e6e824b-bb71-493a-ac2d-b45b1a95fd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Releasing lock "refresh_cache-940d69a3-4737-4e84-b077-fe2eff86753f" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.compute.manager [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Instance network_info: |[{"id": "8e6e824b-bb71-493a-ac2d-b45b1a95fd69", "address": "fa:16:3e:ec:cd:d2", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e6e824b-bb", "ovs_interfaceid": "8e6e824b-bb71-493a-ac2d-b45b1a95fd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Start _get_guest_xml network_info=[{"id": "8e6e824b-bb71-493a-ac2d-b45b1a95fd69", "address": "fa:16:3e:ec:cd:d2", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e6e824b-bb", "ovs_interfaceid": "8e6e824b-bb71-493a-ac2d-b45b1a95fd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:42:35 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:42:35 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:42:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1362113558',display_name='tempest-AttachVolumeNegativeTest-server-1362113558',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1362113558',id=13,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3RdpFFkxu/x+zMjteaIxrNkHpxuX7Q9GzuhoK4nRz6goNjP+84mU06vqWICneIeTNu82emf8U1QfBvFHNjI+yyjhQhFpaTAkNxYcNl7FeRuduoxMHLfzJa+kgpLFD5lQ==',key_name='tempest-keypair-1259610535',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a6b077946334f1c8fd16d091a7738e1',ramdisk_id='',reservation_id='r-wkyi0913',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2136789566',owner_user_name='tempest-AttachVolumeNegativeTest-2136789566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:42:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d7becd4d5734bc2b652e6f37492eb5e',uuid=940d69a3-4737-4e84-b077-fe2eff86753f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e6e824b-bb71-493a-ac2d-b45b1a95fd69", "address": "fa:16:3e:ec:cd:d2", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e6e824b-bb", "ovs_interfaceid": "8e6e824b-bb71-493a-ac2d-b45b1a95fd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Converting VIF {"id": "8e6e824b-bb71-493a-ac2d-b45b1a95fd69", "address": "fa:16:3e:ec:cd:d2", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e6e824b-bb", "ovs_interfaceid": "8e6e824b-bb71-493a-ac2d-b45b1a95fd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:cd:d2,bridge_name='br-int',has_traffic_filtering=True,id=8e6e824b-bb71-493a-ac2d-b45b1a95fd69,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e6e824b-bb') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.objects.instance [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lazy-loading 'pci_devices' on Instance uuid 940d69a3-4737-4e84-b077-fe2eff86753f {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.compute.manager [req-02e7a1d8-df28-4775-b4e9-f6e7a22f147f req-3b414635-3df7-4db3-8a46-12d15ad2c663 service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Received event network-changed-ee42c358-3097-4050-a477-8a48b500de81 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.compute.manager [req-02e7a1d8-df28-4775-b4e9-f6e7a22f147f req-3b414635-3df7-4db3-8a46-12d15ad2c663 service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Refreshing instance network info cache due to event network-changed-ee42c358-3097-4050-a477-8a48b500de81. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-02e7a1d8-df28-4775-b4e9-f6e7a22f147f req-3b414635-3df7-4db3-8a46-12d15ad2c663 service nova] Acquiring lock "refresh_cache-dbb64a66-f500-407b-ae92-80f27eb6ce2e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-02e7a1d8-df28-4775-b4e9-f6e7a22f147f req-3b414635-3df7-4db3-8a46-12d15ad2c663 service nova] Acquired lock "refresh_cache-dbb64a66-f500-407b-ae92-80f27eb6ce2e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.network.neutron [req-02e7a1d8-df28-4775-b4e9-f6e7a22f147f req-3b414635-3df7-4db3-8a46-12d15ad2c663 service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Refreshing network info cache for port ee42c358-3097-4050-a477-8a48b500de81 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:42:35 user nova-compute[75247]:   <uuid>940d69a3-4737-4e84-b077-fe2eff86753f</uuid>
Dec 06 12:42:35 user nova-compute[75247]:   <name>instance-0000000d</name>
Dec 06 12:42:35 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:42:35 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:42:35 user nova-compute[75247]:   <metadata>
Dec 06 12:42:35 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:42:35 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:42:35 user nova-compute[75247]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1362113558</nova:name>
Dec 06 12:42:35 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:42:35</nova:creationTime>
Dec 06 12:42:35 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:42:35 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:42:35 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:42:35 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:42:35 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:42:35 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:42:35 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:42:35 user nova-compute[75247]:       <nova:owner>
Dec 06 12:42:35 user nova-compute[75247]:         <nova:user uuid="9d7becd4d5734bc2b652e6f37492eb5e">tempest-AttachVolumeNegativeTest-2136789566-project-member</nova:user>
Dec 06 12:42:35 user nova-compute[75247]:         <nova:project uuid="6a6b077946334f1c8fd16d091a7738e1">tempest-AttachVolumeNegativeTest-2136789566</nova:project>
Dec 06 12:42:35 user nova-compute[75247]:       </nova:owner>
Dec 06 12:42:35 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:42:35 user nova-compute[75247]:       <nova:ports>
Dec 06 12:42:35 user nova-compute[75247]:         <nova:port uuid="8e6e824b-bb71-493a-ac2d-b45b1a95fd69">
Dec 06 12:42:35 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 06 12:42:35 user nova-compute[75247]:         </nova:port>
Dec 06 12:42:35 user nova-compute[75247]:       </nova:ports>
Dec 06 12:42:35 user nova-compute[75247]:     </nova:instance>
Dec 06 12:42:35 user nova-compute[75247]:   </metadata>
Dec 06 12:42:35 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:42:35 user nova-compute[75247]:     <system>
Dec 06 12:42:35 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:42:35 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:42:35 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:42:35 user nova-compute[75247]:       <entry name="serial">940d69a3-4737-4e84-b077-fe2eff86753f</entry>
Dec 06 12:42:35 user nova-compute[75247]:       <entry name="uuid">940d69a3-4737-4e84-b077-fe2eff86753f</entry>
Dec 06 12:42:35 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:42:35 user nova-compute[75247]:     </system>
Dec 06 12:42:35 user nova-compute[75247]:   </sysinfo>
Dec 06 12:42:35 user nova-compute[75247]:   <os>
Dec 06 12:42:35 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:42:35 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:42:35 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:42:35 user nova-compute[75247]:   </os>
Dec 06 12:42:35 user nova-compute[75247]:   <features>
Dec 06 12:42:35 user nova-compute[75247]:     <acpi/>
Dec 06 12:42:35 user nova-compute[75247]:     <apic/>
Dec 06 12:42:35 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:42:35 user nova-compute[75247]:   </features>
Dec 06 12:42:35 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:42:35 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:42:35 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:42:35 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:42:35 user nova-compute[75247]:   </clock>
Dec 06 12:42:35 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:42:35 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:42:35 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:42:35 user nova-compute[75247]:   </cpu>
Dec 06 12:42:35 user nova-compute[75247]:   <devices>
Dec 06 12:42:35 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:42:35 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:42:35 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/940d69a3-4737-4e84-b077-fe2eff86753f/disk"/>
Dec 06 12:42:35 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:42:35 user nova-compute[75247]:     </disk>
Dec 06 12:42:35 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:42:35 user nova-compute[75247]:       <mac address="fa:16:3e:ec:cd:d2"/>
Dec 06 12:42:35 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:42:35 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:42:35 user nova-compute[75247]:       <target dev="tap8e6e824b-bb"/>
Dec 06 12:42:35 user nova-compute[75247]:     </interface>
Dec 06 12:42:35 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:42:35 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/940d69a3-4737-4e84-b077-fe2eff86753f/console.log" append="off"/>
Dec 06 12:42:35 user nova-compute[75247]:     </serial>
Dec 06 12:42:35 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:42:35 user nova-compute[75247]:     <video>
Dec 06 12:42:35 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:42:35 user nova-compute[75247]:     </video>
Dec 06 12:42:35 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:42:35 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:42:35 user nova-compute[75247]:     </rng>
Dec 06 12:42:35 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:42:35 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:42:35 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:42:35 user nova-compute[75247]:     </memballoon>
Dec 06 12:42:35 user nova-compute[75247]:   </devices>
Dec 06 12:42:35 user nova-compute[75247]: </domain>
Dec 06 12:42:35 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:42:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1362113558',display_name='tempest-AttachVolumeNegativeTest-server-1362113558',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1362113558',id=13,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3RdpFFkxu/x+zMjteaIxrNkHpxuX7Q9GzuhoK4nRz6goNjP+84mU06vqWICneIeTNu82emf8U1QfBvFHNjI+yyjhQhFpaTAkNxYcNl7FeRuduoxMHLfzJa+kgpLFD5lQ==',key_name='tempest-keypair-1259610535',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a6b077946334f1c8fd16d091a7738e1',ramdisk_id='',reservation_id='r-wkyi0913',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2136789566',owner_user_name='tempest-AttachVolumeNegativeTest-2136789566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:42:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d7becd4d5734bc2b652e6f37492eb5e',uuid=940d69a3-4737-4e84-b077-fe2eff86753f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e6e824b-bb71-493a-ac2d-b45b1a95fd69", "address": "fa:16:3e:ec:cd:d2", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e6e824b-bb", "ovs_interfaceid": "8e6e824b-bb71-493a-ac2d-b45b1a95fd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Converting VIF {"id": "8e6e824b-bb71-493a-ac2d-b45b1a95fd69", "address": "fa:16:3e:ec:cd:d2", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e6e824b-bb", "ovs_interfaceid": "8e6e824b-bb71-493a-ac2d-b45b1a95fd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:cd:d2,bridge_name='br-int',has_traffic_filtering=True,id=8e6e824b-bb71-493a-ac2d-b45b1a95fd69,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e6e824b-bb') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG os_vif [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:cd:d2,bridge_name='br-int',has_traffic_filtering=True,id=8e6e824b-bb71-493a-ac2d-b45b1a95fd69,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e6e824b-bb') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5a16792a-a6e7-5e04-bb79-fbebd654df2c', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e6e824b-bb, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e6e824b-bb, col_values=(('qos', UUID('fa4d21ff-9e9b-402b-83da-9b801beb983e')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e6e824b-bb, col_values=(('external_ids', {'iface-id': '8e6e824b-bb71-493a-ac2d-b45b1a95fd69', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:cd:d2', 'vm-uuid': '940d69a3-4737-4e84-b077-fe2eff86753f'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:35 user nova-compute[75247]: INFO os_vif [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:cd:d2,bridge_name='br-int',has_traffic_filtering=True,id=8e6e824b-bb71-493a-ac2d-b45b1a95fd69,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e6e824b-bb')
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] No VIF found with MAC fa:16:3e:ec:cd:d2, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:42:35 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:42:36 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:42:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.505s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:36 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Deleted allocations for instance 0a07dcbb-573e-4835-a4d2-3cae1d3446e3
Dec 06 12:42:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e5dbe5d3-8975-486d-9a07-a8088d981078 tempest-DeleteServersTestJSON-2009001202 tempest-DeleteServersTestJSON-2009001202-project-member] Lock "0a07dcbb-573e-4835-a4d2-3cae1d3446e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.198s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:36 user nova-compute[75247]: DEBUG nova.network.neutron [req-02e7a1d8-df28-4775-b4e9-f6e7a22f147f req-3b414635-3df7-4db3-8a46-12d15ad2c663 service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Updated VIF entry in instance network info cache for port ee42c358-3097-4050-a477-8a48b500de81. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:42:36 user nova-compute[75247]: DEBUG nova.network.neutron [req-02e7a1d8-df28-4775-b4e9-f6e7a22f147f req-3b414635-3df7-4db3-8a46-12d15ad2c663 service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Updating instance_info_cache with network_info: [{"id": "ee42c358-3097-4050-a477-8a48b500de81", "address": "fa:16:3e:fd:3e:cc", "network": {"id": "003dc158-ddf8-48e4-9fa4-d9fa5f102273", "bridge": "br-int", "label": "tempest-TestVolumeSwap-823652334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09aa091fb4534e24b685fec6e6ca52e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee42c358-30", "ovs_interfaceid": "ee42c358-3097-4050-a477-8a48b500de81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:42:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-02e7a1d8-df28-4775-b4e9-f6e7a22f147f req-3b414635-3df7-4db3-8a46-12d15ad2c663 service nova] Releasing lock "refresh_cache-dbb64a66-f500-407b-ae92-80f27eb6ce2e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:42:36 user nova-compute[75247]: DEBUG nova.compute.manager [req-02e7a1d8-df28-4775-b4e9-f6e7a22f147f req-3b414635-3df7-4db3-8a46-12d15ad2c663 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received event network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-02e7a1d8-df28-4775-b4e9-f6e7a22f147f req-3b414635-3df7-4db3-8a46-12d15ad2c663 service nova] Acquiring lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-02e7a1d8-df28-4775-b4e9-f6e7a22f147f req-3b414635-3df7-4db3-8a46-12d15ad2c663 service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-02e7a1d8-df28-4775-b4e9-f6e7a22f147f req-3b414635-3df7-4db3-8a46-12d15ad2c663 service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:36 user nova-compute[75247]: DEBUG nova.compute.manager [req-02e7a1d8-df28-4775-b4e9-f6e7a22f147f req-3b414635-3df7-4db3-8a46-12d15ad2c663 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] No waiting events found dispatching network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:42:36 user nova-compute[75247]: WARNING nova.compute.manager [req-02e7a1d8-df28-4775-b4e9-f6e7a22f147f req-3b414635-3df7-4db3-8a46-12d15ad2c663 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received unexpected event network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc for instance with vm_state stopped and task_state None.
Dec 06 12:42:36 user nova-compute[75247]: DEBUG nova.compute.manager [req-79ab102b-c64f-4dea-a70a-6c0da26bc375 req-be1ebd4f-e110-4aa1-b084-e7e70eafeee3 service nova] [instance: 0a07dcbb-573e-4835-a4d2-3cae1d3446e3] Received event network-vif-deleted-2c3b146f-74ce-47d5-9bca-54c20e685cdb {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:36 user nova-compute[75247]: DEBUG nova.compute.manager [req-79ab102b-c64f-4dea-a70a-6c0da26bc375 req-be1ebd4f-e110-4aa1-b084-e7e70eafeee3 service nova] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Received event network-changed-8e6e824b-bb71-493a-ac2d-b45b1a95fd69 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:36 user nova-compute[75247]: DEBUG nova.compute.manager [req-79ab102b-c64f-4dea-a70a-6c0da26bc375 req-be1ebd4f-e110-4aa1-b084-e7e70eafeee3 service nova] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Refreshing instance network info cache due to event network-changed-8e6e824b-bb71-493a-ac2d-b45b1a95fd69. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:42:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-79ab102b-c64f-4dea-a70a-6c0da26bc375 req-be1ebd4f-e110-4aa1-b084-e7e70eafeee3 service nova] Acquiring lock "refresh_cache-940d69a3-4737-4e84-b077-fe2eff86753f" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:42:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-79ab102b-c64f-4dea-a70a-6c0da26bc375 req-be1ebd4f-e110-4aa1-b084-e7e70eafeee3 service nova] Acquired lock "refresh_cache-940d69a3-4737-4e84-b077-fe2eff86753f" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:42:36 user nova-compute[75247]: DEBUG nova.network.neutron [req-79ab102b-c64f-4dea-a70a-6c0da26bc375 req-be1ebd4f-e110-4aa1-b084-e7e70eafeee3 service nova] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Refreshing network info cache for port 8e6e824b-bb71-493a-ac2d-b45b1a95fd69 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:42:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Acquiring lock "interface-f2e75618-9164-4527-a6a3-5f5195effccf-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "interface-f2e75618-9164-4527-a6a3-5f5195effccf-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:36 user nova-compute[75247]: DEBUG nova.objects.instance [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lazy-loading 'flavor' on Instance uuid f2e75618-9164-4527-a6a3-5f5195effccf {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:42:36 user nova-compute[75247]: DEBUG nova.network.neutron [req-79ab102b-c64f-4dea-a70a-6c0da26bc375 req-be1ebd4f-e110-4aa1-b084-e7e70eafeee3 service nova] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Updated VIF entry in instance network info cache for port 8e6e824b-bb71-493a-ac2d-b45b1a95fd69. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:42:36 user nova-compute[75247]: DEBUG nova.network.neutron [req-79ab102b-c64f-4dea-a70a-6c0da26bc375 req-be1ebd4f-e110-4aa1-b084-e7e70eafeee3 service nova] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Updating instance_info_cache with network_info: [{"id": "8e6e824b-bb71-493a-ac2d-b45b1a95fd69", "address": "fa:16:3e:ec:cd:d2", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e6e824b-bb", "ovs_interfaceid": "8e6e824b-bb71-493a-ac2d-b45b1a95fd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:42:36 user nova-compute[75247]: DEBUG nova.objects.instance [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lazy-loading 'pci_requests' on Instance uuid f2e75618-9164-4527-a6a3-5f5195effccf {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:42:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-79ab102b-c64f-4dea-a70a-6c0da26bc375 req-be1ebd4f-e110-4aa1-b084-e7e70eafeee3 service nova] Releasing lock "refresh_cache-940d69a3-4737-4e84-b077-fe2eff86753f" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:42:36 user nova-compute[75247]: DEBUG nova.objects.base [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Object Instance<f2e75618-9164-4527-a6a3-5f5195effccf> lazy-loaded attributes: flavor,pci_requests {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:42:36 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:42:37 user nova-compute[75247]: DEBUG nova.policy [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14563ea794be4e5bb54c7b4cabde8ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4031371ec46d42c2bd887bac7edf42a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:42:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:37 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Successfully created port: 4b46350b-531d-4f9c-89eb-1ebab7067497 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:42:37 user nova-compute[75247]: DEBUG nova.compute.manager [req-1b2634a7-6ddb-4848-bb92-1ea944440522 req-63a5fec5-3609-4e41-aef4-fd83a61d4116 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Received event network-changed-68ab6435-5cd9-45bf-891c-c20b68415e11 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:37 user nova-compute[75247]: DEBUG nova.compute.manager [req-1b2634a7-6ddb-4848-bb92-1ea944440522 req-63a5fec5-3609-4e41-aef4-fd83a61d4116 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Refreshing instance network info cache due to event network-changed-68ab6435-5cd9-45bf-891c-c20b68415e11. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:42:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1b2634a7-6ddb-4848-bb92-1ea944440522 req-63a5fec5-3609-4e41-aef4-fd83a61d4116 service nova] Acquiring lock "refresh_cache-f2e75618-9164-4527-a6a3-5f5195effccf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:42:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1b2634a7-6ddb-4848-bb92-1ea944440522 req-63a5fec5-3609-4e41-aef4-fd83a61d4116 service nova] Acquired lock "refresh_cache-f2e75618-9164-4527-a6a3-5f5195effccf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:42:37 user nova-compute[75247]: DEBUG nova.network.neutron [req-1b2634a7-6ddb-4848-bb92-1ea944440522 req-63a5fec5-3609-4e41-aef4-fd83a61d4116 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Refreshing network info cache for port 68ab6435-5cd9-45bf-891c-c20b68415e11 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:42:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:38 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Successfully updated port: 4b46350b-531d-4f9c-89eb-1ebab7067497 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:42:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Acquiring lock "refresh_cache-f2e75618-9164-4527-a6a3-5f5195effccf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:42:38 user nova-compute[75247]: DEBUG nova.network.neutron [req-1b2634a7-6ddb-4848-bb92-1ea944440522 req-63a5fec5-3609-4e41-aef4-fd83a61d4116 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Updated VIF entry in instance network info cache for port 68ab6435-5cd9-45bf-891c-c20b68415e11. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:42:38 user nova-compute[75247]: DEBUG nova.network.neutron [req-1b2634a7-6ddb-4848-bb92-1ea944440522 req-63a5fec5-3609-4e41-aef4-fd83a61d4116 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Updating instance_info_cache with network_info: [{"id": "68ab6435-5cd9-45bf-891c-c20b68415e11", "address": "fa:16:3e:b0:12:84", "network": {"id": "c5765401-4948-42dc-bfce-fe0e5ebf3a42", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-751579203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ab6435-5c", "ovs_interfaceid": "68ab6435-5cd9-45bf-891c-c20b68415e11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:42:38 user nova-compute[75247]: DEBUG nova.compute.manager [req-68abd3bb-faf2-4d8b-8178-3014323a7ab3 req-213a6461-df16-4890-bc3f-c7903a3f44ef service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Received event network-changed-4b46350b-531d-4f9c-89eb-1ebab7067497 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:38 user nova-compute[75247]: DEBUG nova.compute.manager [req-68abd3bb-faf2-4d8b-8178-3014323a7ab3 req-213a6461-df16-4890-bc3f-c7903a3f44ef service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Refreshing instance network info cache due to event network-changed-4b46350b-531d-4f9c-89eb-1ebab7067497. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:42:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-68abd3bb-faf2-4d8b-8178-3014323a7ab3 req-213a6461-df16-4890-bc3f-c7903a3f44ef service nova] Acquiring lock "refresh_cache-f2e75618-9164-4527-a6a3-5f5195effccf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:42:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1b2634a7-6ddb-4848-bb92-1ea944440522 req-63a5fec5-3609-4e41-aef4-fd83a61d4116 service nova] Releasing lock "refresh_cache-f2e75618-9164-4527-a6a3-5f5195effccf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:42:38 user nova-compute[75247]: DEBUG nova.compute.manager [req-1b2634a7-6ddb-4848-bb92-1ea944440522 req-63a5fec5-3609-4e41-aef4-fd83a61d4116 service nova] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Received event network-vif-plugged-8e6e824b-bb71-493a-ac2d-b45b1a95fd69 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1b2634a7-6ddb-4848-bb92-1ea944440522 req-63a5fec5-3609-4e41-aef4-fd83a61d4116 service nova] Acquiring lock "940d69a3-4737-4e84-b077-fe2eff86753f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1b2634a7-6ddb-4848-bb92-1ea944440522 req-63a5fec5-3609-4e41-aef4-fd83a61d4116 service nova] Lock "940d69a3-4737-4e84-b077-fe2eff86753f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1b2634a7-6ddb-4848-bb92-1ea944440522 req-63a5fec5-3609-4e41-aef4-fd83a61d4116 service nova] Lock "940d69a3-4737-4e84-b077-fe2eff86753f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:38 user nova-compute[75247]: DEBUG nova.compute.manager [req-1b2634a7-6ddb-4848-bb92-1ea944440522 req-63a5fec5-3609-4e41-aef4-fd83a61d4116 service nova] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] No waiting events found dispatching network-vif-plugged-8e6e824b-bb71-493a-ac2d-b45b1a95fd69 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:42:38 user nova-compute[75247]: WARNING nova.compute.manager [req-1b2634a7-6ddb-4848-bb92-1ea944440522 req-63a5fec5-3609-4e41-aef4-fd83a61d4116 service nova] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Received unexpected event network-vif-plugged-8e6e824b-bb71-493a-ac2d-b45b1a95fd69 for instance with vm_state building and task_state spawning.
Dec 06 12:42:38 user nova-compute[75247]: DEBUG nova.compute.manager [req-1b2634a7-6ddb-4848-bb92-1ea944440522 req-63a5fec5-3609-4e41-aef4-fd83a61d4116 service nova] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Received event network-vif-plugged-8e6e824b-bb71-493a-ac2d-b45b1a95fd69 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1b2634a7-6ddb-4848-bb92-1ea944440522 req-63a5fec5-3609-4e41-aef4-fd83a61d4116 service nova] Acquiring lock "940d69a3-4737-4e84-b077-fe2eff86753f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1b2634a7-6ddb-4848-bb92-1ea944440522 req-63a5fec5-3609-4e41-aef4-fd83a61d4116 service nova] Lock "940d69a3-4737-4e84-b077-fe2eff86753f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1b2634a7-6ddb-4848-bb92-1ea944440522 req-63a5fec5-3609-4e41-aef4-fd83a61d4116 service nova] Lock "940d69a3-4737-4e84-b077-fe2eff86753f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:38 user nova-compute[75247]: DEBUG nova.compute.manager [req-1b2634a7-6ddb-4848-bb92-1ea944440522 req-63a5fec5-3609-4e41-aef4-fd83a61d4116 service nova] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] No waiting events found dispatching network-vif-plugged-8e6e824b-bb71-493a-ac2d-b45b1a95fd69 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:42:38 user nova-compute[75247]: WARNING nova.compute.manager [req-1b2634a7-6ddb-4848-bb92-1ea944440522 req-63a5fec5-3609-4e41-aef4-fd83a61d4116 service nova] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Received unexpected event network-vif-plugged-8e6e824b-bb71-493a-ac2d-b45b1a95fd69 for instance with vm_state building and task_state spawning.
Dec 06 12:42:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Acquired lock "refresh_cache-f2e75618-9164-4527-a6a3-5f5195effccf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:42:38 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Updating instance_info_cache with network_info: [{"id": "68ab6435-5cd9-45bf-891c-c20b68415e11", "address": "fa:16:3e:b0:12:84", "network": {"id": "c5765401-4948-42dc-bfce-fe0e5ebf3a42", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-751579203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ab6435-5c", "ovs_interfaceid": "68ab6435-5cd9-45bf-891c-c20b68415e11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b46350b-531d-4f9c-89eb-1ebab7067497", "address": "fa:16:3e:5d:69:9f", "network": {"id": "a51d59c1-8168-46ad-a649-919cd6307bb7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1124351624", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b46350b-53", "ovs_interfaceid": "4b46350b-531d-4f9c-89eb-1ebab7067497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Releasing lock "refresh_cache-f2e75618-9164-4527-a6a3-5f5195effccf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-68abd3bb-faf2-4d8b-8178-3014323a7ab3 req-213a6461-df16-4890-bc3f-c7903a3f44ef service nova] Acquired lock "refresh_cache-f2e75618-9164-4527-a6a3-5f5195effccf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.network.neutron [req-68abd3bb-faf2-4d8b-8178-3014323a7ab3 req-213a6461-df16-4890-bc3f-c7903a3f44ef service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Refreshing network info cache for port 4b46350b-531d-4f9c-89eb-1ebab7067497 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1618747013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1618747013',id=9,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJqUDXevj4gXj7N7wpZj/XCteR5V+dPOM68FsqKu9Fudl378/ktu9MdzbbKdcoiSMygbRXxj+WBcn7A30ZdIiAz+sQjvUKqzGUuXAmht+5SuCJrZIb25AK4InwaKc1iVg==',key_name='tempest-keypair-76799662',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:40:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4031371ec46d42c2bd887bac7edf42a4',ramdisk_id='',reservation_id='r-ouoqw3qc',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1141791142',owner_user_name='tempest-TaggedAttachmentsTest-1141791142-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:40:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14563ea794be4e5bb54c7b4cabde8ee0',uuid=f2e75618-9164-4527-a6a3-5f5195effccf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b46350b-531d-4f9c-89eb-1ebab7067497", "address": "fa:16:3e:5d:69:9f", "network": {"id": "a51d59c1-8168-46ad-a649-919cd6307bb7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1124351624", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b46350b-53", "ovs_interfaceid": "4b46350b-531d-4f9c-89eb-1ebab7067497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Converting VIF {"id": "4b46350b-531d-4f9c-89eb-1ebab7067497", "address": "fa:16:3e:5d:69:9f", "network": {"id": "a51d59c1-8168-46ad-a649-919cd6307bb7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1124351624", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b46350b-53", "ovs_interfaceid": "4b46350b-531d-4f9c-89eb-1ebab7067497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:69:9f,bridge_name='br-int',has_traffic_filtering=True,id=4b46350b-531d-4f9c-89eb-1ebab7067497,network=Network(a51d59c1-8168-46ad-a649-919cd6307bb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b46350b-53') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG os_vif [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:69:9f,bridge_name='br-int',has_traffic_filtering=True,id=4b46350b-531d-4f9c-89eb-1ebab7067497,network=Network(a51d59c1-8168-46ad-a649-919cd6307bb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b46350b-53') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '75f1a9cf-faa0-5882-a171-550f9dccaa1a', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b46350b-53, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b46350b-53, col_values=(('qos', UUID('df318298-7c3e-4149-9c94-eb936bd5a331')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b46350b-53, col_values=(('external_ids', {'iface-id': '4b46350b-531d-4f9c-89eb-1ebab7067497', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:69:9f', 'vm-uuid': 'f2e75618-9164-4527-a6a3-5f5195effccf'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:39 user nova-compute[75247]: INFO os_vif [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:69:9f,bridge_name='br-int',has_traffic_filtering=True,id=4b46350b-531d-4f9c-89eb-1ebab7067497,network=Network(a51d59c1-8168-46ad-a649-919cd6307bb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b46350b-53')
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1618747013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1618747013',id=9,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJqUDXevj4gXj7N7wpZj/XCteR5V+dPOM68FsqKu9Fudl378/ktu9MdzbbKdcoiSMygbRXxj+WBcn7A30ZdIiAz+sQjvUKqzGUuXAmht+5SuCJrZIb25AK4InwaKc1iVg==',key_name='tempest-keypair-76799662',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:40:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4031371ec46d42c2bd887bac7edf42a4',ramdisk_id='',reservation_id='r-ouoqw3qc',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1141791142',owner_user_name='tempest-TaggedAttachmentsTest-1141791142-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:40:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14563ea794be4e5bb54c7b4cabde8ee0',uuid=f2e75618-9164-4527-a6a3-5f5195effccf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b46350b-531d-4f9c-89eb-1ebab7067497", "address": "fa:16:3e:5d:69:9f", "network": {"id": "a51d59c1-8168-46ad-a649-919cd6307bb7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1124351624", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b46350b-53", "ovs_interfaceid": "4b46350b-531d-4f9c-89eb-1ebab7067497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Converting VIF {"id": "4b46350b-531d-4f9c-89eb-1ebab7067497", "address": "fa:16:3e:5d:69:9f", "network": {"id": "a51d59c1-8168-46ad-a649-919cd6307bb7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1124351624", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b46350b-53", "ovs_interfaceid": "4b46350b-531d-4f9c-89eb-1ebab7067497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:69:9f,bridge_name='br-int',has_traffic_filtering=True,id=4b46350b-531d-4f9c-89eb-1ebab7067497,network=Network(a51d59c1-8168-46ad-a649-919cd6307bb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b46350b-53') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] attach device xml: <interface type="ethernet">
Dec 06 12:42:39 user nova-compute[75247]:   <mac address="fa:16:3e:5d:69:9f"/>
Dec 06 12:42:39 user nova-compute[75247]:   <model type="virtio"/>
Dec 06 12:42:39 user nova-compute[75247]:   <mtu size="1442"/>
Dec 06 12:42:39 user nova-compute[75247]:   <target dev="tap4b46350b-53"/>
Dec 06 12:42:39 user nova-compute[75247]: </interface>
Dec 06 12:42:39 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.compute.manager [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:42:39 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Instance spawned successfully.
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] No BDM found with device name hda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] No VIF found with MAC fa:16:3e:b0:12:84, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.network.neutron [req-68abd3bb-faf2-4d8b-8178-3014323a7ab3 req-213a6461-df16-4890-bc3f-c7903a3f44ef service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Updated VIF entry in instance network info cache for port 4b46350b-531d-4f9c-89eb-1ebab7067497. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.network.neutron [req-68abd3bb-faf2-4d8b-8178-3014323a7ab3 req-213a6461-df16-4890-bc3f-c7903a3f44ef service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Updating instance_info_cache with network_info: [{"id": "68ab6435-5cd9-45bf-891c-c20b68415e11", "address": "fa:16:3e:b0:12:84", "network": {"id": "c5765401-4948-42dc-bfce-fe0e5ebf3a42", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-751579203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ab6435-5c", "ovs_interfaceid": "68ab6435-5cd9-45bf-891c-c20b68415e11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b46350b-531d-4f9c-89eb-1ebab7067497", "address": "fa:16:3e:5d:69:9f", "network": {"id": "a51d59c1-8168-46ad-a649-919cd6307bb7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1124351624", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b46350b-53", "ovs_interfaceid": "4b46350b-531d-4f9c-89eb-1ebab7067497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-68abd3bb-faf2-4d8b-8178-3014323a7ab3 req-213a6461-df16-4890-bc3f-c7903a3f44ef service nova] Releasing lock "refresh_cache-f2e75618-9164-4527-a6a3-5f5195effccf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:42:39 user nova-compute[75247]:   <nova:package version="0.0.0"/>
Dec 06 12:42:39 user nova-compute[75247]:   <nova:name>tempest-device-tagging-server-1618747013</nova:name>
Dec 06 12:42:39 user nova-compute[75247]:   <nova:creationTime>2023-12-06 12:42:39</nova:creationTime>
Dec 06 12:42:39 user nova-compute[75247]:   <nova:flavor name="m1.tiny">
Dec 06 12:42:39 user nova-compute[75247]:     <nova:memory>512</nova:memory>
Dec 06 12:42:39 user nova-compute[75247]:     <nova:disk>1</nova:disk>
Dec 06 12:42:39 user nova-compute[75247]:     <nova:swap>0</nova:swap>
Dec 06 12:42:39 user nova-compute[75247]:     <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:42:39 user nova-compute[75247]:     <nova:vcpus>1</nova:vcpus>
Dec 06 12:42:39 user nova-compute[75247]:   </nova:flavor>
Dec 06 12:42:39 user nova-compute[75247]:   <nova:owner>
Dec 06 12:42:39 user nova-compute[75247]:     <nova:user uuid="14563ea794be4e5bb54c7b4cabde8ee0">tempest-TaggedAttachmentsTest-1141791142-project-member</nova:user>
Dec 06 12:42:39 user nova-compute[75247]:     <nova:project uuid="4031371ec46d42c2bd887bac7edf42a4">tempest-TaggedAttachmentsTest-1141791142</nova:project>
Dec 06 12:42:39 user nova-compute[75247]:   </nova:owner>
Dec 06 12:42:39 user nova-compute[75247]:   <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:42:39 user nova-compute[75247]:   <nova:ports>
Dec 06 12:42:39 user nova-compute[75247]:     <nova:port uuid="68ab6435-5cd9-45bf-891c-c20b68415e11">
Dec 06 12:42:39 user nova-compute[75247]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 12:42:39 user nova-compute[75247]:     </nova:port>
Dec 06 12:42:39 user nova-compute[75247]:     <nova:port uuid="4b46350b-531d-4f9c-89eb-1ebab7067497">
Dec 06 12:42:39 user nova-compute[75247]:       <nova:ip type="fixed" address="10.10.10.66" ipVersion="4"/>
Dec 06 12:42:39 user nova-compute[75247]:     </nova:port>
Dec 06 12:42:39 user nova-compute[75247]:   </nova:ports>
Dec 06 12:42:39 user nova-compute[75247]: </nova:instance>
Dec 06 12:42:39 user nova-compute[75247]:  {{(pid=75247) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e63bb158-d697-4b71-aa33-7952688677db tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "interface-f2e75618-9164-4527-a6a3-5f5195effccf-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.182s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.compute.manager [req-035c8caf-b14b-4c2f-bcf0-7fb6bb954238 req-7fcc1c6a-5aa8-44dd-a08d-6eedf7e45128 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Received event network-vif-plugged-4b46350b-531d-4f9c-89eb-1ebab7067497 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-035c8caf-b14b-4c2f-bcf0-7fb6bb954238 req-7fcc1c6a-5aa8-44dd-a08d-6eedf7e45128 service nova] Acquiring lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-035c8caf-b14b-4c2f-bcf0-7fb6bb954238 req-7fcc1c6a-5aa8-44dd-a08d-6eedf7e45128 service nova] Lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-035c8caf-b14b-4c2f-bcf0-7fb6bb954238 req-7fcc1c6a-5aa8-44dd-a08d-6eedf7e45128 service nova] Lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.compute.manager [req-035c8caf-b14b-4c2f-bcf0-7fb6bb954238 req-7fcc1c6a-5aa8-44dd-a08d-6eedf7e45128 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] No waiting events found dispatching network-vif-plugged-4b46350b-531d-4f9c-89eb-1ebab7067497 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:42:39 user nova-compute[75247]: WARNING nova.compute.manager [req-035c8caf-b14b-4c2f-bcf0-7fb6bb954238 req-7fcc1c6a-5aa8-44dd-a08d-6eedf7e45128 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Received unexpected event network-vif-plugged-4b46350b-531d-4f9c-89eb-1ebab7067497 for instance with vm_state active and task_state None.
Dec 06 12:42:39 user nova-compute[75247]: INFO nova.compute.manager [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Took 6.51 seconds to spawn the instance on the hypervisor.
Dec 06 12:42:39 user nova-compute[75247]: DEBUG nova.compute.manager [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:40 user nova-compute[75247]: INFO nova.compute.manager [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Took 7.60 seconds to build instance.
Dec 06 12:42:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1ea8bd4f-a85e-41bf-9154-9df02b67afbc tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "940d69a3-4737-4e84-b077-fe2eff86753f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.761s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Acquiring lock "f2e75618-9164-4527-a6a3-5f5195effccf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "f2e75618-9164-4527-a6a3-5f5195effccf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:40 user nova-compute[75247]: DEBUG nova.objects.instance [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lazy-loading 'flavor' on Instance uuid f2e75618-9164-4527-a6a3-5f5195effccf {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:42:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "f2e75618-9164-4527-a6a3-5f5195effccf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Acquiring lock "f2e75618-9164-4527-a6a3-5f5195effccf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "f2e75618-9164-4527-a6a3-5f5195effccf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:40 user nova-compute[75247]: INFO nova.compute.manager [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Attaching volume 8533adbe-4090-4aea-84e0-2d8099bc334a to /dev/vdb
Dec 06 12:42:40 user nova-compute[75247]: DEBUG os_brick.utils [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:42:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc87c221-c23a-4cbf-b48c-ab1f3710ba38]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b332e2-297c-479b-810c-a6942a91bd39]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02a2ffa-8f5f-40df-b418-c186a9561714]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4edd90-95d9-4e54-9817-fa808be108f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:42:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:42:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:42:40 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:42:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[268a0ee7-f73c-44cc-b992-30fb4f6eab9f]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:42:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:42:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:42:40 user nova-compute[75247]: DEBUG os_brick.utils [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:42:40 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Updating existing volume attachment record: 514c1f2a-fce5-4705-8f68-c84db74544cd {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:42:41 user nova-compute[75247]: DEBUG nova.compute.manager [req-f35e5e60-7865-4a8d-8e14-c084dff0cf42 req-5032146b-7788-4ec7-98bd-0fe4789c08ef service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Received event network-vif-plugged-4b46350b-531d-4f9c-89eb-1ebab7067497 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f35e5e60-7865-4a8d-8e14-c084dff0cf42 req-5032146b-7788-4ec7-98bd-0fe4789c08ef service nova] Acquiring lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f35e5e60-7865-4a8d-8e14-c084dff0cf42 req-5032146b-7788-4ec7-98bd-0fe4789c08ef service nova] Lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f35e5e60-7865-4a8d-8e14-c084dff0cf42 req-5032146b-7788-4ec7-98bd-0fe4789c08ef service nova] Lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:41 user nova-compute[75247]: DEBUG nova.compute.manager [req-f35e5e60-7865-4a8d-8e14-c084dff0cf42 req-5032146b-7788-4ec7-98bd-0fe4789c08ef service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] No waiting events found dispatching network-vif-plugged-4b46350b-531d-4f9c-89eb-1ebab7067497 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:42:41 user nova-compute[75247]: WARNING nova.compute.manager [req-f35e5e60-7865-4a8d-8e14-c084dff0cf42 req-5032146b-7788-4ec7-98bd-0fe4789c08ef service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Received unexpected event network-vif-plugged-4b46350b-531d-4f9c-89eb-1ebab7067497 for instance with vm_state active and task_state None.
Dec 06 12:42:41 user nova-compute[75247]: DEBUG nova.compute.manager [req-f35e5e60-7865-4a8d-8e14-c084dff0cf42 req-5032146b-7788-4ec7-98bd-0fe4789c08ef service nova] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Received event network-changed-bf793824-98be-4226-82eb-5e37152fcb2a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:41 user nova-compute[75247]: DEBUG nova.compute.manager [req-f35e5e60-7865-4a8d-8e14-c084dff0cf42 req-5032146b-7788-4ec7-98bd-0fe4789c08ef service nova] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Refreshing instance network info cache due to event network-changed-bf793824-98be-4226-82eb-5e37152fcb2a. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:42:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f35e5e60-7865-4a8d-8e14-c084dff0cf42 req-5032146b-7788-4ec7-98bd-0fe4789c08ef service nova] Acquiring lock "refresh_cache-12f40dad-65dc-4281-aa53-6036aa7e26d9" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:42:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f35e5e60-7865-4a8d-8e14-c084dff0cf42 req-5032146b-7788-4ec7-98bd-0fe4789c08ef service nova] Acquired lock "refresh_cache-12f40dad-65dc-4281-aa53-6036aa7e26d9" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:42:41 user nova-compute[75247]: DEBUG nova.network.neutron [req-f35e5e60-7865-4a8d-8e14-c084dff0cf42 req-5032146b-7788-4ec7-98bd-0fe4789c08ef service nova] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Refreshing network info cache for port bf793824-98be-4226-82eb-5e37152fcb2a {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:42:42 user nova-compute[75247]: DEBUG nova.network.neutron [req-f35e5e60-7865-4a8d-8e14-c084dff0cf42 req-5032146b-7788-4ec7-98bd-0fe4789c08ef service nova] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Updated VIF entry in instance network info cache for port bf793824-98be-4226-82eb-5e37152fcb2a. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:42:42 user nova-compute[75247]: DEBUG nova.network.neutron [req-f35e5e60-7865-4a8d-8e14-c084dff0cf42 req-5032146b-7788-4ec7-98bd-0fe4789c08ef service nova] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Updating instance_info_cache with network_info: [{"id": "bf793824-98be-4226-82eb-5e37152fcb2a", "address": "fa:16:3e:0d:07:76", "network": {"id": "cd593cd1-d7c8-41f9-89eb-844e385dcbac", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1184891647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b039f4b1235348e9b27104df9753f5be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf793824-98", "ovs_interfaceid": "bf793824-98be-4226-82eb-5e37152fcb2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:42:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f35e5e60-7865-4a8d-8e14-c084dff0cf42 req-5032146b-7788-4ec7-98bd-0fe4789c08ef service nova] Releasing lock "refresh_cache-12f40dad-65dc-4281-aa53-6036aa7e26d9" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:42:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBJGnqtH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:42:45 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:42:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:42:45 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:42:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:42:45 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[567d87b3-ed80-4523-8fb4-787a83e9b0f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:42:45 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf0bbeb-9000-41c8-ba3e-cf146452fb86]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e] added
Dec 06 12:42:45 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b62c4c-0f20-4996-b702-bd3e16068928]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d6c1f6-5e4d-448f-a356-b683a5842112]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBJGnqtH {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBJGnqtH" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4609ef-d483-421d-8825-06ab36ab5ee7]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zBJGnqtH'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb1515e-69be-41a8-a0df-7d26a119ecdf]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a1c818-796a-4ac9-8d6d-8fefcbc8e76c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:45 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:45 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:45 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:45 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:45 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:42:45 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:45 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:45 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:45 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:45 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:45 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:42:45 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5640524a-2ae4-4a97-af21-56ea64ef11f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e, portal: 172.16.0.220,3260]
Dec 06 12:42:45 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e, portal: 172.16.0.220,3260] successful.
Dec 06 12:42:45 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca92c502-15d9-42da-8c95-0a88c1efa571]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea5f302-e3b2-4148-b01e-645e1d333e5d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:45 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:45 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:45 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:45 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:45 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:42:45 user nova-compute[75247]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)
Dec 06 12:42:45 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:45 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:45 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:45 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:45 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:45 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:42:45 user nova-compute[75247]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)
Dec 06 12:42:45 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] HCTL ('38', '-', '-', 0) found on session 9 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a34272f-5f73-4b22-aed5-cf58037faab6]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: None {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Acquiring lock "12f40dad-65dc-4281-aa53-6036aa7e26d9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Lock "12f40dad-65dc-4281-aa53-6036aa7e26d9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycZYnIDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:42:45 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:42:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG nova.objects.instance [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Lazy-loading 'flavor' on Instance uuid 12f40dad-65dc-4281-aa53-6036aa7e26d9 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Lock "12f40dad-65dc-4281-aa53-6036aa7e26d9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Acquiring lock "12f40dad-65dc-4281-aa53-6036aa7e26d9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Lock "12f40dad-65dc-4281-aa53-6036aa7e26d9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:45 user nova-compute[75247]: INFO nova.compute.manager [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Attaching volume f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 to /dev/vdb
Dec 06 12:42:46 user nova-compute[75247]: DEBUG os_brick.utils [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c3c00c-ac16-433b-9674-16e1dde4eaba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a24b4e1-1f0a-4c19-8d31-502cccd93a35]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c640fbb1-c815-4e4b-b695-745625351303]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7cc390-7761-40e3-982d-0b8e1a485626]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:42:46 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[feec7810-386e-4186-8652-68b244b302c1]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG os_brick.utils [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Updating existing volume attachment record: ee6004fb-c5b3-4c55-9c08-192d6afd5992 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBJGnqtH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26566616161623138', 'path': '/dev/sdg'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566616161623138', 'path': '/dev/sdg'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.972s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:42:46 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:42:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:42:46 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG nova.objects.instance [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lazy-loading 'flavor' on Instance uuid f0e26668-e253-409a-a011-a54e8ad3ebb7 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cc1af3-5079-4924-9c5a-0acf68fdfefb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:42:46 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 12:42:46 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:42:46 user nova-compute[75247]:   <source dev="/dev/sdg"/>
Dec 06 12:42:46 user nova-compute[75247]:   <target dev="sdc" bus="scsi"/>
Dec 06 12:42:46 user nova-compute[75247]:   <serial>52f821cf-60c8-442a-aebe-b44741fb151e</serial>
Dec 06 12:42:46 user nova-compute[75247]:   <address type="drive" controller="0" unit="2"/>
Dec 06 12:42:46 user nova-compute[75247]: </disk>
Dec 06 12:42:46 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdfd888-678d-4d0f-90a4-367e310e8f7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8] added
Dec 06 12:42:46 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[817d7881-ec73-4eb9-879c-311c432d6b84]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[943da3ab-14ce-4e4c-953c-96f6e7a66b29]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycZYnIDC {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycZYnIDC" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[95668de6-88db-48e7-96fc-7743c3e64255]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ycZYnIDC'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a100d58-469a-4fa6-ac46-7354ae1c4699]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0435bb0e-5845-4fce-90fd-b767d6169287]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:46 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:46 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:46 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:46 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:46 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:42:46 user nova-compute[75247]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)
Dec 06 12:42:46 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:46 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:46 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:46 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:46 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:46 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:42:46 user nova-compute[75247]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)
Dec 06 12:42:46 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8213d354-0a1c-48c3-afcd-b88e4893c6be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8, portal: 172.16.0.220,3260]
Dec 06 12:42:46 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8, portal: 172.16.0.220,3260] successful.
Dec 06 12:42:46 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bb7a6c-cf86-4639-a119-8e82938c9ecf]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fe621e-e05a-452c-9816-af82a109f702]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:47 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:42:47 user nova-compute[75247]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:47 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:47 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:47 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:47 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:47 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:42:47 user nova-compute[75247]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)
Dec 06 12:42:47 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:42:47 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:42:47 user nova-compute[75247]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:47 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:47 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:47 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:47 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:47 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:42:47 user nova-compute[75247]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)
Dec 06 12:42:47 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:42:47 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:42:47 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:42:47 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:42:47 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:42:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:47 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[74401927-7123-4a40-8625-f84d9d97a3b3]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:47 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:42:47 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycZYnIDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:42:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] No BDM found with device name sda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:42:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:42:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:42:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] No VIF found with MAC fa:16:3e:ae:36:46, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:42:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-2c27ab47-2e16-46f7-921f-181dfcafa909 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "f0e26668-e253-409a-a011-a54e8ad3ebb7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.314s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Acquiring lock "f0e26668-e253-409a-a011-a54e8ad3ebb7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "f0e26668-e253-409a-a011-a54e8ad3ebb7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:48 user nova-compute[75247]: INFO nova.compute.manager [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Detaching volume 52f821cf-60c8-442a-aebe-b44741fb151e
Dec 06 12:42:48 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:42:48 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] <== connect_volume: return (2341ms) {'type': 'block', 'scsi_wwn': '26366646534323163', 'path': '/dev/sdi'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:42:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366646534323163', 'path': '/dev/sdi'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:42:48 user nova-compute[75247]: DEBUG nova.objects.instance [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lazy-loading 'flavor' on Instance uuid dbb64a66-f500-407b-ae92-80f27eb6ce2e {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:42:48 user nova-compute[75247]: INFO nova.virt.block_device [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Attempting to driver detach volume 52f821cf-60c8-442a-aebe-b44741fb151e from mountpoint /dev/sdc
Dec 06 12:42:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 12:42:48 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:42:48 user nova-compute[75247]:   <source dev="/dev/sdi"/>
Dec 06 12:42:48 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:42:48 user nova-compute[75247]:   <serial>82a4a39f-5874-4d9f-8936-c14e2d8a0ca8</serial>
Dec 06 12:42:48 user nova-compute[75247]: </disk>
Dec 06 12:42:48 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 12:42:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Attempting to detach device sdc from instance f0e26668-e253-409a-a011-a54e8ad3ebb7 from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 12:42:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:42:48 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:42:48 user nova-compute[75247]:   <source dev="/dev/sdg"/>
Dec 06 12:42:48 user nova-compute[75247]:   <target dev="sdc" bus="scsi"/>
Dec 06 12:42:48 user nova-compute[75247]:   <serial>52f821cf-60c8-442a-aebe-b44741fb151e</serial>
Dec 06 12:42:48 user nova-compute[75247]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Dec 06 12:42:48 user nova-compute[75247]: </disk>
Dec 06 12:42:48 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:42:48 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Successfully detached device sdc from instance f0e26668-e253-409a-a011-a54e8ad3ebb7 from the persistent domain config.
Dec 06 12:42:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance f0e26668-e253-409a-a011-a54e8ad3ebb7 from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 12:42:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:42:48 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:42:48 user nova-compute[75247]:   <source dev="/dev/sdg"/>
Dec 06 12:42:48 user nova-compute[75247]:   <target dev="sdc" bus="scsi"/>
Dec 06 12:42:48 user nova-compute[75247]:   <serial>52f821cf-60c8-442a-aebe-b44741fb151e</serial>
Dec 06 12:42:48 user nova-compute[75247]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Dec 06 12:42:48 user nova-compute[75247]: </disk>
Dec 06 12:42:48 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:42:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:42:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:42:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] No VIF found with MAC fa:16:3e:fd:3e:cc, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:42:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7614ab97-605c-4f5b-9319-bda2e68f64bf tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.409s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance f0e26668-e253-409a-a011-a54e8ad3ebb7 {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 12:42:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Acquiring lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.003s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:50 user nova-compute[75247]: DEBUG os_brick.utils [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:42:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:50 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[577e6a24-4f17-4c63-aac2-51d6fb835979]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:50 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7631028d-8ebf-4512-9c37-3dcbc050a879]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:50 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1834e5fa-2419-4209-ab60-f85bca3f1448]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:50 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce88454f-6f72-4896-96d2-cda330af05ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:42:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:42:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:42:50 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:42:50 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[81959002-40b1-4d2a-bf37-a170416ae838]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:42:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:42:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:42:50 user nova-compute[75247]: DEBUG os_brick.utils [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:42:50 user nova-compute[75247]: INFO nova.compute.manager [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Swapping volume 82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 for a981a788-9ae3-41c7-b06f-3b797b194bf6
Dec 06 12:42:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AxTqkZFQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:42:51 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:42:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:42:51 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:42:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:42:51 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:42:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[548ca847-ce79-415f-b7ba-3f22ca3bdfe7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:42:51 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc95d53-e3ff-4c5b-aef1-766b0b76efda]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a] added
Dec 06 12:42:51 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dfc614-72ea-46ba-8c43-b764344abdb6]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[989cb748-ce49-4738-8985-73a6f27fa116]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AxTqkZFQ {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AxTqkZFQ" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c5dbcf-41a8-4d3b-a9f1-60efbba6b69f]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AxTqkZFQ'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8015a211-2855-45cd-b51d-b3189c6cd054]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d5de4b-5d92-4ae6-b1a3-610453370af9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:42:51 user nova-compute[75247]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:51 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:51 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:51 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:51 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:51 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:42:51 user nova-compute[75247]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)
Dec 06 12:42:51 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:42:51 user nova-compute[75247]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:51 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:51 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:51 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:51 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:51 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:42:51 user nova-compute[75247]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)
Dec 06 12:42:51 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:42:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c796cf56-1cf6-4cc6-b4a2-a93a37f0a9aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a, portal: 172.16.0.220,3260]
Dec 06 12:42:52 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a, portal: 172.16.0.220,3260] successful.
Dec 06 12:42:52 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[491c0274-69e6-4d6f-93d3-ca953f516a87]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c6c510-e5fb-4834-9a72-a4e471b0dd09]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:42:52 user nova-compute[75247]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)
Dec 06 12:42:52 user nova-compute[75247]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:52 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:52 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:52 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:52 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:52 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:42:52 user nova-compute[75247]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)
Dec 06 12:42:52 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:42:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:42:52 user nova-compute[75247]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)
Dec 06 12:42:52 user nova-compute[75247]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:52 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:52 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:52 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:52 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:52 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:42:52 user nova-compute[75247]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)
Dec 06 12:42:52 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:42:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:42:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:42:52 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:42:52 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:42:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[930c84b6-c75e-4037-a52a-1ca549fcf055]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:52 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:42:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AxTqkZFQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:42:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:42:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23432636234656263', 'path': '/dev/sdj'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:42:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432636234656263', 'path': '/dev/sdj'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:42:53 user nova-compute[75247]: DEBUG nova.objects.instance [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lazy-loading 'flavor' on Instance uuid f2e75618-9164-4527-a6a3-5f5195effccf {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:42:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 12:42:53 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:42:53 user nova-compute[75247]:   <source dev="/dev/sdj"/>
Dec 06 12:42:53 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:42:53 user nova-compute[75247]:   <serial>8533adbe-4090-4aea-84e0-2d8099bc334a</serial>
Dec 06 12:42:53 user nova-compute[75247]: </disk>
Dec 06 12:42:53 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 12:42:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:42:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] No BDM found with device name hda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:42:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] No VIF found with MAC fa:16:3e:b0:12:84, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:42:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-70f23ad6-de3d-4f5c-99fe-a56f95ca5ae2 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "f2e75618-9164-4527-a6a3-5f5195effccf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.299s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:54 user nova-compute[75247]: DEBUG nova.compute.manager [req-ca4f1e7a-4bcc-4264-ae02-ed38c72ad165 req-93c4f605-2eec-4206-97ff-ca2acb341a66 service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Received event network-changed-795878af-3950-4253-83f2-7656b6ce8fb0 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:54 user nova-compute[75247]: DEBUG nova.compute.manager [req-ca4f1e7a-4bcc-4264-ae02-ed38c72ad165 req-93c4f605-2eec-4206-97ff-ca2acb341a66 service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Refreshing instance network info cache due to event network-changed-795878af-3950-4253-83f2-7656b6ce8fb0. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:42:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ca4f1e7a-4bcc-4264-ae02-ed38c72ad165 req-93c4f605-2eec-4206-97ff-ca2acb341a66 service nova] Acquiring lock "refresh_cache-ed721541-3a94-496f-8b9d-88c74ac83ef7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:42:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ca4f1e7a-4bcc-4264-ae02-ed38c72ad165 req-93c4f605-2eec-4206-97ff-ca2acb341a66 service nova] Acquired lock "refresh_cache-ed721541-3a94-496f-8b9d-88c74ac83ef7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:42:54 user nova-compute[75247]: DEBUG nova.network.neutron [req-ca4f1e7a-4bcc-4264-ae02-ed38c72ad165 req-93c4f605-2eec-4206-97ff-ca2acb341a66 service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Refreshing network info cache for port 795878af-3950-4253-83f2-7656b6ce8fb0 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:42:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Acquiring lock "f2e75618-9164-4527-a6a3-5f5195effccf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "f2e75618-9164-4527-a6a3-5f5195effccf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:55 user nova-compute[75247]: INFO nova.compute.manager [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Detaching volume 8533adbe-4090-4aea-84e0-2d8099bc334a
Dec 06 12:42:55 user nova-compute[75247]: INFO nova.virt.block_device [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Attempting to driver detach volume 8533adbe-4090-4aea-84e0-2d8099bc334a from mountpoint /dev/vdb
Dec 06 12:42:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Attempting to detach device vdb from instance f2e75618-9164-4527-a6a3-5f5195effccf from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 12:42:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:42:55 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:42:55 user nova-compute[75247]:   <source dev="/dev/sdj"/>
Dec 06 12:42:55 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:42:55 user nova-compute[75247]:   <serial>8533adbe-4090-4aea-84e0-2d8099bc334a</serial>
Dec 06 12:42:55 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 06 12:42:55 user nova-compute[75247]: </disk>
Dec 06 12:42:55 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:42:55 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Successfully detached device vdb from instance f2e75618-9164-4527-a6a3-5f5195effccf from the persistent domain config.
Dec 06 12:42:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f2e75618-9164-4527-a6a3-5f5195effccf from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 12:42:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:42:55 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:42:55 user nova-compute[75247]:   <source dev="/dev/sdj"/>
Dec 06 12:42:55 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:42:55 user nova-compute[75247]:   <serial>8533adbe-4090-4aea-84e0-2d8099bc334a</serial>
Dec 06 12:42:55 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 06 12:42:55 user nova-compute[75247]: </disk>
Dec 06 12:42:55 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:42:55 user nova-compute[75247]: DEBUG nova.network.neutron [req-ca4f1e7a-4bcc-4264-ae02-ed38c72ad165 req-93c4f605-2eec-4206-97ff-ca2acb341a66 service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Updated VIF entry in instance network info cache for port 795878af-3950-4253-83f2-7656b6ce8fb0. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:42:55 user nova-compute[75247]: DEBUG nova.network.neutron [req-ca4f1e7a-4bcc-4264-ae02-ed38c72ad165 req-93c4f605-2eec-4206-97ff-ca2acb341a66 service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Updating instance_info_cache with network_info: [{"id": "795878af-3950-4253-83f2-7656b6ce8fb0", "address": "fa:16:3e:39:75:70", "network": {"id": "b8c04077-286f-434c-a3a6-cde7a124f301", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-378433228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d12120b32e41b891fd25ca49f9553a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795878af-39", "ovs_interfaceid": "795878af-3950-4253-83f2-7656b6ce8fb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:42:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ca4f1e7a-4bcc-4264-ae02-ed38c72ad165 req-93c4f605-2eec-4206-97ff-ca2acb341a66 service nova] Releasing lock "refresh_cache-ed721541-3a94-496f-8b9d-88c74ac83ef7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:42:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f2e75618-9164-4527-a6a3-5f5195effccf {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 12:42:56 user nova-compute[75247]: INFO nova.compute.manager [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Rebuilding instance
Dec 06 12:42:56 user nova-compute[75247]: DEBUG nova.compute.manager [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:56 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Instance destroyed successfully.
Dec 06 12:42:56 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Instance destroyed successfully.
Dec 06 12:42:56 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1282622112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2112362070',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAvGjqKGelHMukSgIEWiaJYGvjKnXCgFhWE2e9opkG+MtYR0JDGRdm7aO7xPBVUPfutpJlFkjfqa+5bgZXZpZP3Yy5+bfGop2oLmWOnvB+kyfjNOJ8IAYFrs9oEZQCG4w==',key_name='tempest-keypair-863855062',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:41:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='05d12120b32e41b891fd25ca49f9553a',ramdisk_id='',reservation_id='r-ouvdxg8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-888686040',owner_user_name='tempest-ServerActionsV293TestJSON-888686040-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:42:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12dc589ceb3429b8ae09c1413589709',uuid=ed721541-3a94-496f-8b9d-88c74ac83ef7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "795878af-3950-4253-83f2-7656b6ce8fb0", "address": "fa:16:3e:39:75:70", "network": {"id": "b8c04077-286f-434c-a3a6-cde7a124f301", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-378433228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d12120b32e41b891fd25ca49f9553a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795878af-39", "ovs_interfaceid": "795878af-3950-4253-83f2-7656b6ce8fb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Converting VIF {"id": "795878af-3950-4253-83f2-7656b6ce8fb0", "address": "fa:16:3e:39:75:70", "network": {"id": "b8c04077-286f-434c-a3a6-cde7a124f301", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-378433228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d12120b32e41b891fd25ca49f9553a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795878af-39", "ovs_interfaceid": "795878af-3950-4253-83f2-7656b6ce8fb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:75:70,bridge_name='br-int',has_traffic_filtering=True,id=795878af-3950-4253-83f2-7656b6ce8fb0,network=Network(b8c04077-286f-434c-a3a6-cde7a124f301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap795878af-39') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG os_vif [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:75:70,bridge_name='br-int',has_traffic_filtering=True,id=795878af-3950-4253-83f2-7656b6ce8fb0,network=Network(b8c04077-286f-434c-a3a6-cde7a124f301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap795878af-39') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap795878af-39, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82ed0343-b1ba-4966-8ca4-a398b9a4d4f0) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:56 user nova-compute[75247]: INFO os_vif [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:75:70,bridge_name='br-int',has_traffic_filtering=True,id=795878af-3950-4253-83f2-7656b6ce8fb0,network=Network(b8c04077-286f-434c-a3a6-cde7a124f301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap795878af-39')
Dec 06 12:42:56 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'teobKPCy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:42:56 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 06 12:42:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[56483c73-d012-44d0-98f6-6b4392f1f778]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:42:56 user nova-compute[75247]: No targets found.
Dec 06 12:42:56 user nova-compute[75247]: iSNS:
Dec 06 12:42:56 user nova-compute[75247]: No targets found.
Dec 06 12:42:56 user nova-compute[75247]: STATIC:
Dec 06 12:42:56 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8
Dec 06 12:42:56 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:42:56 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:42:56 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8
Dec 06 12:42:56 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:42:56 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:42:56 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496
Dec 06 12:42:56 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:42:56 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:42:56 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e
Dec 06 12:42:56 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:42:56 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:42:56 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0
Dec 06 12:42:56 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:42:56 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:42:56 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a
Dec 06 12:42:56 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:42:56 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:42:56 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c
Dec 06 12:42:56 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:42:56 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:42:56 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4
Dec 06 12:42:56 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:42:56 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:42:56 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482
Dec 06 12:42:56 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:42:56 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:42:56 user nova-compute[75247]: FIRMWARE:
Dec 06 12:42:56 user nova-compute[75247]: No targets found.
Dec 06 12:42:56 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:42:56 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:42:56 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c7ddf0-5320-44a1-b5a8-eec31456bdeb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b4e384-3285-46f0-ba90-9b3917e0bcec]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:42:56 user nova-compute[75247]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)
Dec 06 12:42:56 user nova-compute[75247]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:56 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:56 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:56 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:56 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:56 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:42:56 user nova-compute[75247]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)
Dec 06 12:42:56 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:42:56 user nova-compute[75247]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)
Dec 06 12:42:56 user nova-compute[75247]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:42:56 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:56 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:56 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:56 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:56 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:42:56 user nova-compute[75247]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)
Dec 06 12:42:56 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd7480e39a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0'): ({'sdb'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Removing single pathed devices sdb {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2046abc2-ff95-4e41-9af2-19c7977a4b13]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9affe46d-b96b-47f3-9332-e2b6598a04c5]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Flushing IO for device /dev/sdb {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG nova.compute.manager [req-806f7e01-abf4-4129-bbcb-1d503e986da4 req-dc9f491d-9f23-40a3-95a8-0cd92468adce service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Received event network-vif-unplugged-795878af-3950-4253-83f2-7656b6ce8fb0 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-806f7e01-abf4-4129-bbcb-1d503e986da4 req-dc9f491d-9f23-40a3-95a8-0cd92468adce service nova] Acquiring lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-806f7e01-abf4-4129-bbcb-1d503e986da4 req-dc9f491d-9f23-40a3-95a8-0cd92468adce service nova] Lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-806f7e01-abf4-4129-bbcb-1d503e986da4 req-dc9f491d-9f23-40a3-95a8-0cd92468adce service nova] Lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG nova.compute.manager [req-806f7e01-abf4-4129-bbcb-1d503e986da4 req-dc9f491d-9f23-40a3-95a8-0cd92468adce service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] No waiting events found dispatching network-vif-unplugged-795878af-3950-4253-83f2-7656b6ce8fb0 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:42:57 user nova-compute[75247]: WARNING nova.compute.manager [req-806f7e01-abf4-4129-bbcb-1d503e986da4 req-dc9f491d-9f23-40a3-95a8-0cd92468adce service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Received unexpected event network-vif-unplugged-795878af-3950-4253-83f2-7656b6ce8fb0 for instance with vm_state active and task_state rebuilding.
Dec 06 12:42:57 user nova-compute[75247]: DEBUG nova.compute.manager [req-806f7e01-abf4-4129-bbcb-1d503e986da4 req-dc9f491d-9f23-40a3-95a8-0cd92468adce service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Received event network-vif-plugged-795878af-3950-4253-83f2-7656b6ce8fb0 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-806f7e01-abf4-4129-bbcb-1d503e986da4 req-dc9f491d-9f23-40a3-95a8-0cd92468adce service nova] Acquiring lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-806f7e01-abf4-4129-bbcb-1d503e986da4 req-dc9f491d-9f23-40a3-95a8-0cd92468adce service nova] Lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-806f7e01-abf4-4129-bbcb-1d503e986da4 req-dc9f491d-9f23-40a3-95a8-0cd92468adce service nova] Lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG nova.compute.manager [req-806f7e01-abf4-4129-bbcb-1d503e986da4 req-dc9f491d-9f23-40a3-95a8-0cd92468adce service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] No waiting events found dispatching network-vif-plugged-795878af-3950-4253-83f2-7656b6ce8fb0 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:42:57 user nova-compute[75247]: WARNING nova.compute.manager [req-806f7e01-abf4-4129-bbcb-1d503e986da4 req-dc9f491d-9f23-40a3-95a8-0cd92468adce service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Received unexpected event network-vif-plugged-795878af-3950-4253-83f2-7656b6ce8fb0 for instance with vm_state active and task_state rebuilding.
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b69c2c-7301-4705-a718-5d999d9ca34c]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fc7123-0ec5-4f02-ac9e-0b180717c997]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[da025cbe-ba20-46a3-ac52-c4556485f8c3]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[928e599a-3cec-4438-938a-fd8c08d9cb44]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0, portal: 172.16.0.220,3260]
Dec 06 12:42:57 user nova-compute[75247]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0, portal: 172.16.0.220,3260] successful.
Dec 06 12:42:57 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a213471-ac2f-4bf6-b7c1-9b15d7b6498d]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] <== disconnect_volume: return (349ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:42:57 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Deleting instance files /opt/stack/data/nova/instances/ed721541-3a94-496f-8b9d-88c74ac83ef7_del
Dec 06 12:42:57 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Deletion of /opt/stack/data/nova/instances/ed721541-3a94-496f-8b9d-88c74ac83ef7_del complete
Dec 06 12:42:57 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance ed721541-3a94-496f-8b9d-88c74ac83ef7 could not be found.
Dec 06 12:42:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'teobKPCy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:42:57 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73fabc7-09c4-4f55-af76-72d2f43a6ac7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:42:57 user nova-compute[75247]: No targets found.
Dec 06 12:42:57 user nova-compute[75247]: iSNS:
Dec 06 12:42:57 user nova-compute[75247]: No targets found.
Dec 06 12:42:57 user nova-compute[75247]: STATIC:
Dec 06 12:42:57 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8
Dec 06 12:42:57 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:42:57 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:42:57 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8
Dec 06 12:42:57 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:42:57 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:42:57 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496
Dec 06 12:42:57 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:42:57 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:42:57 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e
Dec 06 12:42:57 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:42:57 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:42:57 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a
Dec 06 12:42:57 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:42:57 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:42:57 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c
Dec 06 12:42:57 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:42:57 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:42:57 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4
Dec 06 12:42:57 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:42:57 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:42:57 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482
Dec 06 12:42:57 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:42:57 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:42:57 user nova-compute[75247]: FIRMWARE:
Dec 06 12:42:57 user nova-compute[75247]: No targets found.
Dec 06 12:42:57 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:42:57 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:42:57 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe701be-a775-4b0a-8577-34667a92bccd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[82170202-8018-4819-9bde-4ccd900e2521]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)
Dec 06 12:42:57 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)
Dec 06 12:42:57 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd730190670>, {}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Disconnecting from: [] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.082s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] <== disconnect_volume: return (83ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkpuHIRO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:42:57 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:42:57 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:42:57 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3df7f0-608d-4a22-9016-141940a3831d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:42:57 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d39fb6-7302-410e-b99d-c65a14011ec7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681] added
Dec 06 12:42:57 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d3aab0-e223-405f-b49b-288877d11550]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[274b34f2-d243-472f-9e14-07d388e09913]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AkpuHIRO {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AkpuHIRO" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd076c4-52c8-40b9-9410-73002880f9e0]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AkpuHIRO'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e2c47b-93b8-4dd4-8b1a-97106995a814]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f5b55e-8442-4c9c-9807-67d4c8a21ac2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)
Dec 06 12:42:57 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)
Dec 06 12:42:57 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[364e99af-bed7-4174-88cd-60e3a91d8db2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681, portal: 172.16.0.220,3260]
Dec 06 12:42:57 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681, portal: 172.16.0.220,3260] successful.
Dec 06 12:42:57 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1d91c6-1cb4-4b3d-9977-adbf83ded1ed]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4859b7b5-ee2c-4d1e-8c0d-d2d12ca74824]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)
Dec 06 12:42:57 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:42:57 user nova-compute[75247]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)
Dec 06 12:42:57 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[55487ac2-eb7b-40d7-a615-89c6b3be67b6]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:42:57 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkpuHIRO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:42:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:42:58 user nova-compute[75247]: DEBUG nova.compute.manager [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Preparing to wait for external event volume-reimaged-f5d30437-2abd-41f4-9626-a1ce202bacb0 {{(pid=75247) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Dec 06 12:42:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Acquiring lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:42:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:42:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:42:58 user nova-compute[75247]: ERROR nova.volume.cinder [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Update attachment failed for attachment 82c261f6-a27b-4839-b4e8-290313796611. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a90f353c-0924-4279-8fb2-f9f25fd94a54) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a90f353c-0924-4279-8fb2-f9f25fd94a54)
Dec 06 12:42:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:42:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23161663434316562', 'path': '/dev/sdb'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:42:58 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161663434316562', 'path': '/dev/sdb'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:42:58 user nova-compute[75247]: DEBUG nova.objects.instance [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Lazy-loading 'flavor' on Instance uuid 12f40dad-65dc-4281-aa53-6036aa7e26d9 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:42:58 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] attach device xml: <disk type="block" device="disk">
Dec 06 12:42:58 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:42:58 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:42:58 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:42:58 user nova-compute[75247]:   <serial>f55bc9fb-8aec-4d64-b7d4-8dffacc3e681</serial>
Dec 06 12:42:58 user nova-compute[75247]: </disk>
Dec 06 12:42:58 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 12:42:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:42:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:42:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] No VIF found with MAC fa:16:3e:0d:07:76, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:42:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-2f1a64fc-74c0-4b99-8bd8-7ed27e3c5d1d tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Lock "12f40dad-65dc-4281-aa53-6036aa7e26d9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.491s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1ee1fc6b-e03d-4e09-82af-70ebe111c0b9 tempest-VolumesAssistedSnapshotsTest-12427848 tempest-VolumesAssistedSnapshotsTest-12427848-project] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] volume_snapshot_create: create_info: {'snapshot_id': 'eb88add1-7d55-412a-85b7-a4469ed844e6', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75247) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3572}}
Dec 06 12:43:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1ee1fc6b-e03d-4e09-82af-70ebe111c0b9 tempest-VolumesAssistedSnapshotsTest-12427848 tempest-VolumesAssistedSnapshotsTest-12427848-project] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] snap xml: <domainsnapshot>
Dec 06 12:43:00 user nova-compute[75247]:   <disks>
Dec 06 12:43:00 user nova-compute[75247]:     <disk name="/dev/sdb" snapshot="external" type="file">
Dec 06 12:43:00 user nova-compute[75247]:       <source file="/dev/new_file"/>
Dec 06 12:43:00 user nova-compute[75247]:     </disk>
Dec 06 12:43:00 user nova-compute[75247]:     <disk name="vda" snapshot="no"/>
Dec 06 12:43:00 user nova-compute[75247]:   </disks>
Dec 06 12:43:00 user nova-compute[75247]: </domainsnapshot>
Dec 06 12:43:00 user nova-compute[75247]:  {{(pid=75247) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3513}}
Dec 06 12:43:00 user nova-compute[75247]: DEBUG nova.objects.instance [None req-1ee1fc6b-e03d-4e09-82af-70ebe111c0b9 tempest-VolumesAssistedSnapshotsTest-12427848 tempest-VolumesAssistedSnapshotsTest-12427848-project] Lazy-loading 'system_metadata' on Instance uuid 12f40dad-65dc-4281-aa53-6036aa7e26d9 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:43:00 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-1ee1fc6b-e03d-4e09-82af-70ebe111c0b9 tempest-VolumesAssistedSnapshotsTest-12427848 tempest-VolumesAssistedSnapshotsTest-12427848-project] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [None req-1ee1fc6b-e03d-4e09-82af-70ebe111c0b9 tempest-VolumesAssistedSnapshotsTest-12427848 tempest-VolumesAssistedSnapshotsTest-12427848-project] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Traceback (most recent call last):
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]     rv = execute(f, *args, **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]     six.reraise(c, e, tb)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]     raise value
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]     rv = meth(*args, **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] 
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [None req-1ee1fc6b-e03d-4e09-82af-70ebe111c0b9 tempest-VolumesAssistedSnapshotsTest-12427848 tempest-VolumesAssistedSnapshotsTest-12427848-project] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Traceback (most recent call last):
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]     self._volume_snapshot_create(context, instance, guest,
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]     rv = execute(f, *args, **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]     six.reraise(c, e, tb)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]     raise value
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]     rv = meth(*args, **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] 
Dec 06 12:43:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ea427d38-a6ab-4876-9481-2f08c647fc6b tempest-VolumesAssistedSnapshotsTest-12427848 tempest-VolumesAssistedSnapshotsTest-12427848-project] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] volume_snapshot_delete: delete_info: {'volume_id': 'f55bc9fb-8aec-4d64-b7d4-8dffacc3e681'} {{(pid=75247) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3673}}
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [None req-ea427d38-a6ab-4876-9481-2f08c647fc6b tempest-VolumesAssistedSnapshotsTest-12427848 tempest-VolumesAssistedSnapshotsTest-12427848-project] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Traceback (most recent call last):
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]     self._volume_snapshot_delete(context, instance, volume_id,
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9]     if delete_info['type'] != 'qcow2':
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] KeyError: 'type'
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] 
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [None req-1ee1fc6b-e03d-4e09-82af-70ebe111c0b9 tempest-VolumesAssistedSnapshotsTest-12427848 tempest-VolumesAssistedSnapshotsTest-12427848-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot eb88add1-7d55-412a-85b7-a4469ed844e6 could not be found.
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     raise value
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver 
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver 
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot eb88add1-7d55-412a-85b7-a4469ed844e6 could not be found. (HTTP 404) (Request-ID: req-a208f376-950d-4155-94e4-70a7ffd780b3)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver 
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver 
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3412, in _volume_snapshot_update_status
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot eb88add1-7d55-412a-85b7-a4469ed844e6 could not be found.
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver 
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server [None req-1ee1fc6b-e03d-4e09-82af-70ebe111c0b9 tempest-VolumesAssistedSnapshotsTest-12427848 tempest-VolumesAssistedSnapshotsTest-12427848-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3593, in volume_snapshot_create
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     raise value
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server 
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver [None req-ea427d38-a6ab-4876-9481-2f08c647fc6b tempest-VolumesAssistedSnapshotsTest-12427848 tempest-VolumesAssistedSnapshotsTest-12427848-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver 
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver 
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-6941929b-6623-423f-a74b-335c335c2d73)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver 
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver 
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3412, in _volume_snapshot_update_status
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Dec 06 12:43:00 user nova-compute[75247]: ERROR nova.virt.libvirt.driver 
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server [None req-ea427d38-a6ab-4876-9481-2f08c647fc6b tempest-VolumesAssistedSnapshotsTest-12427848 tempest-VolumesAssistedSnapshotsTest-12427848-project] Exception during message handling: KeyError: 'type'
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3849, in volume_snapshot_delete
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Dec 06 12:43:00 user nova-compute[75247]: ERROR oslo_messaging.rpc.server 
Dec 06 12:43:00 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:43:00 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:43:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Acquiring lock "12f40dad-65dc-4281-aa53-6036aa7e26d9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Lock "12f40dad-65dc-4281-aa53-6036aa7e26d9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:01 user nova-compute[75247]: INFO nova.compute.manager [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Detaching volume f55bc9fb-8aec-4d64-b7d4-8dffacc3e681
Dec 06 12:43:01 user nova-compute[75247]: INFO nova.virt.block_device [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Attempting to driver detach volume f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 from mountpoint /dev/vdb
Dec 06 12:43:01 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Attempting to detach device vdb from instance 12f40dad-65dc-4281-aa53-6036aa7e26d9 from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 12:43:01 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] detach device xml: <disk type="block" device="disk">
Dec 06 12:43:01 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:43:01 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:43:01 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:43:01 user nova-compute[75247]:   <serial>f55bc9fb-8aec-4d64-b7d4-8dffacc3e681</serial>
Dec 06 12:43:01 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:43:01 user nova-compute[75247]: </disk>
Dec 06 12:43:01 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:43:01 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Successfully detached device vdb from instance 12f40dad-65dc-4281-aa53-6036aa7e26d9 from the persistent domain config.
Dec 06 12:43:01 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 12f40dad-65dc-4281-aa53-6036aa7e26d9 from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 12:43:01 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] detach device xml: <disk type="block" device="disk">
Dec 06 12:43:01 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:43:01 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:43:01 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:43:01 user nova-compute[75247]:   <serial>f55bc9fb-8aec-4d64-b7d4-8dffacc3e681</serial>
Dec 06 12:43:01 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:43:01 user nova-compute[75247]: </disk>
Dec 06 12:43:01 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:43:01 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 12f40dad-65dc-4281-aa53-6036aa7e26d9 {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 12:43:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:01 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:43:02 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:43:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:03 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:43:03 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 12:43:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-782289e2-91cd-4aee-9a08-eadfb2a5965b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:43:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-782289e2-91cd-4aee-9a08-eadfb2a5965b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:43:04 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 12:43:04 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Updating instance_info_cache with network_info: [{"id": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "address": "fa:16:3e:e4:cb:02", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924c627-a1", "ovs_interfaceid": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:43:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-782289e2-91cd-4aee-9a08-eadfb2a5965b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:43:04 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 12:43:04 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:43:04 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:43:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:04 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 12:43:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:43:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:05 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:43:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:43:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12f40dad-65dc-4281-aa53-6036aa7e26d9/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12f40dad-65dc-4281-aa53-6036aa7e26d9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12f40dad-65dc-4281-aa53-6036aa7e26d9/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12f40dad-65dc-4281-aa53-6036aa7e26d9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940d69a3-4737-4e84-b077-fe2eff86753f/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940d69a3-4737-4e84-b077-fe2eff86753f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940d69a3-4737-4e84-b077-fe2eff86753f/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940d69a3-4737-4e84-b077-fe2eff86753f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:43:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:43:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:43:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFexDjIt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dbb64a66-f500-407b-ae92-80f27eb6ce2e', 'attached_at': '', 'detached_at': '', 'volume_id': 'a981a788-9ae3-41c7-b06f-3b797b194bf6', 'serial': 'a981a788-9ae3-41c7-b06f-3b797b194bf6'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycZYnIDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'dbb64a66-f500-407b-ae92-80f27eb6ce2e', 'attached_at': '', 'detached_at': '', 'volume_id': '82a4a39f-5874-4d9f-8936-c14e2d8a0ca8', 'serial'} {{(pid=75247) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Dec 06 12:43:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:08 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance f0e26668-e253-409a-a011-a54e8ad3ebb7 is timed out.
Dec 06 12:43:08 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Successfully detached device sdc from instance f0e26668-e253-409a-a011-a54e8ad3ebb7 from the live domain config.
Dec 06 12:43:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:43:08 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFexDjIt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:43:08 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:43:08 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:43:08 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:43:08 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:43:08 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:43:08 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:43:08 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:43:08 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:43:08 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:43:08 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=7158MB free_disk=25.386394500732422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 12:43:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:43:08 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBJGnqtH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:43:08 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:43:08 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57b917d-8a54-4321-a9dd-7abea2582d00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:43:09 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af58654-d4d5-446b-a121-2eb24a504c0f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6] added
Dec 06 12:43:09 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4e8bfb-6940-4d7b-bb1c-0ba229195aa8]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7189197f-6d18-45ef-98f5-3784b3aafeb8]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TFexDjIt {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TFexDjIt" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[579948d5-67fa-4ee3-85d8-1ba40bf989e3]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TFexDjIt'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a7ba0c-97f2-4e42-8451-610fdc4b426e]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a75e67-64d5-4a04-9be9-469a65fd2b22]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)
Dec 06 12:43:09 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)
Dec 06 12:43:09 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 70c4664e-ae7a-47de-bba7-18300391d209 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 782289e2-91cd-4aee-9a08-eadfb2a5965b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 4531bf11-b948-4d57-bf55-f33563815e26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance ec9eea5d-dc9a-4a65-881a-a89538e3a593 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance f0e26668-e253-409a-a011-a54e8ad3ebb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance dbb64a66-f500-407b-ae92-80f27eb6ce2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance f2e75618-9164-4527-a6a3-5f5195effccf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 12f40dad-65dc-4281-aa53-6036aa7e26d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance ed721541-3a94-496f-8b9d-88c74ac83ef7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 51c56231-9ff5-45a6-ad38-e7ac68124ed4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 940d69a3-4737-4e84-b077-fe2eff86753f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8c3d8e-fe7a-4c2b-806b-a339ac58c880]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6, portal: 172.16.0.220,3260]
Dec 06 12:43:09 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6, portal: 172.16.0.220,3260] successful.
Dec 06 12:43:09 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0faf101-75da-4742-80e2-b78c20f13a42]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f515db5-d4af-4f82-8b65-49df4f51eda8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)
Dec 06 12:43:09 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:09 user nova-compute[75247]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)
Dec 06 12:43:09 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] HCTL ('42', '-', '-', 0) found on session 13 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2dac35-70b4-43a4-be77-fc00634220c6]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Searching for a device in session 13 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFexDjIt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 12:43:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.989s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23030353530303730', 'path': '/dev/sdk'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030353530303730', 'path': '/dev/sdk'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.401s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG nova.objects.instance [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Lazy-loading 'flavor' on Instance uuid dbb64a66-f500-407b-ae92-80f27eb6ce2e {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f15689-444d-465e-819d-45cb3eb7adf7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:43:10 user nova-compute[75247]: No targets found.
Dec 06 12:43:10 user nova-compute[75247]: iSNS:
Dec 06 12:43:10 user nova-compute[75247]: No targets found.
Dec 06 12:43:10 user nova-compute[75247]: STATIC:
Dec 06 12:43:10 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8
Dec 06 12:43:10 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:10 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:10 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681
Dec 06 12:43:10 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:10 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:10 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8
Dec 06 12:43:10 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:10 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:10 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496
Dec 06 12:43:10 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:10 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:10 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e
Dec 06 12:43:10 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:10 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:10 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0
Dec 06 12:43:10 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:10 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:10 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a
Dec 06 12:43:10 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:10 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:10 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6
Dec 06 12:43:10 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:10 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:10 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c
Dec 06 12:43:10 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:10 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:10 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4
Dec 06 12:43:10 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:10 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:10 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482
Dec 06 12:43:10 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:10 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:10 user nova-compute[75247]: FIRMWARE:
Dec 06 12:43:10 user nova-compute[75247]: No targets found.
Dec 06 12:43:10 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:43:10 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:43:10 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3139ec0f-c2db-4546-9314-f977253e437a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[818957cd-abb9-4e64-b2fc-5b40d8f70c5f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:43:10 user nova-compute[75247]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)
Dec 06 12:43:10 user nova-compute[75247]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 (non-flash)
Dec 06 12:43:10 user nova-compute[75247]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:10 user nova-compute[75247]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:43:10 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:43:10 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:43:10 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:43:10 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:10 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:10 user nova-compute[75247]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)
Dec 06 12:43:10 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:43:10 user nova-compute[75247]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)
Dec 06 12:43:10 user nova-compute[75247]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 (non-flash)
Dec 06 12:43:10 user nova-compute[75247]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:10 user nova-compute[75247]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:43:10 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:43:10 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:43:10 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:43:10 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:10 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:10 user nova-compute[75247]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e (non-flash)
Dec 06 12:43:10 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd74b189c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e'): ({'sdg'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Removing single pathed devices sdg {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e123f9ac-902b-4975-9769-42111b679d37]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3257f46-9106-490d-8abd-69174ed8943d]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Flushing IO for device /dev/sdg {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[538577b8-f806-48b1-8a2c-7d0289a8279f]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1f9d7a-441d-42f9-812f-8813aabb0207]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] SCSI volumes sdg have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da3f28b-acb2-4356-a28e-81aba0c4db17]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3f963c-7561-4928-b784-f3d694ec1c66]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e, portal: 172.16.0.220,3260]
Dec 06 12:43:10 user nova-compute[75247]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e, portal: 172.16.0.220,3260] successful.
Dec 06 12:43:10 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f821cf-60c8-442a-aebe-b44741fb151e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[41baa2ee-481e-4eb4-958d-3897e4bb6fd7]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] <== disconnect_volume: return (1751ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:43:10 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 12:43:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] COPY block job progress, current cursor: 52428800 final cursor: 1073741824 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 12:43:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] COPY block job progress, current cursor: 140509184 final cursor: 1073741824 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 12:43:12 user nova-compute[75247]: DEBUG nova.objects.instance [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lazy-loading 'flavor' on Instance uuid f0e26668-e253-409a-a011-a54e8ad3ebb7 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:43:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1c473fae-aa5f-4a75-b3dd-438f2745dd83 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "f0e26668-e253-409a-a011-a54e8ad3ebb7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.267s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:12 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] COPY block job progress, current cursor: 255852544 final cursor: 1073741824 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 12:43:12 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] COPY block job progress, current cursor: 414187520 final cursor: 1073741824 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 12:43:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] COPY block job progress, current cursor: 547356672 final cursor: 1073741824 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 12:43:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "3e1b5197-dc38-48a5-b9f9-e053be499433" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:13 user nova-compute[75247]: DEBUG nova.compute.manager [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:43:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a0a396ac-44c1-4efd-82a2-b04816b9d284 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Acquiring lock "f0e26668-e253-409a-a011-a54e8ad3ebb7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a0a396ac-44c1-4efd-82a2-b04816b9d284 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "f0e26668-e253-409a-a011-a54e8ad3ebb7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a0a396ac-44c1-4efd-82a2-b04816b9d284 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Acquiring lock "f0e26668-e253-409a-a011-a54e8ad3ebb7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a0a396ac-44c1-4efd-82a2-b04816b9d284 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "f0e26668-e253-409a-a011-a54e8ad3ebb7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a0a396ac-44c1-4efd-82a2-b04816b9d284 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "f0e26668-e253-409a-a011-a54e8ad3ebb7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:13 user nova-compute[75247]: INFO nova.compute.manager [None req-a0a396ac-44c1-4efd-82a2-b04816b9d284 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Terminating instance
Dec 06 12:43:13 user nova-compute[75247]: DEBUG nova.compute.manager [None req-a0a396ac-44c1-4efd-82a2-b04816b9d284 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:43:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:13 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:43:13 user nova-compute[75247]: INFO nova.compute.claims [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Claim successful on node user
Dec 06 12:43:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] COPY block job progress, current cursor: 697303040 final cursor: 1073741824 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 12:43:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] COPY block job progress, current cursor: 851443712 final cursor: 1073741824 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG nova.compute.manager [req-25775939-5c79-4d83-97a3-5056e3f3bba0 req-a0387b67-96f5-4be2-8560-0dcd87907905 service nova] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Received event network-vif-unplugged-7ec9c7ac-57f1-42a5-b2ff-df899a930efd {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-25775939-5c79-4d83-97a3-5056e3f3bba0 req-a0387b67-96f5-4be2-8560-0dcd87907905 service nova] Acquiring lock "f0e26668-e253-409a-a011-a54e8ad3ebb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-25775939-5c79-4d83-97a3-5056e3f3bba0 req-a0387b67-96f5-4be2-8560-0dcd87907905 service nova] Lock "f0e26668-e253-409a-a011-a54e8ad3ebb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-25775939-5c79-4d83-97a3-5056e3f3bba0 req-a0387b67-96f5-4be2-8560-0dcd87907905 service nova] Lock "f0e26668-e253-409a-a011-a54e8ad3ebb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG nova.compute.manager [req-25775939-5c79-4d83-97a3-5056e3f3bba0 req-a0387b67-96f5-4be2-8560-0dcd87907905 service nova] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] No waiting events found dispatching network-vif-unplugged-7ec9c7ac-57f1-42a5-b2ff-df899a930efd {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG nova.compute.manager [req-25775939-5c79-4d83-97a3-5056e3f3bba0 req-a0387b67-96f5-4be2-8560-0dcd87907905 service nova] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Received event network-vif-unplugged-7ec9c7ac-57f1-42a5-b2ff-df899a930efd for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:43:14 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Instance destroyed successfully.
Dec 06 12:43:14 user nova-compute[75247]: DEBUG nova.objects.instance [None req-a0a396ac-44c1-4efd-82a2-b04816b9d284 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lazy-loading 'resources' on Instance uuid f0e26668-e253-409a-a011-a54e8ad3ebb7 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-a0a396ac-44c1-4efd-82a2-b04816b9d284 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:40:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1365250011',display_name='tempest-AttachSCSIVolumeTestJSON-server-1365250011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1365250011',id=7,image_ref='2d2536e6-9076-431d-93fe-0b9e2aab6535',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYvF1ysQZxUe4KQhuyUVnV9QSYlchajcSK3qwIxMdZr23Agz8JiRew/YgxFEv9EL4qHm105P9w5kIftabmGUNLzNf9pcaNrf1cXlMNQUy9csFJIy3rMOEiCkrFoB0TJLA==',key_name='tempest-keypair-552943027',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:40:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92ed07eb8a8d4dfe9ba6bd8af697f1e6',ramdisk_id='',reservation_id='r-u41oipq7',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2d2536e6-9076-431d-93fe-0b9e2aab6535',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-490069061',owner_user_name='tempest-AttachSCSIVolumeTestJSON-490069061-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:40:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f734dd5ead24a3bbddace417e18bbbb',uuid=f0e26668-e253-409a-a011-a54e8ad3ebb7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ec9c7ac-57f1-42a5-b2ff-df899a930efd", "address": "fa:16:3e:ae:36:46", "network": {"id": "a3353b80-0ced-43e4-8cea-c98cd7d8c132", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638714784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ed07eb8a8d4dfe9ba6bd8af697f1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ec9c7ac-57", "ovs_interfaceid": "7ec9c7ac-57f1-42a5-b2ff-df899a930efd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-a0a396ac-44c1-4efd-82a2-b04816b9d284 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Converting VIF {"id": "7ec9c7ac-57f1-42a5-b2ff-df899a930efd", "address": "fa:16:3e:ae:36:46", "network": {"id": "a3353b80-0ced-43e4-8cea-c98cd7d8c132", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638714784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ed07eb8a8d4dfe9ba6bd8af697f1e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ec9c7ac-57", "ovs_interfaceid": "7ec9c7ac-57f1-42a5-b2ff-df899a930efd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-a0a396ac-44c1-4efd-82a2-b04816b9d284 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:36:46,bridge_name='br-int',has_traffic_filtering=True,id=7ec9c7ac-57f1-42a5-b2ff-df899a930efd,network=Network(a3353b80-0ced-43e4-8cea-c98cd7d8c132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ec9c7ac-57') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG os_vif [None req-a0a396ac-44c1-4efd-82a2-b04816b9d284 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:36:46,bridge_name='br-int',has_traffic_filtering=True,id=7ec9c7ac-57f1-42a5-b2ff-df899a930efd,network=Network(a3353b80-0ced-43e4-8cea-c98cd7d8c132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ec9c7ac-57') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ec9c7ac-57, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1692eb9-fe7f-4dad-a088-fffa5800c9f7) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:14 user nova-compute[75247]: INFO os_vif [None req-a0a396ac-44c1-4efd-82a2-b04816b9d284 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:36:46,bridge_name='br-int',has_traffic_filtering=True,id=7ec9c7ac-57f1-42a5-b2ff-df899a930efd,network=Network(a3353b80-0ced-43e4-8cea-c98cd7d8c132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ec9c7ac-57')
Dec 06 12:43:14 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-a0a396ac-44c1-4efd-82a2-b04816b9d284 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Deleting instance files /opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7_del
Dec 06 12:43:14 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-a0a396ac-44c1-4efd-82a2-b04816b9d284 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Deletion of /opt/stack/data/nova/instances/f0e26668-e253-409a-a011-a54e8ad3ebb7_del complete
Dec 06 12:43:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.982s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG nova.compute.manager [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:43:14 user nova-compute[75247]: INFO nova.compute.manager [None req-a0a396ac-44c1-4efd-82a2-b04816b9d284 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Took 1.13 seconds to destroy the instance on the hypervisor.
Dec 06 12:43:14 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-a0a396ac-44c1-4efd-82a2-b04816b9d284 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] COPY block job progress, current cursor: 1020264448 final cursor: 1073741824 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG nova.compute.manager [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:43:14 user nova-compute[75247]: DEBUG nova.network.neutron [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:43:15 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:43:15 user nova-compute[75247]: DEBUG nova.compute.manager [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:43:15 user nova-compute[75247]: INFO nova.virt.block_device [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Booting with blank volume at /dev/vda
Dec 06 12:43:15 user nova-compute[75247]: DEBUG nova.policy [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0efa55fc4754d96a33d07d52342d8f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222da79e3583495d90d5442029996343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycZYnIDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:43:15 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:43:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6775574f-8a76-43fd-8413-5debea043942]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:43:15 user nova-compute[75247]: No targets found.
Dec 06 12:43:15 user nova-compute[75247]: iSNS:
Dec 06 12:43:15 user nova-compute[75247]: No targets found.
Dec 06 12:43:15 user nova-compute[75247]: STATIC:
Dec 06 12:43:15 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8
Dec 06 12:43:15 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:15 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:15 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681
Dec 06 12:43:15 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:15 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:15 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8
Dec 06 12:43:15 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:15 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:15 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496
Dec 06 12:43:15 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:15 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:15 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0
Dec 06 12:43:15 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:15 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:15 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a
Dec 06 12:43:15 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:15 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:15 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6
Dec 06 12:43:15 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:15 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:15 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c
Dec 06 12:43:15 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:15 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:15 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4
Dec 06 12:43:15 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:15 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:15 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482
Dec 06 12:43:15 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:15 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:15 user nova-compute[75247]: FIRMWARE:
Dec 06 12:43:15 user nova-compute[75247]: No targets found.
Dec 06 12:43:15 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:43:15 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:43:15 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c29cba-f5fb-408e-8a29-7074d8686b81]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ed3620-61e6-4095-9f38-76810a70f9cf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:43:15 user nova-compute[75247]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)
Dec 06 12:43:15 user nova-compute[75247]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 (non-flash)
Dec 06 12:43:15 user nova-compute[75247]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:15 user nova-compute[75247]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:43:15 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:43:15 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:43:15 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:43:15 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:15 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:15 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:43:15 user nova-compute[75247]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)
Dec 06 12:43:15 user nova-compute[75247]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 (non-flash)
Dec 06 12:43:15 user nova-compute[75247]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:15 user nova-compute[75247]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:43:15 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:43:15 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:43:15 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:43:15 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:15 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:15 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd7302f7c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8'): ({'sdi'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Removing single pathed devices sdi {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5d1e6e-4aba-40e9-b393-c11c2633b27e]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b9a69e-40aa-4b62-9366-7e3d118945da]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Flushing IO for device /dev/sdi {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[753a218b-29a7-4f4f-8824-dc35ca60c1d9]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:15 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f2e75618-9164-4527-a6a3-5f5195effccf is timed out.
Dec 06 12:43:15 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Successfully detached device vdb from instance f2e75618-9164-4527-a6a3-5f5195effccf from the live domain config.
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.031s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fc725b-04f5-441b-a66a-c17214830829]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] SCSI volumes sdi have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AxTqkZFQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:43:15 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:43:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[092753df-5371-44a8-96ae-a18e6939ce42]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67c682b-3d39-4064-a176-962c144528ed]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8, portal: 172.16.0.220,3260]
Dec 06 12:43:15 user nova-compute[75247]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8, portal: 172.16.0.220,3260] successful.
Dec 06 12:43:15 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bd735b-302a-4e72-b97e-c45f146e8270]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] <== disconnect_volume: return (351ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.144s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48c1dde-7ba4-4812-8547-38c8a9b219f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:43:15 user nova-compute[75247]: No targets found.
Dec 06 12:43:15 user nova-compute[75247]: iSNS:
Dec 06 12:43:15 user nova-compute[75247]: No targets found.
Dec 06 12:43:15 user nova-compute[75247]: STATIC:
Dec 06 12:43:15 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8
Dec 06 12:43:15 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:15 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:15 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681
Dec 06 12:43:15 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:15 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:15 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496
Dec 06 12:43:15 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:15 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:15 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0
Dec 06 12:43:15 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:15 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:15 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a
Dec 06 12:43:15 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:15 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:15 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6
Dec 06 12:43:15 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:15 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:15 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c
Dec 06 12:43:15 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:15 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:15 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4
Dec 06 12:43:15 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:15 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:15 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482
Dec 06 12:43:15 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:15 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:15 user nova-compute[75247]: FIRMWARE:
Dec 06 12:43:15 user nova-compute[75247]: No targets found.
Dec 06 12:43:15 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:43:15 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:43:15 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:43:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7d386b-47be-4f57-abe4-c2b09f5c4b36]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFexDjIt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': 'dbb64a66-f500-407b-ae92-80f27eb6ce2e', 'attached_at': '', 'detached_at': '', 'volume_id': 'a981a788-9ae3-41c7-b06f-3b797b194bf6', 'serial'} {{(pid=75247) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] swap_volume: removing Cinder connection for volume 82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 {{(pid=75247) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde2dec3-f05a-490f-8b09-e87e8a0470cd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)
Dec 06 12:43:16 user nova-compute[75247]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 (non-flash)
Dec 06 12:43:16 user nova-compute[75247]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:16 user nova-compute[75247]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:43:16 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:43:16 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:43:16 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:43:16 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:16 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:16 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a (non-flash)
Dec 06 12:43:16 user nova-compute[75247]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 (non-flash)
Dec 06 12:43:16 user nova-compute[75247]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:16 user nova-compute[75247]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:43:16 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:43:16 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:43:16 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:43:16 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:16 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:16 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c613f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a'): ({'sdj'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Removing single pathed devices sdj {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[88517327-7024-45e9-b5ed-b038c04352a3]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8525a6a5-1665-47b5-9784-34b802f97c06]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Flushing IO for device /dev/sdj {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea61cfbc-e894-496a-b99e-73a2fca195c1]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.192s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[916043ae-99bc-4a57-98aa-0cc55deae608]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] SCSI volumes sdj have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[879f207e-9fa4-4640-b8c6-3c85c1886d33]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09425c6-37dd-48ef-8870-ef4553228aa5]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a, portal: 172.16.0.220,3260]
Dec 06 12:43:16 user nova-compute[75247]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a, portal: 172.16.0.220,3260] successful.
Dec 06 12:43:16 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8533adbe-4090-4aea-84e0-2d8099bc334a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.099s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[762d10b0-f85e-4ea5-9d48-5174494c74e2]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.568s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] <== disconnect_volume: return (711ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG nova.compute.manager [req-12e63603-a093-47d4-b8cd-0d87eeb9ceb2 req-63e64382-ddd6-43ae-98ca-f125b054608a service nova] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Received event network-vif-plugged-7ec9c7ac-57f1-42a5-b2ff-df899a930efd {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-12e63603-a093-47d4-b8cd-0d87eeb9ceb2 req-63e64382-ddd6-43ae-98ca-f125b054608a service nova] Acquiring lock "f0e26668-e253-409a-a011-a54e8ad3ebb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-12e63603-a093-47d4-b8cd-0d87eeb9ceb2 req-63e64382-ddd6-43ae-98ca-f125b054608a service nova] Lock "f0e26668-e253-409a-a011-a54e8ad3ebb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-12e63603-a093-47d4-b8cd-0d87eeb9ceb2 req-63e64382-ddd6-43ae-98ca-f125b054608a service nova] Lock "f0e26668-e253-409a-a011-a54e8ad3ebb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG nova.compute.manager [req-12e63603-a093-47d4-b8cd-0d87eeb9ceb2 req-63e64382-ddd6-43ae-98ca-f125b054608a service nova] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] No waiting events found dispatching network-vif-plugged-7ec9c7ac-57f1-42a5-b2ff-df899a930efd {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:43:16 user nova-compute[75247]: WARNING nova.compute.manager [req-12e63603-a093-47d4-b8cd-0d87eeb9ceb2 req-63e64382-ddd6-43ae-98ca-f125b054608a service nova] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Received unexpected event network-vif-plugged-7ec9c7ac-57f1-42a5-b2ff-df899a930efd for instance with vm_state active and task_state deleting.
Dec 06 12:43:16 user nova-compute[75247]: DEBUG nova.compute.manager [req-12e63603-a093-47d4-b8cd-0d87eeb9ceb2 req-63e64382-ddd6-43ae-98ca-f125b054608a service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-changed-ce9cf139-5123-474a-b4ea-0880d5b48d27 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG nova.compute.manager [req-12e63603-a093-47d4-b8cd-0d87eeb9ceb2 req-63e64382-ddd6-43ae-98ca-f125b054608a service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Refreshing instance network info cache due to event network-changed-ce9cf139-5123-474a-b4ea-0880d5b48d27. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-12e63603-a093-47d4-b8cd-0d87eeb9ceb2 req-63e64382-ddd6-43ae-98ca-f125b054608a service nova] Acquiring lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-12e63603-a093-47d4-b8cd-0d87eeb9ceb2 req-63e64382-ddd6-43ae-98ca-f125b054608a service nova] Acquired lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:43:16 user nova-compute[75247]: DEBUG nova.network.neutron [req-12e63603-a093-47d4-b8cd-0d87eeb9ceb2 req-63e64382-ddd6-43ae-98ca-f125b054608a service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Refreshing network info cache for port ce9cf139-5123-474a-b4ea-0880d5b48d27 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:43:17 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] swap_volume: Updating volume 82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "TFexDjIt", "auth_password": "7J2lfSgH9Quint", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "a981a788-9ae3-41c7-b06f-3b797b194bf6"}, "status": "reserved", "instance": "dbb64a66-f500-407b-ae92-80f27eb6ce2e", "attached_at": "", "detached_at": "", "volume_id": "a981a788-9ae3-41c7-b06f-3b797b194bf6", "serial": "a981a788-9ae3-41c7-b06f-3b797b194bf6"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a981a788-9ae3-41c7-b06f-3b797b194bf6', 'no_device': None, 'attachment_id': '82c261f6-a27b-4839-b4e8-290313796611'} {{(pid=75247) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Dec 06 12:43:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f7b8e8b8-4c7e-4875-a4f5-a1f93a06c126 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 26.698s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:17 user nova-compute[75247]: DEBUG nova.network.neutron [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Successfully created port: f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:43:17 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:43:17 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Took 2.56 seconds to deallocate network for instance.
Dec 06 12:43:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a0a396ac-44c1-4efd-82a2-b04816b9d284 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a0a396ac-44c1-4efd-82a2-b04816b9d284 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:17 user nova-compute[75247]: DEBUG nova.objects.instance [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lazy-loading 'flavor' on Instance uuid f2e75618-9164-4527-a6a3-5f5195effccf {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:43:17 user nova-compute[75247]: DEBUG nova.network.neutron [req-12e63603-a093-47d4-b8cd-0d87eeb9ceb2 req-63e64382-ddd6-43ae-98ca-f125b054608a service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Updated VIF entry in instance network info cache for port ce9cf139-5123-474a-b4ea-0880d5b48d27. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:43:17 user nova-compute[75247]: DEBUG nova.network.neutron [req-12e63603-a093-47d4-b8cd-0d87eeb9ceb2 req-63e64382-ddd6-43ae-98ca-f125b054608a service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Updating instance_info_cache with network_info: [{"id": "ce9cf139-5123-474a-b4ea-0880d5b48d27", "address": "fa:16:3e:67:4c:8e", "network": {"id": "c6a1a892-2161-4aae-9790-3c6e03f34389", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1604742206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9cf139-51", "ovs_interfaceid": "ce9cf139-5123-474a-b4ea-0880d5b48d27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a20eb2f0-1219-4738-9733-7bf8618ac75d", "address": "fa:16:3e:81:34:c2", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20eb2f0-12", "ovs_interfaceid": "a20eb2f0-1219-4738-9733-7bf8618ac75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "650ff76d-5da3-40b6-a2f7-3c9bcfa49a51", "address": "fa:16:3e:6b:d5:f0", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650ff76d-5d", "ovs_interfaceid": "650ff76d-5da3-40b6-a2f7-3c9bcfa49a51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d9b37b6-a28d-4028-ac06-9cd7685d403f", "address": "fa:16:3e:59:b1:a2", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9b37b6-a2", "ovs_interfaceid": "3d9b37b6-a28d-4028-ac06-9cd7685d403f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6", "address": "fa:16:3e:ad:ba:c7", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa60734-d8", "ovs_interfaceid": "7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9384778-27c0-459c-90f1-512f3f1bbda5", "address": "fa:16:3e:6e:01:3c", "network": {"id": "25876878-6a68-4cc1-9332-822c5778b8da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1585990936", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9384778-27", "ovs_interfaceid": "f9384778-27c0-459c-90f1-512f3f1bbda5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b94c5e7-0a3d-43d9-9c8a-35badae08754", "address": "fa:16:3e:e1:9f:73", "network": {"id": "25876878-6a68-4cc1-9332-822c5778b8da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1585990936", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b94c5e7-0a", "ovs_interfaceid": "0b94c5e7-0a3d-43d9-9c8a-35badae08754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:43:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-12e63603-a093-47d4-b8cd-0d87eeb9ceb2 req-63e64382-ddd6-43ae-98ca-f125b054608a service nova] Releasing lock "refresh_cache-51c56231-9ff5-45a6-ad38-e7ac68124ed4" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:43:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-cfa7dfc2-a955-4cf9-8dc6-4025f1f8e35e tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "f2e75618-9164-4527-a6a3-5f5195effccf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.752s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:17 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-a0a396ac-44c1-4efd-82a2-b04816b9d284 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:43:17 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-a0a396ac-44c1-4efd-82a2-b04816b9d284 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a0a396ac-44c1-4efd-82a2-b04816b9d284 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.473s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Acquiring lock "interface-f2e75618-9164-4527-a6a3-5f5195effccf-4b46350b-531d-4f9c-89eb-1ebab7067497" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "interface-f2e75618-9164-4527-a6a3-5f5195effccf-4b46350b-531d-4f9c-89eb-1ebab7067497" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:18 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-a0a396ac-44c1-4efd-82a2-b04816b9d284 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Deleted allocations for instance f0e26668-e253-409a-a011-a54e8ad3ebb7
Dec 06 12:43:18 user nova-compute[75247]: DEBUG nova.objects.instance [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lazy-loading 'flavor' on Instance uuid f2e75618-9164-4527-a6a3-5f5195effccf {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1618747013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1618747013',id=9,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJqUDXevj4gXj7N7wpZj/XCteR5V+dPOM68FsqKu9Fudl378/ktu9MdzbbKdcoiSMygbRXxj+WBcn7A30ZdIiAz+sQjvUKqzGUuXAmht+5SuCJrZIb25AK4InwaKc1iVg==',key_name='tempest-keypair-76799662',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:40:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4031371ec46d42c2bd887bac7edf42a4',ramdisk_id='',reservation_id='r-ouoqw3qc',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1141791142',owner_user_name='tempest-TaggedAttachmentsTest-1141791142-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:40:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14563ea794be4e5bb54c7b4cabde8ee0',uuid=f2e75618-9164-4527-a6a3-5f5195effccf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b46350b-531d-4f9c-89eb-1ebab7067497", "address": "fa:16:3e:5d:69:9f", "network": {"id": "a51d59c1-8168-46ad-a649-919cd6307bb7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1124351624", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b46350b-53", "ovs_interfaceid": "4b46350b-531d-4f9c-89eb-1ebab7067497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Converting VIF {"id": "4b46350b-531d-4f9c-89eb-1ebab7067497", "address": "fa:16:3e:5d:69:9f", "network": {"id": "a51d59c1-8168-46ad-a649-919cd6307bb7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1124351624", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b46350b-53", "ovs_interfaceid": "4b46350b-531d-4f9c-89eb-1ebab7067497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:69:9f,bridge_name='br-int',has_traffic_filtering=True,id=4b46350b-531d-4f9c-89eb-1ebab7067497,network=Network(a51d59c1-8168-46ad-a649-919cd6307bb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b46350b-53') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5d:69:9f"/><model type="virtio"/><mtu size="1442"/><target dev="tap4b46350b-53"/></interface> {{(pid=75247) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5d:69:9f"/><model type="virtio"/><mtu size="1442"/><target dev="tap4b46350b-53"/></interface> {{(pid=75247) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Attempting to detach device tap4b46350b-53 from instance f2e75618-9164-4527-a6a3-5f5195effccf from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] detach device xml: <interface type="ethernet">
Dec 06 12:43:18 user nova-compute[75247]:   <mac address="fa:16:3e:5d:69:9f"/>
Dec 06 12:43:18 user nova-compute[75247]:   <model type="virtio"/>
Dec 06 12:43:18 user nova-compute[75247]:   <mtu size="1442"/>
Dec 06 12:43:18 user nova-compute[75247]:   <target dev="tap4b46350b-53"/>
Dec 06 12:43:18 user nova-compute[75247]: </interface>
Dec 06 12:43:18 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG nova.network.neutron [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Successfully updated port: f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5d:69:9f"/><model type="virtio"/><mtu size="1442"/><target dev="tap4b46350b-53"/></interface> {{(pid=75247) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "refresh_cache-3e1b5197-dc38-48a5-b9f9-e053be499433" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquired lock "refresh_cache-3e1b5197-dc38-48a5-b9f9-e053be499433" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG nova.network.neutron [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:5d:69:9f"/><model type="virtio"/><mtu size="1442"/><target dev="tap4b46350b-53"/></interface>not found in domain: <domain type='kvm' id='9'>
Dec 06 12:43:18 user nova-compute[75247]:   <name>instance-00000009</name>
Dec 06 12:43:18 user nova-compute[75247]:   <uuid>f2e75618-9164-4527-a6a3-5f5195effccf</uuid>
Dec 06 12:43:18 user nova-compute[75247]:   <metadata>
Dec 06 12:43:18 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:43:18 user nova-compute[75247]:   <nova:package version="0.0.0"/>
Dec 06 12:43:18 user nova-compute[75247]:   <nova:name>tempest-device-tagging-server-1618747013</nova:name>
Dec 06 12:43:18 user nova-compute[75247]:   <nova:creationTime>2023-12-06 12:42:39</nova:creationTime>
Dec 06 12:43:18 user nova-compute[75247]:   <nova:flavor name="m1.tiny">
Dec 06 12:43:18 user nova-compute[75247]:     <nova:memory>512</nova:memory>
Dec 06 12:43:18 user nova-compute[75247]:     <nova:disk>1</nova:disk>
Dec 06 12:43:18 user nova-compute[75247]:     <nova:swap>0</nova:swap>
Dec 06 12:43:18 user nova-compute[75247]:     <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:43:18 user nova-compute[75247]:     <nova:vcpus>1</nova:vcpus>
Dec 06 12:43:18 user nova-compute[75247]:   </nova:flavor>
Dec 06 12:43:18 user nova-compute[75247]:   <nova:owner>
Dec 06 12:43:18 user nova-compute[75247]:     <nova:user uuid="14563ea794be4e5bb54c7b4cabde8ee0">tempest-TaggedAttachmentsTest-1141791142-project-member</nova:user>
Dec 06 12:43:18 user nova-compute[75247]:     <nova:project uuid="4031371ec46d42c2bd887bac7edf42a4">tempest-TaggedAttachmentsTest-1141791142</nova:project>
Dec 06 12:43:18 user nova-compute[75247]:   </nova:owner>
Dec 06 12:43:18 user nova-compute[75247]:   <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:43:18 user nova-compute[75247]:   <nova:ports>
Dec 06 12:43:18 user nova-compute[75247]:     <nova:port uuid="68ab6435-5cd9-45bf-891c-c20b68415e11">
Dec 06 12:43:18 user nova-compute[75247]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 12:43:18 user nova-compute[75247]:     </nova:port>
Dec 06 12:43:18 user nova-compute[75247]:     <nova:port uuid="4b46350b-531d-4f9c-89eb-1ebab7067497">
Dec 06 12:43:18 user nova-compute[75247]:       <nova:ip type="fixed" address="10.10.10.66" ipVersion="4"/>
Dec 06 12:43:18 user nova-compute[75247]:     </nova:port>
Dec 06 12:43:18 user nova-compute[75247]:   </nova:ports>
Dec 06 12:43:18 user nova-compute[75247]: </nova:instance>
Dec 06 12:43:18 user nova-compute[75247]:   </metadata>
Dec 06 12:43:18 user nova-compute[75247]:   <memory unit='KiB'>524288</memory>
Dec 06 12:43:18 user nova-compute[75247]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 06 12:43:18 user nova-compute[75247]:   <vcpu placement='static'>1</vcpu>
Dec 06 12:43:18 user nova-compute[75247]:   <resource>
Dec 06 12:43:18 user nova-compute[75247]:     <partition>/machine</partition>
Dec 06 12:43:18 user nova-compute[75247]:   </resource>
Dec 06 12:43:18 user nova-compute[75247]:   <sysinfo type='smbios'>
Dec 06 12:43:18 user nova-compute[75247]:     <system>
Dec 06 12:43:18 user nova-compute[75247]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 06 12:43:18 user nova-compute[75247]:       <entry name='product'>OpenStack Nova</entry>
Dec 06 12:43:18 user nova-compute[75247]:       <entry name='version'>0.0.0</entry>
Dec 06 12:43:18 user nova-compute[75247]:       <entry name='serial'>f2e75618-9164-4527-a6a3-5f5195effccf</entry>
Dec 06 12:43:18 user nova-compute[75247]:       <entry name='uuid'>f2e75618-9164-4527-a6a3-5f5195effccf</entry>
Dec 06 12:43:18 user nova-compute[75247]:       <entry name='family'>Virtual Machine</entry>
Dec 06 12:43:18 user nova-compute[75247]:     </system>
Dec 06 12:43:18 user nova-compute[75247]:   </sysinfo>
Dec 06 12:43:18 user nova-compute[75247]:   <os>
Dec 06 12:43:18 user nova-compute[75247]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 06 12:43:18 user nova-compute[75247]:     <boot dev='hd'/>
Dec 06 12:43:18 user nova-compute[75247]:     <smbios mode='sysinfo'/>
Dec 06 12:43:18 user nova-compute[75247]:   </os>
Dec 06 12:43:18 user nova-compute[75247]:   <features>
Dec 06 12:43:18 user nova-compute[75247]:     <acpi/>
Dec 06 12:43:18 user nova-compute[75247]:     <apic/>
Dec 06 12:43:18 user nova-compute[75247]:     <vmcoreinfo state='on'/>
Dec 06 12:43:18 user nova-compute[75247]:   </features>
Dec 06 12:43:18 user nova-compute[75247]:   <cpu mode='custom' match='exact' check='full'>
Dec 06 12:43:18 user nova-compute[75247]:     <model fallback='forbid'>Nehalem</model>
Dec 06 12:43:18 user nova-compute[75247]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 06 12:43:18 user nova-compute[75247]:     <feature policy='require' name='vme'/>
Dec 06 12:43:18 user nova-compute[75247]:     <feature policy='require' name='x2apic'/>
Dec 06 12:43:18 user nova-compute[75247]:     <feature policy='require' name='hypervisor'/>
Dec 06 12:43:18 user nova-compute[75247]:   </cpu>
Dec 06 12:43:18 user nova-compute[75247]:   <clock offset='utc'>
Dec 06 12:43:18 user nova-compute[75247]:     <timer name='pit' tickpolicy='delay'/>
Dec 06 12:43:18 user nova-compute[75247]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 06 12:43:18 user nova-compute[75247]:     <timer name='hpet' present='no'/>
Dec 06 12:43:18 user nova-compute[75247]:   </clock>
Dec 06 12:43:18 user nova-compute[75247]:   <on_poweroff>destroy</on_poweroff>
Dec 06 12:43:18 user nova-compute[75247]:   <on_reboot>restart</on_reboot>
Dec 06 12:43:18 user nova-compute[75247]:   <on_crash>destroy</on_crash>
Dec 06 12:43:18 user nova-compute[75247]:   <devices>
Dec 06 12:43:18 user nova-compute[75247]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 06 12:43:18 user nova-compute[75247]:     <disk type='file' device='disk'>
Dec 06 12:43:18 user nova-compute[75247]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 06 12:43:18 user nova-compute[75247]:       <source file='/opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk' index='2'/>
Dec 06 12:43:18 user nova-compute[75247]:       <backingStore type='file' index='3'>
Dec 06 12:43:18 user nova-compute[75247]:         <format type='raw'/>
Dec 06 12:43:18 user nova-compute[75247]:         <source file='/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec'/>
Dec 06 12:43:18 user nova-compute[75247]:         <backingStore/>
Dec 06 12:43:18 user nova-compute[75247]:       </backingStore>
Dec 06 12:43:18 user nova-compute[75247]:       <target dev='vda' bus='virtio'/>
Dec 06 12:43:18 user nova-compute[75247]:       <alias name='virtio-disk0'/>
Dec 06 12:43:18 user nova-compute[75247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 06 12:43:18 user nova-compute[75247]:     </disk>
Dec 06 12:43:18 user nova-compute[75247]:     <disk type='file' device='cdrom'>
Dec 06 12:43:18 user nova-compute[75247]:       <driver name='qemu' type='raw' cache='none'/>
Dec 06 12:43:18 user nova-compute[75247]:       <source file='/opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk.config' index='1'/>
Dec 06 12:43:18 user nova-compute[75247]:       <backingStore/>
Dec 06 12:43:18 user nova-compute[75247]:       <target dev='hda' bus='ide'/>
Dec 06 12:43:18 user nova-compute[75247]:       <readonly/>
Dec 06 12:43:18 user nova-compute[75247]:       <alias name='ide0-0-0'/>
Dec 06 12:43:18 user nova-compute[75247]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 06 12:43:18 user nova-compute[75247]:     </disk>
Dec 06 12:43:18 user nova-compute[75247]:     <controller type='usb' index='0' model='none'>
Dec 06 12:43:18 user nova-compute[75247]:       <alias name='usb'/>
Dec 06 12:43:18 user nova-compute[75247]:     </controller>
Dec 06 12:43:18 user nova-compute[75247]:     <controller type='pci' index='0' model='pci-root'>
Dec 06 12:43:18 user nova-compute[75247]:       <alias name='pci.0'/>
Dec 06 12:43:18 user nova-compute[75247]:     </controller>
Dec 06 12:43:18 user nova-compute[75247]:     <controller type='ide' index='0'>
Dec 06 12:43:18 user nova-compute[75247]:       <alias name='ide'/>
Dec 06 12:43:18 user nova-compute[75247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 06 12:43:18 user nova-compute[75247]:     </controller>
Dec 06 12:43:18 user nova-compute[75247]:     <interface type='ethernet'>
Dec 06 12:43:18 user nova-compute[75247]:       <mac address='fa:16:3e:b0:12:84'/>
Dec 06 12:43:18 user nova-compute[75247]:       <target dev='tap68ab6435-5c'/>
Dec 06 12:43:18 user nova-compute[75247]:       <model type='virtio'/>
Dec 06 12:43:18 user nova-compute[75247]:       <mtu size='1442'/>
Dec 06 12:43:18 user nova-compute[75247]:       <alias name='net0'/>
Dec 06 12:43:18 user nova-compute[75247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 06 12:43:18 user nova-compute[75247]:     </interface>
Dec 06 12:43:18 user nova-compute[75247]:     <interface type='ethernet'>
Dec 06 12:43:18 user nova-compute[75247]:       <mac address='fa:16:3e:5d:69:9f'/>
Dec 06 12:43:18 user nova-compute[75247]:       <target dev='tap4b46350b-53'/>
Dec 06 12:43:18 user nova-compute[75247]:       <model type='virtio'/>
Dec 06 12:43:18 user nova-compute[75247]:       <mtu size='1442'/>
Dec 06 12:43:18 user nova-compute[75247]:       <alias name='net1'/>
Dec 06 12:43:18 user nova-compute[75247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Dec 06 12:43:18 user nova-compute[75247]:     </interface>
Dec 06 12:43:18 user nova-compute[75247]:     <serial type='pty'>
Dec 06 12:43:18 user nova-compute[75247]:       <source path='/dev/pts/8'/>
Dec 06 12:43:18 user nova-compute[75247]:       <log file='/opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/console.log' append='off'/>
Dec 06 12:43:18 user nova-compute[75247]:       <target type='isa-serial' port='0'>
Dec 06 12:43:18 user nova-compute[75247]:         <model name='isa-serial'/>
Dec 06 12:43:18 user nova-compute[75247]:       </target>
Dec 06 12:43:18 user nova-compute[75247]:       <alias name='serial0'/>
Dec 06 12:43:18 user nova-compute[75247]:     </serial>
Dec 06 12:43:18 user nova-compute[75247]:     <console type='pty' tty='/dev/pts/8'>
Dec 06 12:43:18 user nova-compute[75247]:       <source path='/dev/pts/8'/>
Dec 06 12:43:18 user nova-compute[75247]:       <log file='/opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/console.log' append='off'/>
Dec 06 12:43:18 user nova-compute[75247]:       <target type='serial' port='0'/>
Dec 06 12:43:18 user nova-compute[75247]:       <alias name='serial0'/>
Dec 06 12:43:18 user nova-compute[75247]:     </console>
Dec 06 12:43:18 user nova-compute[75247]:     <input type='mouse' bus='ps2'>
Dec 06 12:43:18 user nova-compute[75247]:       <alias name='input0'/>
Dec 06 12:43:18 user nova-compute[75247]:     </input>
Dec 06 12:43:18 user nova-compute[75247]:     <input type='keyboard' bus='ps2'>
Dec 06 12:43:18 user nova-compute[75247]:       <alias name='input1'/>
Dec 06 12:43:18 user nova-compute[75247]:     </input>
Dec 06 12:43:18 user nova-compute[75247]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Dec 06 12:43:18 user nova-compute[75247]:       <listen type='address' address='0.0.0.0'/>
Dec 06 12:43:18 user nova-compute[75247]:     </graphics>
Dec 06 12:43:18 user nova-compute[75247]:     <audio id='1' type='none'/>
Dec 06 12:43:18 user nova-compute[75247]:     <video>
Dec 06 12:43:18 user nova-compute[75247]:       <model type='virtio' heads='1' primary='yes'/>
Dec 06 12:43:18 user nova-compute[75247]:       <alias name='video0'/>
Dec 06 12:43:18 user nova-compute[75247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 06 12:43:18 user nova-compute[75247]:     </video>
Dec 06 12:43:18 user nova-compute[75247]:     <memballoon model='virtio'>
Dec 06 12:43:18 user nova-compute[75247]:       <stats period='10'/>
Dec 06 12:43:18 user nova-compute[75247]:       <alias name='balloon0'/>
Dec 06 12:43:18 user nova-compute[75247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 06 12:43:18 user nova-compute[75247]:     </memballoon>
Dec 06 12:43:18 user nova-compute[75247]:     <rng model='virtio'>
Dec 06 12:43:18 user nova-compute[75247]:       <backend model='random'>/dev/urandom</backend>
Dec 06 12:43:18 user nova-compute[75247]:       <alias name='rng0'/>
Dec 06 12:43:18 user nova-compute[75247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 06 12:43:18 user nova-compute[75247]:     </rng>
Dec 06 12:43:18 user nova-compute[75247]:   </devices>
Dec 06 12:43:18 user nova-compute[75247]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 06 12:43:18 user nova-compute[75247]:     <label>libvirt-f2e75618-9164-4527-a6a3-5f5195effccf</label>
Dec 06 12:43:18 user nova-compute[75247]:     <imagelabel>libvirt-f2e75618-9164-4527-a6a3-5f5195effccf</imagelabel>
Dec 06 12:43:18 user nova-compute[75247]:   </seclabel>
Dec 06 12:43:18 user nova-compute[75247]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 06 12:43:18 user nova-compute[75247]:     <label>+64055:+108</label>
Dec 06 12:43:18 user nova-compute[75247]:     <imagelabel>+64055:+108</imagelabel>
Dec 06 12:43:18 user nova-compute[75247]:   </seclabel>
Dec 06 12:43:18 user nova-compute[75247]: </domain>
Dec 06 12:43:18 user nova-compute[75247]:  {{(pid=75247) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 06 12:43:18 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Successfully detached device tap4b46350b-53 from instance f2e75618-9164-4527-a6a3-5f5195effccf from the persistent domain config.
Dec 06 12:43:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] (1/8): Attempting to detach device tap4b46350b-53 with device alias net1 from instance f2e75618-9164-4527-a6a3-5f5195effccf from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] detach device xml: <interface type="ethernet">
Dec 06 12:43:18 user nova-compute[75247]:   <mac address="fa:16:3e:5d:69:9f"/>
Dec 06 12:43:18 user nova-compute[75247]:   <model type="virtio"/>
Dec 06 12:43:18 user nova-compute[75247]:   <mtu size="1442"/>
Dec 06 12:43:18 user nova-compute[75247]:   <target dev="tap4b46350b-53"/>
Dec 06 12:43:18 user nova-compute[75247]: </interface>
Dec 06 12:43:18 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a0a396ac-44c1-4efd-82a2-b04816b9d284 tempest-AttachSCSIVolumeTestJSON-490069061 tempest-AttachSCSIVolumeTestJSON-490069061-project-member] Lock "f0e26668-e253-409a-a011-a54e8ad3ebb7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.443s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG nova.network.neutron [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Start waiting for the detach event from libvirt for device tap4b46350b-53 with device alias net1 for instance f2e75618-9164-4527-a6a3-5f5195effccf {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG nova.network.neutron [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Updating instance_info_cache with network_info: [{"id": "f373c320-8b0c-440d-b825-d7ec2555b89d", "address": "fa:16:3e:3f:8d:92", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf373c320-8b", "ovs_interfaceid": "f373c320-8b0c-440d-b825-d7ec2555b89d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Releasing lock "refresh_cache-3e1b5197-dc38-48a5-b9f9-e053be499433" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG nova.compute.manager [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Instance network_info: |[{"id": "f373c320-8b0c-440d-b825-d7ec2555b89d", "address": "fa:16:3e:3f:8d:92", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf373c320-8b", "ovs_interfaceid": "f373c320-8b0c-440d-b825-d7ec2555b89d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG nova.compute.manager [req-e8d3b1fa-389f-4fc2-b45e-0cdfc662fc18 req-ad334a7f-f754-45b2-ad69-986476048e13 service nova] [instance: f0e26668-e253-409a-a011-a54e8ad3ebb7] Received event network-vif-deleted-7ec9c7ac-57f1-42a5-b2ff-df899a930efd {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG nova.compute.manager [req-e8d3b1fa-389f-4fc2-b45e-0cdfc662fc18 req-ad334a7f-f754-45b2-ad69-986476048e13 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Received event network-changed-f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG nova.compute.manager [req-e8d3b1fa-389f-4fc2-b45e-0cdfc662fc18 req-ad334a7f-f754-45b2-ad69-986476048e13 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Refreshing instance network info cache due to event network-changed-f373c320-8b0c-440d-b825-d7ec2555b89d. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e8d3b1fa-389f-4fc2-b45e-0cdfc662fc18 req-ad334a7f-f754-45b2-ad69-986476048e13 service nova] Acquiring lock "refresh_cache-3e1b5197-dc38-48a5-b9f9-e053be499433" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e8d3b1fa-389f-4fc2-b45e-0cdfc662fc18 req-ad334a7f-f754-45b2-ad69-986476048e13 service nova] Acquired lock "refresh_cache-3e1b5197-dc38-48a5-b9f9-e053be499433" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG nova.network.neutron [req-e8d3b1fa-389f-4fc2-b45e-0cdfc662fc18 req-ad334a7f-f754-45b2-ad69-986476048e13 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Refreshing network info cache for port f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Acquiring lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG os_brick.utils [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7123a9c-9bfe-4577-af20-8e537972e606]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f5ef11-2906-4a6a-b4c5-5a5f273e690a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be4b28a-e875-49a9-8f0e-77e18d10f1c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d84e82e-66bb-4ab4-ab20-8d42c4e4ac9e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG nova.compute.manager [req-1813738a-5c88-43be-8a5c-78c2642c1906 req-89fc292e-d43d-46a3-85ee-967cbdd26a4f service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Received event network-vif-unplugged-4b46350b-531d-4f9c-89eb-1ebab7067497 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1813738a-5c88-43be-8a5c-78c2642c1906 req-89fc292e-d43d-46a3-85ee-967cbdd26a4f service nova] Acquiring lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1813738a-5c88-43be-8a5c-78c2642c1906 req-89fc292e-d43d-46a3-85ee-967cbdd26a4f service nova] Lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1813738a-5c88-43be-8a5c-78c2642c1906 req-89fc292e-d43d-46a3-85ee-967cbdd26a4f service nova] Lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG nova.compute.manager [req-1813738a-5c88-43be-8a5c-78c2642c1906 req-89fc292e-d43d-46a3-85ee-967cbdd26a4f service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] No waiting events found dispatching network-vif-unplugged-4b46350b-531d-4f9c-89eb-1ebab7067497 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:43:18 user nova-compute[75247]: WARNING nova.compute.manager [req-1813738a-5c88-43be-8a5c-78c2642c1906 req-89fc292e-d43d-46a3-85ee-967cbdd26a4f service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Received unexpected event network-vif-unplugged-4b46350b-531d-4f9c-89eb-1ebab7067497 for instance with vm_state active and task_state None.
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:43:18 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:43:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a768131-3e83-4ad4-b82b-5bc66a82da76]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:43:18 user nova-compute[75247]: DEBUG os_brick.utils [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:43:19 user nova-compute[75247]: INFO nova.compute.manager [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Swapping volume a981a788-9ae3-41c7-b06f-3b797b194bf6 for 82a4a39f-5874-4d9f-8936-c14e2d8a0ca8
Dec 06 12:43:19 user nova-compute[75247]: DEBUG nova.network.neutron [req-e8d3b1fa-389f-4fc2-b45e-0cdfc662fc18 req-ad334a7f-f754-45b2-ad69-986476048e13 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Updated VIF entry in instance network info cache for port f373c320-8b0c-440d-b825-d7ec2555b89d. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG nova.network.neutron [req-e8d3b1fa-389f-4fc2-b45e-0cdfc662fc18 req-ad334a7f-f754-45b2-ad69-986476048e13 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Updating instance_info_cache with network_info: [{"id": "f373c320-8b0c-440d-b825-d7ec2555b89d", "address": "fa:16:3e:3f:8d:92", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf373c320-8b", "ovs_interfaceid": "f373c320-8b0c-440d-b825-d7ec2555b89d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e8d3b1fa-389f-4fc2-b45e-0cdfc662fc18 req-ad334a7f-f754-45b2-ad69-986476048e13 service nova] Releasing lock "refresh_cache-3e1b5197-dc38-48a5-b9f9-e053be499433" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:19 user nova-compute[75247]: INFO nova.compute.manager [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Terminating instance
Dec 06 12:43:19 user nova-compute[75247]: DEBUG nova.compute.manager [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG nova.compute.manager [req-2067d8c0-5769-483c-8455-9600970b922a req-d8e5efb9-d274-4447-9c5a-b10c857d6dc6 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-unplugged-ce9cf139-5123-474a-b4ea-0880d5b48d27 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2067d8c0-5769-483c-8455-9600970b922a req-d8e5efb9-d274-4447-9c5a-b10c857d6dc6 service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2067d8c0-5769-483c-8455-9600970b922a req-d8e5efb9-d274-4447-9c5a-b10c857d6dc6 service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2067d8c0-5769-483c-8455-9600970b922a req-d8e5efb9-d274-4447-9c5a-b10c857d6dc6 service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG nova.compute.manager [req-2067d8c0-5769-483c-8455-9600970b922a req-d8e5efb9-d274-4447-9c5a-b10c857d6dc6 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-unplugged-ce9cf139-5123-474a-b4ea-0880d5b48d27 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG nova.compute.manager [req-2067d8c0-5769-483c-8455-9600970b922a req-d8e5efb9-d274-4447-9c5a-b10c857d6dc6 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-unplugged-ce9cf139-5123-474a-b4ea-0880d5b48d27 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG nova.compute.manager [req-45d47a7e-f108-410c-8f8b-fb032da67513 req-509f3c1a-e57c-43ad-b8d3-72f4b1aa8b25 service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Received event volume-reimaged-f5d30437-2abd-41f4-9626-a1ce202bacb0 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-45d47a7e-f108-410c-8f8b-fb032da67513 req-509f3c1a-e57c-43ad-b8d3-72f4b1aa8b25 service nova] Acquiring lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-45d47a7e-f108-410c-8f8b-fb032da67513 req-509f3c1a-e57c-43ad-b8d3-72f4b1aa8b25 service nova] Lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-45d47a7e-f108-410c-8f8b-fb032da67513 req-509f3c1a-e57c-43ad-b8d3-72f4b1aa8b25 service nova] Lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG nova.compute.manager [req-45d47a7e-f108-410c-8f8b-fb032da67513 req-509f3c1a-e57c-43ad-b8d3-72f4b1aa8b25 service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Processing event volume-reimaged-f5d30437-2abd-41f4-9626-a1ce202bacb0 {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG nova.compute.manager [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Instance event wait completed in 21 seconds for volume-reimaged {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:43:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:20 user nova-compute[75247]: INFO nova.virt.block_device [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Booting with volume f5d30437-2abd-41f4-9626-a1ce202bacb0 at /dev/vda
Dec 06 12:43:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG os_brick.utils [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b52681-8449-4b3d-a6d8-caad3cb9ed6a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd4fce8-7e7f-4c91-93a3-afc5b28feb43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[670bc497-3726-4211-884e-2017e007f906]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54f69b4-8e4b-4b63-9572-e5d69247bac2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:43:20 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a335758-71d9-42c9-b162-28e116ff02d5]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG os_brick.utils [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Updating existing volume attachment record: e9c920aa-be0b-411e-9e26-685c45a2f936 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG os_brick.utils [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-fd66f543-38ef-4825-8875-fd91254b393e req-6556007d-b8ee-4b45-915a-ee580e0dfb43 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-unplugged-3d9b37b6-a28d-4028-ac06-9cd7685d403f {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fd66f543-38ef-4825-8875-fd91254b393e req-6556007d-b8ee-4b45-915a-ee580e0dfb43 service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fd66f543-38ef-4825-8875-fd91254b393e req-6556007d-b8ee-4b45-915a-ee580e0dfb43 service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fd66f543-38ef-4825-8875-fd91254b393e req-6556007d-b8ee-4b45-915a-ee580e0dfb43 service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-fd66f543-38ef-4825-8875-fd91254b393e req-6556007d-b8ee-4b45-915a-ee580e0dfb43 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-unplugged-3d9b37b6-a28d-4028-ac06-9cd7685d403f {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-fd66f543-38ef-4825-8875-fd91254b393e req-6556007d-b8ee-4b45-915a-ee580e0dfb43 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-unplugged-3d9b37b6-a28d-4028-ac06-9cd7685d403f for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-fd66f543-38ef-4825-8875-fd91254b393e req-6556007d-b8ee-4b45-915a-ee580e0dfb43 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-plugged-3d9b37b6-a28d-4028-ac06-9cd7685d403f {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fd66f543-38ef-4825-8875-fd91254b393e req-6556007d-b8ee-4b45-915a-ee580e0dfb43 service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fd66f543-38ef-4825-8875-fd91254b393e req-6556007d-b8ee-4b45-915a-ee580e0dfb43 service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fd66f543-38ef-4825-8875-fd91254b393e req-6556007d-b8ee-4b45-915a-ee580e0dfb43 service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-fd66f543-38ef-4825-8875-fd91254b393e req-6556007d-b8ee-4b45-915a-ee580e0dfb43 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-plugged-3d9b37b6-a28d-4028-ac06-9cd7685d403f {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:43:20 user nova-compute[75247]: WARNING nova.compute.manager [req-fd66f543-38ef-4825-8875-fd91254b393e req-6556007d-b8ee-4b45-915a-ee580e0dfb43 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received unexpected event network-vif-plugged-3d9b37b6-a28d-4028-ac06-9cd7685d403f for instance with vm_state active and task_state deleting.
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[138a1d58-d24b-45b6-8356-df0648b437f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9311eb3-1a36-44b7-9bd3-f3d5cc8d62ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcd067d-0a51-49e6-a172-d5f4d5997a26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6585d3f-c91e-4f2f-b9ff-85940224260f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Received event network-vif-plugged-4b46350b-531d-4f9c-89eb-1ebab7067497 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] Acquiring lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] Lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] Lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] No waiting events found dispatching network-vif-plugged-4b46350b-531d-4f9c-89eb-1ebab7067497 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:43:20 user nova-compute[75247]: WARNING nova.compute.manager [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Received unexpected event network-vif-plugged-4b46350b-531d-4f9c-89eb-1ebab7067497 for instance with vm_state active and task_state None.
Dec 06 12:43:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-unplugged-650ff76d-5da3-40b6-a2f7-3c9bcfa49a51 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-unplugged-650ff76d-5da3-40b6-a2f7-3c9bcfa49a51 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-unplugged-650ff76d-5da3-40b6-a2f7-3c9bcfa49a51 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-plugged-650ff76d-5da3-40b6-a2f7-3c9bcfa49a51 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-plugged-650ff76d-5da3-40b6-a2f7-3c9bcfa49a51 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:43:20 user nova-compute[75247]: WARNING nova.compute.manager [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received unexpected event network-vif-plugged-650ff76d-5da3-40b6-a2f7-3c9bcfa49a51 for instance with vm_state active and task_state deleting.
Dec 06 12:43:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-unplugged-7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-unplugged-7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-unplugged-7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-plugged-7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-plugged-7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:43:20 user nova-compute[75247]: WARNING nova.compute.manager [req-d55a6e8f-c9b4-4845-9dd5-63469bbd2eb0 req-2b4c4ce6-257a-4ee3-987a-cbbd2fe7f70f service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received unexpected event network-vif-plugged-7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6 for instance with vm_state active and task_state deleting.
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:43:20 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:43:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e1e799-496d-4ffe-b983-847787034547]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG os_brick.utils [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:43:20 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Updating existing volume attachment record: 5423f4e3-d08c-4756-9443-242bbc6b80e8 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:43:21 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Instance destroyed successfully.
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.objects.instance [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lazy-loading 'resources' on Instance uuid 51c56231-9ff5-45a6-ad38-e7ac68124ed4 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1395602794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1395602794',id=12,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsK0o8hX3LL+8iByCifdWMM6pAHxt20WAEEgA8mlwjBPURbQRsot6wD8XjKgQH8TLAMnzdTfdz2RGsIRYV1pqbYCOnbI3PxxqRs9khNrYSibxJQ7UqBr8VORAImcLPxPw==',key_name='tempest-keypair-1087121586',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:42:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5f2611cfbe440d98fc54a3c186152be',ramdisk_id='',reservation_id='r-p7hvmoiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1984999958',owner_user_name='tempest-TaggedBootDevicesTest-1984999958-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:42:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b81d6b6eeb741bc9c76444729f6d6f2',uuid=51c56231-9ff5-45a6-ad38-e7ac68124ed4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce9cf139-5123-474a-b4ea-0880d5b48d27", "address": "fa:16:3e:67:4c:8e", "network": {"id": "c6a1a892-2161-4aae-9790-3c6e03f34389", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1604742206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9cf139-51", "ovs_interfaceid": "ce9cf139-5123-474a-b4ea-0880d5b48d27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converting VIF {"id": "ce9cf139-5123-474a-b4ea-0880d5b48d27", "address": "fa:16:3e:67:4c:8e", "network": {"id": "c6a1a892-2161-4aae-9790-3c6e03f34389", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1604742206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9cf139-51", "ovs_interfaceid": "ce9cf139-5123-474a-b4ea-0880d5b48d27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:4c:8e,bridge_name='br-int',has_traffic_filtering=True,id=ce9cf139-5123-474a-b4ea-0880d5b48d27,network=Network(c6a1a892-2161-4aae-9790-3c6e03f34389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9cf139-51') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG os_vif [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:4c:8e,bridge_name='br-int',has_traffic_filtering=True,id=ce9cf139-5123-474a-b4ea-0880d5b48d27,network=Network(c6a1a892-2161-4aae-9790-3c6e03f34389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9cf139-51') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce9cf139-51, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f22fbb2-460f-4a33-beb2-37fd7812e390) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: INFO os_vif [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:4c:8e,bridge_name='br-int',has_traffic_filtering=True,id=ce9cf139-5123-474a-b4ea-0880d5b48d27,network=Network(c6a1a892-2161-4aae-9790-3c6e03f34389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9cf139-51')
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1395602794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1395602794',id=12,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsK0o8hX3LL+8iByCifdWMM6pAHxt20WAEEgA8mlwjBPURbQRsot6wD8XjKgQH8TLAMnzdTfdz2RGsIRYV1pqbYCOnbI3PxxqRs9khNrYSibxJQ7UqBr8VORAImcLPxPw==',key_name='tempest-keypair-1087121586',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:42:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5f2611cfbe440d98fc54a3c186152be',ramdisk_id='',reservation_id='r-p7hvmoiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1984999958',owner_user_name='tempest-TaggedBootDevicesTest-1984999958-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:42:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b81d6b6eeb741bc9c76444729f6d6f2',uuid=51c56231-9ff5-45a6-ad38-e7ac68124ed4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a20eb2f0-1219-4738-9733-7bf8618ac75d", "address": "fa:16:3e:81:34:c2", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20eb2f0-12", "ovs_interfaceid": "a20eb2f0-1219-4738-9733-7bf8618ac75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converting VIF {"id": "a20eb2f0-1219-4738-9733-7bf8618ac75d", "address": "fa:16:3e:81:34:c2", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20eb2f0-12", "ovs_interfaceid": "a20eb2f0-1219-4738-9733-7bf8618ac75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:34:c2,bridge_name='br-int',has_traffic_filtering=True,id=a20eb2f0-1219-4738-9733-7bf8618ac75d,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa20eb2f0-12') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG os_vif [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:34:c2,bridge_name='br-int',has_traffic_filtering=True,id=a20eb2f0-1219-4738-9733-7bf8618ac75d,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa20eb2f0-12') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa20eb2f0-12, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa3d2d56-6972-4f55-b5b2-85dc61e984f7) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: INFO os_vif [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:34:c2,bridge_name='br-int',has_traffic_filtering=True,id=a20eb2f0-1219-4738-9733-7bf8618ac75d,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa20eb2f0-12')
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1395602794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1395602794',id=12,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsK0o8hX3LL+8iByCifdWMM6pAHxt20WAEEgA8mlwjBPURbQRsot6wD8XjKgQH8TLAMnzdTfdz2RGsIRYV1pqbYCOnbI3PxxqRs9khNrYSibxJQ7UqBr8VORAImcLPxPw==',key_name='tempest-keypair-1087121586',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:42:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5f2611cfbe440d98fc54a3c186152be',ramdisk_id='',reservation_id='r-p7hvmoiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1984999958',owner_user_name='tempest-TaggedBootDevicesTest-1984999958-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:42:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b81d6b6eeb741bc9c76444729f6d6f2',uuid=51c56231-9ff5-45a6-ad38-e7ac68124ed4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "650ff76d-5da3-40b6-a2f7-3c9bcfa49a51", "address": "fa:16:3e:6b:d5:f0", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650ff76d-5d", "ovs_interfaceid": "650ff76d-5da3-40b6-a2f7-3c9bcfa49a51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converting VIF {"id": "650ff76d-5da3-40b6-a2f7-3c9bcfa49a51", "address": "fa:16:3e:6b:d5:f0", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650ff76d-5d", "ovs_interfaceid": "650ff76d-5da3-40b6-a2f7-3c9bcfa49a51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:d5:f0,bridge_name='br-int',has_traffic_filtering=True,id=650ff76d-5da3-40b6-a2f7-3c9bcfa49a51,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap650ff76d-5d') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG os_vif [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:d5:f0,bridge_name='br-int',has_traffic_filtering=True,id=650ff76d-5da3-40b6-a2f7-3c9bcfa49a51,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap650ff76d-5d') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap650ff76d-5d, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b207c0d-8850-4fd1-b3fb-4883ca5e4824) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:43:21 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 12f40dad-65dc-4281-aa53-6036aa7e26d9 is timed out.
Dec 06 12:43:21 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Successfully detached device vdb from instance 12f40dad-65dc-4281-aa53-6036aa7e26d9 from the live domain config.
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkpuHIRO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:43:21 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:43:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: INFO os_vif [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:d5:f0,bridge_name='br-int',has_traffic_filtering=True,id=650ff76d-5da3-40b6-a2f7-3c9bcfa49a51,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap650ff76d-5d')
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1395602794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1395602794',id=12,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsK0o8hX3LL+8iByCifdWMM6pAHxt20WAEEgA8mlwjBPURbQRsot6wD8XjKgQH8TLAMnzdTfdz2RGsIRYV1pqbYCOnbI3PxxqRs9khNrYSibxJQ7UqBr8VORAImcLPxPw==',key_name='tempest-keypair-1087121586',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:42:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5f2611cfbe440d98fc54a3c186152be',ramdisk_id='',reservation_id='r-p7hvmoiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1984999958',owner_user_name='tempest-TaggedBootDevicesTest-1984999958-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:42:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b81d6b6eeb741bc9c76444729f6d6f2',uuid=51c56231-9ff5-45a6-ad38-e7ac68124ed4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d9b37b6-a28d-4028-ac06-9cd7685d403f", "address": "fa:16:3e:59:b1:a2", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9b37b6-a2", "ovs_interfaceid": "3d9b37b6-a28d-4028-ac06-9cd7685d403f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converting VIF {"id": "3d9b37b6-a28d-4028-ac06-9cd7685d403f", "address": "fa:16:3e:59:b1:a2", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9b37b6-a2", "ovs_interfaceid": "3d9b37b6-a28d-4028-ac06-9cd7685d403f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:b1:a2,bridge_name='br-int',has_traffic_filtering=True,id=3d9b37b6-a28d-4028-ac06-9cd7685d403f,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9b37b6-a2') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG os_vif [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:b1:a2,bridge_name='br-int',has_traffic_filtering=True,id=3d9b37b6-a28d-4028-ac06-9cd7685d403f,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9b37b6-a2') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d9b37b6-a2, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d25a5b-86dc-4767-b026-f2f450127e41]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:43:21 user nova-compute[75247]: No targets found.
Dec 06 12:43:21 user nova-compute[75247]: iSNS:
Dec 06 12:43:21 user nova-compute[75247]: No targets found.
Dec 06 12:43:21 user nova-compute[75247]: STATIC:
Dec 06 12:43:21 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8
Dec 06 12:43:21 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:21 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:21 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681
Dec 06 12:43:21 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:21 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:21 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496
Dec 06 12:43:21 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:21 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:21 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6
Dec 06 12:43:21 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:21 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:21 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c
Dec 06 12:43:21 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:21 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:21 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4
Dec 06 12:43:21 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:21 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:21 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482
Dec 06 12:43:21 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:21 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:21 user nova-compute[75247]: FIRMWARE:
Dec 06 12:43:21 user nova-compute[75247]: No targets found.
Dec 06 12:43:21 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:43:21 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:43:21 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edda275-85be-43c6-99bf-cf3ed7bb91b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e5add9b7-d7b8-45b3-85cc-c74137065cc6) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa288e8-49ff-4719-aec1-e3c7fc1bcb95]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 (non-flash)
Dec 06 12:43:21 user nova-compute[75247]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:21 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:43:21 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:43:21 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:43:21 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:21 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:21 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 (non-flash)
Dec 06 12:43:21 user nova-compute[75247]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:21 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:43:21 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:43:21 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:43:21 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:21 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:21 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c6265f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681'): ({'sdb'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Removing single pathed devices sdb {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-plugged-ce9cf139-5123-474a-b4ea-0880d5b48d27 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-plugged-ce9cf139-5123-474a-b4ea-0880d5b48d27 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:43:21 user nova-compute[75247]: WARNING nova.compute.manager [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received unexpected event network-vif-plugged-ce9cf139-5123-474a-b4ea-0880d5b48d27 for instance with vm_state active and task_state deleting.
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-unplugged-a20eb2f0-1219-4738-9733-7bf8618ac75d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-unplugged-a20eb2f0-1219-4738-9733-7bf8618ac75d {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-unplugged-a20eb2f0-1219-4738-9733-7bf8618ac75d for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-plugged-a20eb2f0-1219-4738-9733-7bf8618ac75d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-plugged-a20eb2f0-1219-4738-9733-7bf8618ac75d {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:43:21 user nova-compute[75247]: WARNING nova.compute.manager [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received unexpected event network-vif-plugged-a20eb2f0-1219-4738-9733-7bf8618ac75d for instance with vm_state active and task_state deleting.
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-unplugged-f9384778-27c0-459c-90f1-512f3f1bbda5 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-unplugged-f9384778-27c0-459c-90f1-512f3f1bbda5 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-unplugged-f9384778-27c0-459c-90f1-512f3f1bbda5 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-plugged-f9384778-27c0-459c-90f1-512f3f1bbda5 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-plugged-f9384778-27c0-459c-90f1-512f3f1bbda5 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:43:21 user nova-compute[75247]: WARNING nova.compute.manager [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received unexpected event network-vif-plugged-f9384778-27c0-459c-90f1-512f3f1bbda5 for instance with vm_state active and task_state deleting.
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-unplugged-0b94c5e7-0a3d-43d9-9c8a-35badae08754 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-unplugged-0b94c5e7-0a3d-43d9-9c8a-35badae08754 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-unplugged-0b94c5e7-0a3d-43d9-9c8a-35badae08754 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-plugged-0b94c5e7-0a3d-43d9-9c8a-35badae08754 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] Acquiring lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] No waiting events found dispatching network-vif-plugged-0b94c5e7-0a3d-43d9-9c8a-35badae08754 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:43:21 user nova-compute[75247]: WARNING nova.compute.manager [req-71cd9fcc-72fa-4b10-8a64-fbd074224515 req-12ddbf4e-13c4-411c-83a8-91da8c78bcfe service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received unexpected event network-vif-plugged-0b94c5e7-0a3d-43d9-9c8a-35badae08754 for instance with vm_state active and task_state deleting.
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf0df36-a009-4323-bd4f-8cf0d8c6073c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:21 user nova-compute[75247]: INFO os_vif [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:b1:a2,bridge_name='br-int',has_traffic_filtering=True,id=3d9b37b6-a28d-4028-ac06-9cd7685d403f,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9b37b6-a2')
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1395602794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1395602794',id=12,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsK0o8hX3LL+8iByCifdWMM6pAHxt20WAEEgA8mlwjBPURbQRsot6wD8XjKgQH8TLAMnzdTfdz2RGsIRYV1pqbYCOnbI3PxxqRs9khNrYSibxJQ7UqBr8VORAImcLPxPw==',key_name='tempest-keypair-1087121586',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:42:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5f2611cfbe440d98fc54a3c186152be',ramdisk_id='',reservation_id='r-p7hvmoiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1984999958',owner_user_name='tempest-TaggedBootDevicesTest-1984999958-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:42:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b81d6b6eeb741bc9c76444729f6d6f2',uuid=51c56231-9ff5-45a6-ad38-e7ac68124ed4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6", "address": "fa:16:3e:ad:ba:c7", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa60734-d8", "ovs_interfaceid": "7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converting VIF {"id": "7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6", "address": "fa:16:3e:ad:ba:c7", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa60734-d8", "ovs_interfaceid": "7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:ba:c7,bridge_name='br-int',has_traffic_filtering=True,id=7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fa60734-d8') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG os_vif [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:ba:c7,bridge_name='br-int',has_traffic_filtering=True,id=7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fa60734-d8') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7fa60734-d8, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e6bf11-ae59-48dd-aeb7-e522ce100fae]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Flushing IO for device /dev/sdb {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60da181-a526-4462-aa10-ca06faf58b24]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2b03b5a-344b-45a3-86fd-af01e2fade35) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5425cc43-e2b2-4fda-aba8-29c8385fc28d]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: INFO os_vif [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:ba:c7,bridge_name='br-int',has_traffic_filtering=True,id=7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6,network=Network(bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fa60734-d8')
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1395602794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1395602794',id=12,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsK0o8hX3LL+8iByCifdWMM6pAHxt20WAEEgA8mlwjBPURbQRsot6wD8XjKgQH8TLAMnzdTfdz2RGsIRYV1pqbYCOnbI3PxxqRs9khNrYSibxJQ7UqBr8VORAImcLPxPw==',key_name='tempest-keypair-1087121586',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:42:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5f2611cfbe440d98fc54a3c186152be',ramdisk_id='',reservation_id='r-p7hvmoiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1984999958',owner_user_name='tempest-TaggedBootDevicesTest-1984999958-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:42:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b81d6b6eeb741bc9c76444729f6d6f2',uuid=51c56231-9ff5-45a6-ad38-e7ac68124ed4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9384778-27c0-459c-90f1-512f3f1bbda5", "address": "fa:16:3e:6e:01:3c", "network": {"id": "25876878-6a68-4cc1-9332-822c5778b8da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1585990936", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9384778-27", "ovs_interfaceid": "f9384778-27c0-459c-90f1-512f3f1bbda5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converting VIF {"id": "f9384778-27c0-459c-90f1-512f3f1bbda5", "address": "fa:16:3e:6e:01:3c", "network": {"id": "25876878-6a68-4cc1-9332-822c5778b8da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1585990936", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9384778-27", "ovs_interfaceid": "f9384778-27c0-459c-90f1-512f3f1bbda5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:01:3c,bridge_name='br-int',has_traffic_filtering=True,id=f9384778-27c0-459c-90f1-512f3f1bbda5,network=Network(25876878-6a68-4cc1-9332-822c5778b8da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9384778-27') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG os_vif [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:01:3c,bridge_name='br-int',has_traffic_filtering=True,id=f9384778-27c0-459c-90f1-512f3f1bbda5,network=Network(25876878-6a68-4cc1-9332-822c5778b8da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9384778-27') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47c1a95-82bd-4222-a0fb-7510c81f2c09]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9384778-27, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:43:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68f1eb29-3128-4f2a-a1d4-e11a744096fa) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[389a8c24-1433-4f39-925b-45d2be98eedf]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681, portal: 172.16.0.220,3260]
Dec 06 12:43:22 user nova-compute[75247]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681, portal: 172.16.0.220,3260] successful.
Dec 06 12:43:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: INFO os_vif [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:01:3c,bridge_name='br-int',has_traffic_filtering=True,id=f9384778-27c0-459c-90f1-512f3f1bbda5,network=Network(25876878-6a68-4cc1-9332-822c5778b8da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9384778-27')
Dec 06 12:43:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1395602794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1395602794',id=12,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsK0o8hX3LL+8iByCifdWMM6pAHxt20WAEEgA8mlwjBPURbQRsot6wD8XjKgQH8TLAMnzdTfdz2RGsIRYV1pqbYCOnbI3PxxqRs9khNrYSibxJQ7UqBr8VORAImcLPxPw==',key_name='tempest-keypair-1087121586',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:42:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5f2611cfbe440d98fc54a3c186152be',ramdisk_id='',reservation_id='r-p7hvmoiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1984999958',owner_user_name='tempest-TaggedBootDevicesTest-1984999958-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:42:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b81d6b6eeb741bc9c76444729f6d6f2',uuid=51c56231-9ff5-45a6-ad38-e7ac68124ed4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b94c5e7-0a3d-43d9-9c8a-35badae08754", "address": "fa:16:3e:e1:9f:73", "network": {"id": "25876878-6a68-4cc1-9332-822c5778b8da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1585990936", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b94c5e7-0a", "ovs_interfaceid": "0b94c5e7-0a3d-43d9-9c8a-35badae08754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converting VIF {"id": "0b94c5e7-0a3d-43d9-9c8a-35badae08754", "address": "fa:16:3e:e1:9f:73", "network": {"id": "25876878-6a68-4cc1-9332-822c5778b8da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1585990936", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b94c5e7-0a", "ovs_interfaceid": "0b94c5e7-0a3d-43d9-9c8a-35badae08754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:9f:73,bridge_name='br-int',has_traffic_filtering=True,id=0b94c5e7-0a3d-43d9-9c8a-35badae08754,network=Network(25876878-6a68-4cc1-9332-822c5778b8da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b94c5e7-0a') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_vif [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:9f:73,bridge_name='br-int',has_traffic_filtering=True,id=0b94c5e7-0a3d-43d9-9c8a-35badae08754,network=Network(25876878-6a68-4cc1-9332-822c5778b8da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b94c5e7-0a') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b94c5e7-0a, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5237358-14f2-4b6f-bad4-eb1a5fcc8fe2) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f55bc9fb-8aec-4d64-b7d4-8dffacc3e681 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[219346a4-13fe-4f67-8acb-bb497b8eec7f]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] <== disconnect_volume: return (374ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:22 user nova-compute[75247]: INFO os_vif [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:9f:73,bridge_name='br-int',has_traffic_filtering=True,id=0b94c5e7-0a3d-43d9-9c8a-35badae08754,network=Network(25876878-6a68-4cc1-9332-822c5778b8da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b94c5e7-0a')
Dec 06 12:43:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFiVLhsU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:43:22 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7a631e-5456-4551-96a8-ad520cd99fbc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:43:22 user nova-compute[75247]: No targets found.
Dec 06 12:43:22 user nova-compute[75247]: iSNS:
Dec 06 12:43:22 user nova-compute[75247]: No targets found.
Dec 06 12:43:22 user nova-compute[75247]: STATIC:
Dec 06 12:43:22 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8
Dec 06 12:43:22 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:22 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:22 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496
Dec 06 12:43:22 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:22 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:22 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6
Dec 06 12:43:22 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:22 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:22 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c
Dec 06 12:43:22 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:22 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:22 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4
Dec 06 12:43:22 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:22 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:22 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482
Dec 06 12:43:22 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:22 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:22 user nova-compute[75247]: FIRMWARE:
Dec 06 12:43:22 user nova-compute[75247]: No targets found.
Dec 06 12:43:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:43:22 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:43:22 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fe5a1c-43a2-4d14-b78b-37444c49fdbf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c653dc03-2045-485f-a027-69c540de6aa5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:22 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:43:22 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:43:22 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:43:22 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:22 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:22 user nova-compute[75247]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 (non-flash)
Dec 06 12:43:22 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:43:22 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:43:22 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:22 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd7302f7d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4'): ({'sdc'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Removing single pathed devices sdc {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[954e9800-8faa-45b1-94e6-b5da80ea8987]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dc20ef-cda1-4108-9978-2c6921cb5ee7]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Flushing IO for device /dev/sdc {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.011s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b378910-1fc6-4bbe-a4af-7a5fe58e7414]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e1cf60-323c-4273-aa8c-0f07d27ac55a]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] SCSI volumes sdc have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf130c7f-8096-45fa-b74f-3040933d1936]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a842c5-3708-4c3c-9319-bb2aac359ed0]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4, portal: 172.16.0.220,3260]
Dec 06 12:43:22 user nova-compute[75247]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4, portal: 172.16.0.220,3260] successful.
Dec 06 12:43:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb5461f8-6a34-42f7-975e-bf166e43dbd4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a69ef9a-7eb9-46db-8c38-f75d7093cb75]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] <== disconnect_volume: return (322ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShrDetyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:43:22 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f35d84-1ed8-4080-a4c0-635d048b968f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:43:22 user nova-compute[75247]: No targets found.
Dec 06 12:43:22 user nova-compute[75247]: iSNS:
Dec 06 12:43:22 user nova-compute[75247]: No targets found.
Dec 06 12:43:22 user nova-compute[75247]: STATIC:
Dec 06 12:43:22 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8
Dec 06 12:43:22 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:22 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:22 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496
Dec 06 12:43:22 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:22 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:22 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6
Dec 06 12:43:22 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:22 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:22 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c
Dec 06 12:43:22 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:22 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:22 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482
Dec 06 12:43:22 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:22 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:22 user nova-compute[75247]: FIRMWARE:
Dec 06 12:43:22 user nova-compute[75247]: No targets found.
Dec 06 12:43:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:43:22 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:43:22 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[32be9955-7472-4f99-9b5e-16e60b6715d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d269df93-5171-419e-85e0-01bf0b5b22cf]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:22 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:43:22 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:43:22 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:22 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:22 user nova-compute[75247]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c (non-flash)
Dec 06 12:43:22 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:43:22 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:22 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd7302f7d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c'): ({'sdd'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Removing single pathed devices sdd {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5dbae6-ae1d-4bf3-b620-b9184449937c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e163a689-3b8c-4236-be49-a186ba357cd6]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Flushing IO for device /dev/sdd {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b9d9b4-2d70-4955-9277-2f07610f98be]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bd3523-e460-4dc3-bbf1-903e70af6b8e]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] SCSI volumes sdd have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0c4436-912f-4f21-90a9-c7bee87712cf]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aec6598-bf52-45eb-8670-f590fc1b24d0]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c, portal: 172.16.0.220,3260]
Dec 06 12:43:22 user nova-compute[75247]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c, portal: 172.16.0.220,3260] successful.
Dec 06 12:43:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:886c0221-91a2-4e23-9fb5-686b92c3f90c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c7f27b-688c-40c8-9a95-80988901e36d]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] <== disconnect_volume: return (294ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mEWgvkVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:43:22 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f5c37b-2ddc-48e1-89ee-26346ea834e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:43:22 user nova-compute[75247]: No targets found.
Dec 06 12:43:22 user nova-compute[75247]: iSNS:
Dec 06 12:43:22 user nova-compute[75247]: No targets found.
Dec 06 12:43:22 user nova-compute[75247]: STATIC:
Dec 06 12:43:22 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8
Dec 06 12:43:22 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:22 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:22 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496
Dec 06 12:43:22 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:22 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:22 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6
Dec 06 12:43:22 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:22 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:22 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482
Dec 06 12:43:22 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:22 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:22 user nova-compute[75247]: FIRMWARE:
Dec 06 12:43:22 user nova-compute[75247]: No targets found.
Dec 06 12:43:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:43:22 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:43:22 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9228dfef-6d83-431d-b433-8dd93e41b2d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9c8704-6e21-4c30-8101-1a1ecacdbce0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:22 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:43:22 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:22 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:22 user nova-compute[75247]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 (non-flash)
Dec 06 12:43:22 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:22 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd7302f7d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8'): ({'sde'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Removing single pathed devices sde {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[366bfa4c-46a7-486b-8790-30bfc0477e36]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8ecf71-61e7-4f5b-b0d9-091375de77e1]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Flushing IO for device /dev/sde {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd92a0b3-c3a0-4e80-b386-f521e56473cf]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[374f8fff-305a-498c-a944-947013669017]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] SCSI volumes sde have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c62d82-ee47-4ad2-9cfa-933290e9f79b]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:23 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[29251e2f-05e3-4b46-959c-af0447d48db5]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8, portal: 172.16.0.220,3260]
Dec 06 12:43:23 user nova-compute[75247]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8, portal: 172.16.0.220,3260] successful.
Dec 06 12:43:23 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92aa917b-0d45-40bc-89df-37e22cc3afd8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:23 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b890cb-0f86-488f-8c62-90d13ce44f15]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:43:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] <== disconnect_volume: return (301ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:43:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:43:23 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Deleting instance files /opt/stack/data/nova/instances/51c56231-9ff5-45a6-ad38-e7ac68124ed4_del
Dec 06 12:43:23 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Deletion of /opt/stack/data/nova/instances/51c56231-9ff5-45a6-ad38-e7ac68124ed4_del complete
Dec 06 12:43:23 user nova-compute[75247]: INFO nova.compute.manager [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Took 3.65 seconds to destroy the instance on the hypervisor.
Dec 06 12:43:23 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:43:23 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:43:23 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:43:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:25 user nova-compute[75247]: DEBUG nova.compute.manager [req-de6afb59-d50e-4033-a5ad-a3340cda7726 req-85750613-7768-45b8-b627-e763ccdc0d63 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-deleted-0b94c5e7-0a3d-43d9-9c8a-35badae08754 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:25 user nova-compute[75247]: INFO nova.compute.manager [req-de6afb59-d50e-4033-a5ad-a3340cda7726 req-85750613-7768-45b8-b627-e763ccdc0d63 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Neutron deleted interface 0b94c5e7-0a3d-43d9-9c8a-35badae08754; detaching it from the instance and deleting it from the info cache
Dec 06 12:43:25 user nova-compute[75247]: DEBUG nova.network.neutron [req-de6afb59-d50e-4033-a5ad-a3340cda7726 req-85750613-7768-45b8-b627-e763ccdc0d63 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Updating instance_info_cache with network_info: [{"id": "ce9cf139-5123-474a-b4ea-0880d5b48d27", "address": "fa:16:3e:67:4c:8e", "network": {"id": "c6a1a892-2161-4aae-9790-3c6e03f34389", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1604742206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9cf139-51", "ovs_interfaceid": "ce9cf139-5123-474a-b4ea-0880d5b48d27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a20eb2f0-1219-4738-9733-7bf8618ac75d", "address": "fa:16:3e:81:34:c2", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20eb2f0-12", "ovs_interfaceid": "a20eb2f0-1219-4738-9733-7bf8618ac75d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "650ff76d-5da3-40b6-a2f7-3c9bcfa49a51", "address": "fa:16:3e:6b:d5:f0", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650ff76d-5d", "ovs_interfaceid": "650ff76d-5da3-40b6-a2f7-3c9bcfa49a51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d9b37b6-a28d-4028-ac06-9cd7685d403f", "address": "fa:16:3e:59:b1:a2", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9b37b6-a2", "ovs_interfaceid": "3d9b37b6-a28d-4028-ac06-9cd7685d403f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6", "address": "fa:16:3e:ad:ba:c7", "network": {"id": "bf3d138d-ee19-4f7a-b0fa-d0bd6b5a88de", "bridge": "br-int", "label": "tempest-device-tagging-net1-405230513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa60734-d8", "ovs_interfaceid": "7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9384778-27c0-459c-90f1-512f3f1bbda5", "address": "fa:16:3e:6e:01:3c", "network": {"id": "25876878-6a68-4cc1-9332-822c5778b8da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1585990936", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c5f2611cfbe440d98fc54a3c186152be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9384778-27", "ovs_interfaceid": "f9384778-27c0-459c-90f1-512f3f1bbda5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:43:25 user nova-compute[75247]: DEBUG nova.compute.manager [req-de6afb59-d50e-4033-a5ad-a3340cda7726 req-85750613-7768-45b8-b627-e763ccdc0d63 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Detach interface failed, port_id=0b94c5e7-0a3d-43d9-9c8a-35badae08754, reason: Instance 51c56231-9ff5-45a6-ad38-e7ac68124ed4 could not be found. {{(pid=75247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 12:43:26 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:43:26 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Took 3.84 seconds to deallocate network for instance.
Dec 06 12:43:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:27 user nova-compute[75247]: DEBUG nova.compute.manager [req-19b377ac-9bad-4bb4-bf21-07d5e3c08e89 req-488f7d69-aa32-4a57-9599-8a32e7465078 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-deleted-3d9b37b6-a28d-4028-ac06-9cd7685d403f {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:27 user nova-compute[75247]: DEBUG nova.compute.manager [req-19b377ac-9bad-4bb4-bf21-07d5e3c08e89 req-488f7d69-aa32-4a57-9599-8a32e7465078 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-deleted-f9384778-27c0-459c-90f1-512f3f1bbda5 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:27 user nova-compute[75247]: DEBUG nova.compute.manager [req-19b377ac-9bad-4bb4-bf21-07d5e3c08e89 req-488f7d69-aa32-4a57-9599-8a32e7465078 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-deleted-7fa60734-d8a6-4ae3-8c08-5ff499e5b4b6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:27 user nova-compute[75247]: DEBUG nova.compute.manager [req-19b377ac-9bad-4bb4-bf21-07d5e3c08e89 req-488f7d69-aa32-4a57-9599-8a32e7465078 service nova] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Received event network-vif-deleted-ce9cf139-5123-474a-b4ea-0880d5b48d27 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycZYnIDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dbb64a66-f500-407b-ae92-80f27eb6ce2e', 'attached_at': '', 'detached_at': '', 'volume_id': '82a4a39f-5874-4d9f-8936-c14e2d8a0ca8', 'serial': '82a4a39f-5874-4d9f-8936-c14e2d8a0ca8'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFexDjIt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': 'a981a788-9ae3-41c7-b06f-3b797b194bf6'}, 'status': 'reserved', 'instance': 'dbb64a66-f500-407b-ae92-80f27eb6ce2e', 'attached_at': '', 'detached_at': '', 'volume_id': 'a981a788-9ae3-41c7-b06f-3b797b194bf6', 'serial'} {{(pid=75247) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycZYnIDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:43:30 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:43:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:43:30 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:43:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:43:30 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bda6ca0-bb2a-4273-b0ad-c54a368f93b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:43:30 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1768ca4f-cd0d-4359-9654-6413bce7dcba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8] added
Dec 06 12:43:30 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4e92ae-a2af-48c5-ba16-4a04f437e698]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cbf80b-e041-4452-86d8-75b2398bdb27]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycZYnIDC {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycZYnIDC" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fe4a66-2bf2-4708-ad2f-286c6ef392f1]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ycZYnIDC'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[061d8cc1-c63f-467a-ad7a-1a699ee48893]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e05d18a-27fe-4afe-8993-218ec515ed33]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:30 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:30 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:30 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:30 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:30 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:30 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c88536-8838-45c2-ac58-cab728469f94]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8, portal: 172.16.0.220,3260]
Dec 06 12:43:30 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8, portal: 172.16.0.220,3260] successful.
Dec 06 12:43:30 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5a8674-1413-4c96-b3b6-efc51f13b7f1]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[468fd132-f22a-42a5-a052-6d6c492240d5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:30 user nova-compute[75247]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:43:30 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:30 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:30 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:30 user nova-compute[75247]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:43:30 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:30 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:30 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfaf14e-5c3e-4f44-8691-028f6b3933bc]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:43:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycZYnIDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:43:31 user nova-compute[75247]: DEBUG nova.objects.instance [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Lazy-loading 'flavor' on Instance uuid 12f40dad-65dc-4281-aa53-6036aa7e26d9 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:43:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-aa4679ff-e398-4976-a877-72402b286df0 tempest-VolumesAssistedSnapshotsTest-1807035649 tempest-VolumesAssistedSnapshotsTest-1807035649-project-admin] Lock "12f40dad-65dc-4281-aa53-6036aa7e26d9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 30.266s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:31 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:43:31 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26366646534323163', 'path': '/dev/sdb'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:43:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366646534323163', 'path': '/dev/sdb'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:43:31 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Lazy-loading 'flavor' on Instance uuid dbb64a66-f500-407b-ae92-80f27eb6ce2e {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:43:32 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Creating image(s)
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Did not create local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Ensure instance console log exists: /opt/stack/data/nova/instances/ed721541-3a94-496f-8b9d-88c74ac83ef7/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Start _get_guest_xml network_info=[{"id": "795878af-3950-4253-83f2-7656b6ce8fb0", "address": "fa:16:3e:39:75:70", "network": {"id": "b8c04077-286f-434c-a3a6-cde7a124f301", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-378433228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d12120b32e41b891fd25ca49f9553a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795878af-39", "ovs_interfaceid": "795878af-3950-4253-83f2-7656b6ce8fb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'e9c920aa-be0b-411e-9e26-685c45a2f936', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'teobKPCy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ed721541-3a94-496f-8b9d-88c74ac83ef7', 'attached_at': '', 'detached_at': '', 'volume_id': 'f5d30437-2abd-41f4-9626-a1ce202bacb0', 'serial': 'f5d30437-2abd-41f4-9626-a1ce202bacb0'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:43:32 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 06 12:43:32 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.objects.instance [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lazy-loading 'vcpu_model' on Instance uuid ed721541-3a94-496f-8b9d-88c74ac83ef7 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'teobKPCy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:43:32 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 06 12:43:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:43:32 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 06 12:43:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:43:32 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[194c7dba-3717-44a6-ad60-e0d1bf90e96d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:43:32 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b72ef9-ef95-4421-b88a-e26ca9ea4784]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0] added
Dec 06 12:43:32 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc116c15-e233-4d4c-b563-3bf74238326f]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c07f96a-2847-4cb0-803e-75759f40cd63]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v teobKPCy {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v teobKPCy" returned: 0 in 0.029s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0e84fa-730c-4f3e-b034-c826d8658011]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'teobKPCy'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5259866-af5f-4411-8f1f-a990ea15d6bd]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efe7ce6-bf58-4e4c-89c0-b069f8cb8621]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:32 user nova-compute[75247]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:43:32 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:32 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:32 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:32 user nova-compute[75247]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:43:32 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:32 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:32 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] COPY block job progress, current cursor: 57671680 final cursor: 1073741824 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[311bd923-80ff-457c-9d37-835740982a42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0, portal: 172.16.0.220,3260]
Dec 06 12:43:32 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0, portal: 172.16.0.220,3260] successful.
Dec 06 12:43:32 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f93a90-26ea-4cf0-9b0b-acc215398fe1]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.compute.manager [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:43:32 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Creating image(s)
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Did not create local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Ensure instance console log exists: /opt/stack/data/nova/instances/3e1b5197-dc38-48a5-b9f9-e053be499433/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Start _get_guest_xml network_info=[{"id": "f373c320-8b0c-440d-b825-d7ec2555b89d", "address": "fa:16:3e:3f:8d:92", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf373c320-8b", "ovs_interfaceid": "f373c320-8b0c-440d-b825-d7ec2555b89d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '5423f4e3-d08c-4756-9443-242bbc6b80e8', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQyuETeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3e1b5197-dc38-48a5-b9f9-e053be499433', 'attached_at': '', 'detached_at': '', 'volume_id': '15434b10-a21d-4ff5-a7d1-d097cc403518', 'serial': '15434b10-a21d-4ff5-a7d1-d097cc403518'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[46aa90cf-d5f1-4ff2-92e7-2b7f5f63940f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:32 user nova-compute[75247]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:43:32 user nova-compute[75247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:43:32 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:32 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:32 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:32 user nova-compute[75247]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:43:32 user nova-compute[75247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:43:32 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:32 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:32 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.394s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:32 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:43:32 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQyuETeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:43:32 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:43:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b3e627-efb5-41e8-8c25-717edc018f56]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:43:32 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'teobKPCy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] COPY block job progress, current cursor: 146800640 final cursor: 1073741824 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] COPY block job progress, current cursor: 306184192 final cursor: 1073741824 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.458s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] <== connect_volume: return (1460ms) {'type': 'block', 'scsi_wwn': '23933303631366262', 'path': '/dev/sdc'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933303631366262', 'path': '/dev/sdc'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.010s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:43:33 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:43:33 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:43:33 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:43:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9341ed74-fd8e-4fe2-b3b2-84c7f51c0c36]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:43:33 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0808ae0-3982-481d-8a75-088b9906294d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518] added
Dec 06 12:43:33 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T12:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1282622112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2112362070',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAvGjqKGelHMukSgIEWiaJYGvjKnXCgFhWE2e9opkG+MtYR0JDGRdm7aO7xPBVUPfutpJlFkjfqa+5bgZXZpZP3Yy5+bfGop2oLmWOnvB+kyfjNOJ8IAYFrs9oEZQCG4w==',key_name='tempest-keypair-863855062',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:41:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='05d12120b32e41b891fd25ca49f9553a',ramdisk_id='',reservation_id='r-ouvdxg8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-888686040',owner_user_name='tempest-ServerActionsV293TestJSON-888686040-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:43:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12dc589ceb3429b8ae09c1413589709',uuid=ed721541-3a94-496f-8b9d-88c74ac83ef7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "795878af-3950-4253-83f2-7656b6ce8fb0", "address": "fa:16:3e:39:75:70", "network": {"id": "b8c04077-286f-434c-a3a6-cde7a124f301", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-378433228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d12120b32e41b891fd25ca49f9553a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795878af-39", "ovs_interfaceid": "795878af-3950-4253-83f2-7656b6ce8fb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Converting VIF {"id": "795878af-3950-4253-83f2-7656b6ce8fb0", "address": "fa:16:3e:39:75:70", "network": {"id": "b8c04077-286f-434c-a3a6-cde7a124f301", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-378433228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d12120b32e41b891fd25ca49f9553a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795878af-39", "ovs_interfaceid": "795878af-3950-4253-83f2-7656b6ce8fb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:75:70,bridge_name='br-int',has_traffic_filtering=True,id=795878af-3950-4253-83f2-7656b6ce8fb0,network=Network(b8c04077-286f-434c-a3a6-cde7a124f301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap795878af-39') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:43:33 user nova-compute[75247]:   <uuid>ed721541-3a94-496f-8b9d-88c74ac83ef7</uuid>
Dec 06 12:43:33 user nova-compute[75247]:   <name>instance-0000000b</name>
Dec 06 12:43:33 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:43:33 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:43:33 user nova-compute[75247]:   <metadata>
Dec 06 12:43:33 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:43:33 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:43:33 user nova-compute[75247]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1282622112</nova:name>
Dec 06 12:43:33 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:43:32</nova:creationTime>
Dec 06 12:43:33 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:43:33 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:43:33 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:43:33 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:43:33 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:43:33 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:43:33 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:43:33 user nova-compute[75247]:       <nova:owner>
Dec 06 12:43:33 user nova-compute[75247]:         <nova:user uuid="c12dc589ceb3429b8ae09c1413589709">tempest-ServerActionsV293TestJSON-888686040-project-member</nova:user>
Dec 06 12:43:33 user nova-compute[75247]:         <nova:project uuid="05d12120b32e41b891fd25ca49f9553a">tempest-ServerActionsV293TestJSON-888686040</nova:project>
Dec 06 12:43:33 user nova-compute[75247]:       </nova:owner>
Dec 06 12:43:33 user nova-compute[75247]:       <nova:ports>
Dec 06 12:43:33 user nova-compute[75247]:         <nova:port uuid="795878af-3950-4253-83f2-7656b6ce8fb0">
Dec 06 12:43:33 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 06 12:43:33 user nova-compute[75247]:         </nova:port>
Dec 06 12:43:33 user nova-compute[75247]:       </nova:ports>
Dec 06 12:43:33 user nova-compute[75247]:     </nova:instance>
Dec 06 12:43:33 user nova-compute[75247]:   </metadata>
Dec 06 12:43:33 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:43:33 user nova-compute[75247]:     <system>
Dec 06 12:43:33 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:43:33 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:43:33 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:43:33 user nova-compute[75247]:       <entry name="serial">ed721541-3a94-496f-8b9d-88c74ac83ef7</entry>
Dec 06 12:43:33 user nova-compute[75247]:       <entry name="uuid">ed721541-3a94-496f-8b9d-88c74ac83ef7</entry>
Dec 06 12:43:33 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:43:33 user nova-compute[75247]:     </system>
Dec 06 12:43:33 user nova-compute[75247]:   </sysinfo>
Dec 06 12:43:33 user nova-compute[75247]:   <os>
Dec 06 12:43:33 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:43:33 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:43:33 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:43:33 user nova-compute[75247]:   </os>
Dec 06 12:43:33 user nova-compute[75247]:   <features>
Dec 06 12:43:33 user nova-compute[75247]:     <acpi/>
Dec 06 12:43:33 user nova-compute[75247]:     <apic/>
Dec 06 12:43:33 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:43:33 user nova-compute[75247]:   </features>
Dec 06 12:43:33 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:43:33 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:43:33 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:43:33 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:43:33 user nova-compute[75247]:   </clock>
Dec 06 12:43:33 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:43:33 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:43:33 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:43:33 user nova-compute[75247]:   </cpu>
Dec 06 12:43:33 user nova-compute[75247]:   <devices>
Dec 06 12:43:33 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 12:43:33 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:43:33 user nova-compute[75247]:       <source dev="/dev/sdc"/>
Dec 06 12:43:33 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:43:33 user nova-compute[75247]:       <serial>f5d30437-2abd-41f4-9626-a1ce202bacb0</serial>
Dec 06 12:43:33 user nova-compute[75247]:     </disk>
Dec 06 12:43:33 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:43:33 user nova-compute[75247]:       <mac address="fa:16:3e:39:75:70"/>
Dec 06 12:43:33 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:43:33 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:43:33 user nova-compute[75247]:       <target dev="tap795878af-39"/>
Dec 06 12:43:33 user nova-compute[75247]:     </interface>
Dec 06 12:43:33 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:43:33 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/ed721541-3a94-496f-8b9d-88c74ac83ef7/console.log" append="off"/>
Dec 06 12:43:33 user nova-compute[75247]:     </serial>
Dec 06 12:43:33 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:43:33 user nova-compute[75247]:     <video>
Dec 06 12:43:33 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:43:33 user nova-compute[75247]:     </video>
Dec 06 12:43:33 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:43:33 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:43:33 user nova-compute[75247]:     </rng>
Dec 06 12:43:33 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:43:33 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:43:33 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:43:33 user nova-compute[75247]:     </memballoon>
Dec 06 12:43:33 user nova-compute[75247]:   </devices>
Dec 06 12:43:33 user nova-compute[75247]: </domain>
Dec 06 12:43:33 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T12:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1282622112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2112362070',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAvGjqKGelHMukSgIEWiaJYGvjKnXCgFhWE2e9opkG+MtYR0JDGRdm7aO7xPBVUPfutpJlFkjfqa+5bgZXZpZP3Yy5+bfGop2oLmWOnvB+kyfjNOJ8IAYFrs9oEZQCG4w==',key_name='tempest-keypair-863855062',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:41:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='05d12120b32e41b891fd25ca49f9553a',ramdisk_id='',reservation_id='r-ouvdxg8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-888686040',owner_user_name='tempest-ServerActionsV293TestJSON-888686040-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:43:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12dc589ceb3429b8ae09c1413589709',uuid=ed721541-3a94-496f-8b9d-88c74ac83ef7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "795878af-3950-4253-83f2-7656b6ce8fb0", "address": "fa:16:3e:39:75:70", "network": {"id": "b8c04077-286f-434c-a3a6-cde7a124f301", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-378433228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d12120b32e41b891fd25ca49f9553a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795878af-39", "ovs_interfaceid": "795878af-3950-4253-83f2-7656b6ce8fb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Converting VIF {"id": "795878af-3950-4253-83f2-7656b6ce8fb0", "address": "fa:16:3e:39:75:70", "network": {"id": "b8c04077-286f-434c-a3a6-cde7a124f301", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-378433228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d12120b32e41b891fd25ca49f9553a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795878af-39", "ovs_interfaceid": "795878af-3950-4253-83f2-7656b6ce8fb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:75:70,bridge_name='br-int',has_traffic_filtering=True,id=795878af-3950-4253-83f2-7656b6ce8fb0,network=Network(b8c04077-286f-434c-a3a6-cde7a124f301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap795878af-39') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG os_vif [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:75:70,bridge_name='br-int',has_traffic_filtering=True,id=795878af-3950-4253-83f2-7656b6ce8fb0,network=Network(b8c04077-286f-434c-a3a6-cde7a124f301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap795878af-39') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '20314134-4086-5bb0-8246-57ead8c0e1cd', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[46114afc-c056-4e3c-9315-2de4bd6c977b]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96e2725-3da7-4d1d-a8d6-8a95c63eb4da]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap795878af-39, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap795878af-39, col_values=(('qos', UUID('65f4736f-a746-4902-8f2e-ce1c359a9ad3')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap795878af-39, col_values=(('external_ids', {'iface-id': '795878af-3950-4253-83f2-7656b6ce8fb0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:75:70', 'vm-uuid': 'ed721541-3a94-496f-8b9d-88c74ac83ef7'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fQyuETeK {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fQyuETeK" returned: 0 in 0.031s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1774f8-0624-45ec-9dc5-3ebb07e2a30b]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fQyuETeK'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:33 user nova-compute[75247]: INFO os_vif [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:75:70,bridge_name='br-int',has_traffic_filtering=True,id=795878af-3950-4253-83f2-7656b6ce8fb0,network=Network(b8c04077-286f-434c-a3a6-cde7a124f301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap795878af-39')
Dec 06 12:43:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[483fbb35-79bc-467d-a974-cd726e05fa04]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec505b40-98a1-4d4a-8b42-ed9f73495564]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:33 user nova-compute[75247]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:43:33 user nova-compute[75247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:43:33 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:33 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:33 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:33 user nova-compute[75247]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:43:33 user nova-compute[75247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:43:33 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:33 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:33 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:43:33 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] No VIF found with MAC fa:16:3e:39:75:70, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:43:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:34 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ea5970-5156-4380-94b7-11cbb5fcc24e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518, portal: 172.16.0.220,3260]
Dec 06 12:43:34 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518, portal: 172.16.0.220,3260] successful.
Dec 06 12:43:34 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:34 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] COPY block job progress, current cursor: 460324864 final cursor: 1073741824 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 12:43:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:34 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f9c56a-fa4c-4c0a-90f1-a6d08b6be9ea]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:34 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[24de5a27-ec44-4774-8c9b-2c825605b5d0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:34 user nova-compute[75247]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:43:34 user nova-compute[75247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:43:34 user nova-compute[75247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:43:34 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:34 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:34 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:43:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:34 user nova-compute[75247]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:43:34 user nova-compute[75247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:43:34 user nova-compute[75247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:43:34 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:34 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:34 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:43:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.427s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:43:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:43:34 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:43:34 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:43:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:34 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[29daa6cd-d608-42eb-a776-be241d71bee5]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:34 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: None {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:43:34 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] COPY block job progress, current cursor: 589299712 final cursor: 1073741824 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] COPY block job progress, current cursor: 730857472 final cursor: 1073741824 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 12:43:35 user nova-compute[75247]: INFO nova.compute.manager [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] [instance: 51c56231-9ff5-45a6-ad38-e7ac68124ed4] Took 8.22 seconds to detach 3 volumes for instance.
Dec 06 12:43:35 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQyuETeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.490s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] <== connect_volume: return (2500ms) {'type': 'block', 'scsi_wwn': '23538373764336132', 'path': '/dev/sdd'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538373764336132', 'path': '/dev/sdd'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:43:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-36313688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-36313688',id=14,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='222da79e3583495d90d5442029996343',ramdisk_id='',reservation_id='r-0exfvqwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:43:15Z,user_data=None,user_id='d0efa55fc4754d96a33d07d52342d8f7',uuid=3e1b5197-dc38-48a5-b9f9-e053be499433,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f373c320-8b0c-440d-b825-d7ec2555b89d", "address": "fa:16:3e:3f:8d:92", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf373c320-8b", "ovs_interfaceid": "f373c320-8b0c-440d-b825-d7ec2555b89d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converting VIF {"id": "f373c320-8b0c-440d-b825-d7ec2555b89d", "address": "fa:16:3e:3f:8d:92", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf373c320-8b", "ovs_interfaceid": "f373c320-8b0c-440d-b825-d7ec2555b89d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:8d:92,bridge_name='br-int',has_traffic_filtering=True,id=f373c320-8b0c-440d-b825-d7ec2555b89d,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf373c320-8b') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG nova.objects.instance [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e1b5197-dc38-48a5-b9f9-e053be499433 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:43:35 user nova-compute[75247]:   <uuid>3e1b5197-dc38-48a5-b9f9-e053be499433</uuid>
Dec 06 12:43:35 user nova-compute[75247]:   <name>instance-0000000e</name>
Dec 06 12:43:35 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:43:35 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:43:35 user nova-compute[75247]:   <metadata>
Dec 06 12:43:35 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:43:35 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:43:35 user nova-compute[75247]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-36313688</nova:name>
Dec 06 12:43:35 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:43:32</nova:creationTime>
Dec 06 12:43:35 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:43:35 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:43:35 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:43:35 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:43:35 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:43:35 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:43:35 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:43:35 user nova-compute[75247]:       <nova:owner>
Dec 06 12:43:35 user nova-compute[75247]:         <nova:user uuid="d0efa55fc4754d96a33d07d52342d8f7">tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member</nova:user>
Dec 06 12:43:35 user nova-compute[75247]:         <nova:project uuid="222da79e3583495d90d5442029996343">tempest-ServerBootFromVolumeStableRescueTest-1200643969</nova:project>
Dec 06 12:43:35 user nova-compute[75247]:       </nova:owner>
Dec 06 12:43:35 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:43:35 user nova-compute[75247]:       <nova:ports>
Dec 06 12:43:35 user nova-compute[75247]:         <nova:port uuid="f373c320-8b0c-440d-b825-d7ec2555b89d">
Dec 06 12:43:35 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 06 12:43:35 user nova-compute[75247]:         </nova:port>
Dec 06 12:43:35 user nova-compute[75247]:       </nova:ports>
Dec 06 12:43:35 user nova-compute[75247]:     </nova:instance>
Dec 06 12:43:35 user nova-compute[75247]:   </metadata>
Dec 06 12:43:35 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:43:35 user nova-compute[75247]:     <system>
Dec 06 12:43:35 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:43:35 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:43:35 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:43:35 user nova-compute[75247]:       <entry name="serial">3e1b5197-dc38-48a5-b9f9-e053be499433</entry>
Dec 06 12:43:35 user nova-compute[75247]:       <entry name="uuid">3e1b5197-dc38-48a5-b9f9-e053be499433</entry>
Dec 06 12:43:35 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:43:35 user nova-compute[75247]:     </system>
Dec 06 12:43:35 user nova-compute[75247]:   </sysinfo>
Dec 06 12:43:35 user nova-compute[75247]:   <os>
Dec 06 12:43:35 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:43:35 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:43:35 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:43:35 user nova-compute[75247]:   </os>
Dec 06 12:43:35 user nova-compute[75247]:   <features>
Dec 06 12:43:35 user nova-compute[75247]:     <acpi/>
Dec 06 12:43:35 user nova-compute[75247]:     <apic/>
Dec 06 12:43:35 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:43:35 user nova-compute[75247]:   </features>
Dec 06 12:43:35 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:43:35 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:43:35 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:43:35 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:43:35 user nova-compute[75247]:   </clock>
Dec 06 12:43:35 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:43:35 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:43:35 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:43:35 user nova-compute[75247]:   </cpu>
Dec 06 12:43:35 user nova-compute[75247]:   <devices>
Dec 06 12:43:35 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 12:43:35 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:43:35 user nova-compute[75247]:       <source dev="/dev/sdd"/>
Dec 06 12:43:35 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:43:35 user nova-compute[75247]:       <serial>15434b10-a21d-4ff5-a7d1-d097cc403518</serial>
Dec 06 12:43:35 user nova-compute[75247]:     </disk>
Dec 06 12:43:35 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:43:35 user nova-compute[75247]:       <mac address="fa:16:3e:3f:8d:92"/>
Dec 06 12:43:35 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:43:35 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:43:35 user nova-compute[75247]:       <target dev="tapf373c320-8b"/>
Dec 06 12:43:35 user nova-compute[75247]:     </interface>
Dec 06 12:43:35 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:43:35 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/3e1b5197-dc38-48a5-b9f9-e053be499433/console.log" append="off"/>
Dec 06 12:43:35 user nova-compute[75247]:     </serial>
Dec 06 12:43:35 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:43:35 user nova-compute[75247]:     <video>
Dec 06 12:43:35 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:43:35 user nova-compute[75247]:     </video>
Dec 06 12:43:35 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:43:35 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:43:35 user nova-compute[75247]:     </rng>
Dec 06 12:43:35 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:43:35 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:43:35 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:43:35 user nova-compute[75247]:     </memballoon>
Dec 06 12:43:35 user nova-compute[75247]:   </devices>
Dec 06 12:43:35 user nova-compute[75247]: </domain>
Dec 06 12:43:35 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:43:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-36313688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-36313688',id=14,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='222da79e3583495d90d5442029996343',ramdisk_id='',reservation_id='r-0exfvqwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:43:15Z,user_data=None,user_id='d0efa55fc4754d96a33d07d52342d8f7',uuid=3e1b5197-dc38-48a5-b9f9-e053be499433,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f373c320-8b0c-440d-b825-d7ec2555b89d", "address": "fa:16:3e:3f:8d:92", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf373c320-8b", "ovs_interfaceid": "f373c320-8b0c-440d-b825-d7ec2555b89d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converting VIF {"id": "f373c320-8b0c-440d-b825-d7ec2555b89d", "address": "fa:16:3e:3f:8d:92", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf373c320-8b", "ovs_interfaceid": "f373c320-8b0c-440d-b825-d7ec2555b89d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:8d:92,bridge_name='br-int',has_traffic_filtering=True,id=f373c320-8b0c-440d-b825-d7ec2555b89d,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf373c320-8b') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG os_vif [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:8d:92,bridge_name='br-int',has_traffic_filtering=True,id=f373c320-8b0c-440d-b825-d7ec2555b89d,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf373c320-8b') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb8d3b35-82c4-514f-a796-c056f1aacfcd', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf373c320-8b, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf373c320-8b, col_values=(('qos', UUID('8aeab400-823b-47e1-834f-eab45f86964a')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf373c320-8b, col_values=(('external_ids', {'iface-id': 'f373c320-8b0c-440d-b825-d7ec2555b89d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:8d:92', 'vm-uuid': '3e1b5197-dc38-48a5-b9f9-e053be499433'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:35 user nova-compute[75247]: INFO os_vif [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:8d:92,bridge_name='br-int',has_traffic_filtering=True,id=f373c320-8b0c-440d-b825-d7ec2555b89d,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf373c320-8b')
Dec 06 12:43:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] No VIF found with MAC fa:16:3e:3f:8d:92, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] COPY block job progress, current cursor: 860880896 final cursor: 1073741824 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.588s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG nova.compute.manager [req-081201c6-3d12-4460-aa14-1bdc5535e5a0 req-3dd0790e-4bef-4c82-8a0c-a1a946937720 service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Received event network-vif-plugged-795878af-3950-4253-83f2-7656b6ce8fb0 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-081201c6-3d12-4460-aa14-1bdc5535e5a0 req-3dd0790e-4bef-4c82-8a0c-a1a946937720 service nova] Acquiring lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-081201c6-3d12-4460-aa14-1bdc5535e5a0 req-3dd0790e-4bef-4c82-8a0c-a1a946937720 service nova] Lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-081201c6-3d12-4460-aa14-1bdc5535e5a0 req-3dd0790e-4bef-4c82-8a0c-a1a946937720 service nova] Lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:35 user nova-compute[75247]: DEBUG nova.compute.manager [req-081201c6-3d12-4460-aa14-1bdc5535e5a0 req-3dd0790e-4bef-4c82-8a0c-a1a946937720 service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] No waiting events found dispatching network-vif-plugged-795878af-3950-4253-83f2-7656b6ce8fb0 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:43:35 user nova-compute[75247]: WARNING nova.compute.manager [req-081201c6-3d12-4460-aa14-1bdc5535e5a0 req-3dd0790e-4bef-4c82-8a0c-a1a946937720 service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Received unexpected event network-vif-plugged-795878af-3950-4253-83f2-7656b6ce8fb0 for instance with vm_state active and task_state rebuild_spawning.
Dec 06 12:43:35 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Deleted allocations for instance 51c56231-9ff5-45a6-ad38-e7ac68124ed4
Dec 06 12:43:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-99503ad2-cc33-45b8-81fa-d43da7c3712c tempest-TaggedBootDevicesTest-1984999958 tempest-TaggedBootDevicesTest-1984999958-project-member] Lock "51c56231-9ff5-45a6-ad38-e7ac68124ed4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.621s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] COPY block job progress, current cursor: 1006632960 final cursor: 1073741824 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 12:43:36 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:36 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:36 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:36 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:36 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 12:43:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:43:36 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFexDjIt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': 'a981a788-9ae3-41c7-b06f-3b797b194bf6'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:43:36 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:43:36 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:43:36 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:43:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:36 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[99debfd9-cf5a-4cbc-8501-62a3d5a2c949]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:36 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:43:36 user nova-compute[75247]: No targets found.
Dec 06 12:43:36 user nova-compute[75247]: iSNS:
Dec 06 12:43:36 user nova-compute[75247]: No targets found.
Dec 06 12:43:36 user nova-compute[75247]: STATIC:
Dec 06 12:43:36 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8
Dec 06 12:43:36 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:36 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:36 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496
Dec 06 12:43:36 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:36 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:36 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:43:36 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:36 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:36 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0
Dec 06 12:43:36 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:36 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:36 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6
Dec 06 12:43:36 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:36 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:36 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482
Dec 06 12:43:36 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:43:36 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:43:36 user nova-compute[75247]: FIRMWARE:
Dec 06 12:43:36 user nova-compute[75247]: No targets found.
Dec 06 12:43:36 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:43:37 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:43:37 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[defb7f00-2632-4c54-9e66-4687aeefc557]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ea9774-fba3-4178-aee1-ac43a7bbe8be]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:37 user nova-compute[75247]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:43:37 user nova-compute[75247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:43:37 user nova-compute[75247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:43:37 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:37 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:37 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 (non-flash)
Dec 06 12:43:37 user nova-compute[75247]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:43:37 user nova-compute[75247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:43:37 user nova-compute[75247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:43:37 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:43:37 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:43:37 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c6103a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6'): ({'sdk'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Removing single pathed devices sdk {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59f8875-b7af-453e-b0e2-3a33a132b963]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b97bb9f-56f2-4b8e-8d84-4bc2db8cbc42]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Flushing IO for device /dev/sdk {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.012s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[862475ea-22c0-4e62-be62-0a22cc8de3b0]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.037s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ed7bf8-fbb9-430b-8a40-29eb83dd3b0d]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] SCSI volumes sdk have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e678973-2b0f-44a3-9033-141f9e1a83d5]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f898e155-1dba-421e-ae6c-b10fb9de3a14]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6, portal: 172.16.0.220,3260]
Dec 06 12:43:37 user nova-compute[75247]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6, portal: 172.16.0.220,3260] successful.
Dec 06 12:43:37 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a981a788-9ae3-41c7-b06f-3b797b194bf6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5f7b6b-a991-41e0-94f6-a7da91dd4e8b]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] <== disconnect_volume: return (355ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycZYnIDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'dbb64a66-f500-407b-ae92-80f27eb6ce2e', 'attached_at': '', 'detached_at': '', 'volume_id': '82a4a39f-5874-4d9f-8936-c14e2d8a0ca8', 'serial'} {{(pid=75247) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] swap_volume: removing Cinder connection for volume a981a788-9ae3-41c7-b06f-3b797b194bf6 {{(pid=75247) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG nova.compute.manager [req-e8a7cd35-d735-4eba-969b-736d33b0497a req-e6796b3c-b54c-4461-96b0-e9da02722fb4 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Received event network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e8a7cd35-d735-4eba-969b-736d33b0497a req-e6796b3c-b54c-4461-96b0-e9da02722fb4 service nova] Acquiring lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e8a7cd35-d735-4eba-969b-736d33b0497a req-e6796b3c-b54c-4461-96b0-e9da02722fb4 service nova] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e8a7cd35-d735-4eba-969b-736d33b0497a req-e6796b3c-b54c-4461-96b0-e9da02722fb4 service nova] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG nova.compute.manager [req-e8a7cd35-d735-4eba-969b-736d33b0497a req-e6796b3c-b54c-4461-96b0-e9da02722fb4 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] No waiting events found dispatching network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:43:37 user nova-compute[75247]: WARNING nova.compute.manager [req-e8a7cd35-d735-4eba-969b-736d33b0497a req-e6796b3c-b54c-4461-96b0-e9da02722fb4 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Received unexpected event network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d for instance with vm_state building and task_state spawning.
Dec 06 12:43:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG nova.compute.manager [req-ebb3679d-0514-4d89-8acf-2d05f2df8458 req-709954a2-a4c7-4a69-886d-ffe3173c6f57 service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Received event network-vif-plugged-795878af-3950-4253-83f2-7656b6ce8fb0 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ebb3679d-0514-4d89-8acf-2d05f2df8458 req-709954a2-a4c7-4a69-886d-ffe3173c6f57 service nova] Acquiring lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ebb3679d-0514-4d89-8acf-2d05f2df8458 req-709954a2-a4c7-4a69-886d-ffe3173c6f57 service nova] Lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ebb3679d-0514-4d89-8acf-2d05f2df8458 req-709954a2-a4c7-4a69-886d-ffe3173c6f57 service nova] Lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:37 user nova-compute[75247]: DEBUG nova.compute.manager [req-ebb3679d-0514-4d89-8acf-2d05f2df8458 req-709954a2-a4c7-4a69-886d-ffe3173c6f57 service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] No waiting events found dispatching network-vif-plugged-795878af-3950-4253-83f2-7656b6ce8fb0 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:43:37 user nova-compute[75247]: WARNING nova.compute.manager [req-ebb3679d-0514-4d89-8acf-2d05f2df8458 req-709954a2-a4c7-4a69-886d-ffe3173c6f57 service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Received unexpected event network-vif-plugged-795878af-3950-4253-83f2-7656b6ce8fb0 for instance with vm_state active and task_state rebuild_spawning.
Dec 06 12:43:38 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Waiting for libvirt event about the detach of device tap4b46350b-53 with device alias net1 from instance f2e75618-9164-4527-a6a3-5f5195effccf is timed out.
Dec 06 12:43:38 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5d:69:9f"/><model type="virtio"/><mtu size="1442"/><target dev="tap4b46350b-53"/></interface> {{(pid=75247) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 06 12:43:38 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:5d:69:9f"/><model type="virtio"/><mtu size="1442"/><target dev="tap4b46350b-53"/></interface>not found in domain: <domain type='kvm' id='9'>
Dec 06 12:43:38 user nova-compute[75247]:   <name>instance-00000009</name>
Dec 06 12:43:38 user nova-compute[75247]:   <uuid>f2e75618-9164-4527-a6a3-5f5195effccf</uuid>
Dec 06 12:43:38 user nova-compute[75247]:   <metadata>
Dec 06 12:43:38 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:43:38 user nova-compute[75247]:   <nova:package version="0.0.0"/>
Dec 06 12:43:38 user nova-compute[75247]:   <nova:name>tempest-device-tagging-server-1618747013</nova:name>
Dec 06 12:43:38 user nova-compute[75247]:   <nova:creationTime>2023-12-06 12:42:39</nova:creationTime>
Dec 06 12:43:38 user nova-compute[75247]:   <nova:flavor name="m1.tiny">
Dec 06 12:43:38 user nova-compute[75247]:     <nova:memory>512</nova:memory>
Dec 06 12:43:38 user nova-compute[75247]:     <nova:disk>1</nova:disk>
Dec 06 12:43:38 user nova-compute[75247]:     <nova:swap>0</nova:swap>
Dec 06 12:43:38 user nova-compute[75247]:     <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:43:38 user nova-compute[75247]:     <nova:vcpus>1</nova:vcpus>
Dec 06 12:43:38 user nova-compute[75247]:   </nova:flavor>
Dec 06 12:43:38 user nova-compute[75247]:   <nova:owner>
Dec 06 12:43:38 user nova-compute[75247]:     <nova:user uuid="14563ea794be4e5bb54c7b4cabde8ee0">tempest-TaggedAttachmentsTest-1141791142-project-member</nova:user>
Dec 06 12:43:38 user nova-compute[75247]:     <nova:project uuid="4031371ec46d42c2bd887bac7edf42a4">tempest-TaggedAttachmentsTest-1141791142</nova:project>
Dec 06 12:43:38 user nova-compute[75247]:   </nova:owner>
Dec 06 12:43:38 user nova-compute[75247]:   <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:43:38 user nova-compute[75247]:   <nova:ports>
Dec 06 12:43:38 user nova-compute[75247]:     <nova:port uuid="68ab6435-5cd9-45bf-891c-c20b68415e11">
Dec 06 12:43:38 user nova-compute[75247]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 12:43:38 user nova-compute[75247]:     </nova:port>
Dec 06 12:43:38 user nova-compute[75247]:     <nova:port uuid="4b46350b-531d-4f9c-89eb-1ebab7067497">
Dec 06 12:43:38 user nova-compute[75247]:       <nova:ip type="fixed" address="10.10.10.66" ipVersion="4"/>
Dec 06 12:43:38 user nova-compute[75247]:     </nova:port>
Dec 06 12:43:38 user nova-compute[75247]:   </nova:ports>
Dec 06 12:43:38 user nova-compute[75247]: </nova:instance>
Dec 06 12:43:38 user nova-compute[75247]:   </metadata>
Dec 06 12:43:38 user nova-compute[75247]:   <memory unit='KiB'>524288</memory>
Dec 06 12:43:38 user nova-compute[75247]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 06 12:43:38 user nova-compute[75247]:   <vcpu placement='static'>1</vcpu>
Dec 06 12:43:38 user nova-compute[75247]:   <resource>
Dec 06 12:43:38 user nova-compute[75247]:     <partition>/machine</partition>
Dec 06 12:43:38 user nova-compute[75247]:   </resource>
Dec 06 12:43:38 user nova-compute[75247]:   <sysinfo type='smbios'>
Dec 06 12:43:38 user nova-compute[75247]:     <system>
Dec 06 12:43:38 user nova-compute[75247]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 06 12:43:38 user nova-compute[75247]:       <entry name='product'>OpenStack Nova</entry>
Dec 06 12:43:38 user nova-compute[75247]:       <entry name='version'>0.0.0</entry>
Dec 06 12:43:38 user nova-compute[75247]:       <entry name='serial'>f2e75618-9164-4527-a6a3-5f5195effccf</entry>
Dec 06 12:43:38 user nova-compute[75247]:       <entry name='uuid'>f2e75618-9164-4527-a6a3-5f5195effccf</entry>
Dec 06 12:43:38 user nova-compute[75247]:       <entry name='family'>Virtual Machine</entry>
Dec 06 12:43:38 user nova-compute[75247]:     </system>
Dec 06 12:43:38 user nova-compute[75247]:   </sysinfo>
Dec 06 12:43:38 user nova-compute[75247]:   <os>
Dec 06 12:43:38 user nova-compute[75247]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 06 12:43:38 user nova-compute[75247]:     <boot dev='hd'/>
Dec 06 12:43:38 user nova-compute[75247]:     <smbios mode='sysinfo'/>
Dec 06 12:43:38 user nova-compute[75247]:   </os>
Dec 06 12:43:38 user nova-compute[75247]:   <features>
Dec 06 12:43:38 user nova-compute[75247]:     <acpi/>
Dec 06 12:43:38 user nova-compute[75247]:     <apic/>
Dec 06 12:43:38 user nova-compute[75247]:     <vmcoreinfo state='on'/>
Dec 06 12:43:38 user nova-compute[75247]:   </features>
Dec 06 12:43:38 user nova-compute[75247]:   <cpu mode='custom' match='exact' check='full'>
Dec 06 12:43:38 user nova-compute[75247]:     <model fallback='forbid'>Nehalem</model>
Dec 06 12:43:38 user nova-compute[75247]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 06 12:43:38 user nova-compute[75247]:     <feature policy='require' name='vme'/>
Dec 06 12:43:38 user nova-compute[75247]:     <feature policy='require' name='x2apic'/>
Dec 06 12:43:38 user nova-compute[75247]:     <feature policy='require' name='hypervisor'/>
Dec 06 12:43:38 user nova-compute[75247]:   </cpu>
Dec 06 12:43:38 user nova-compute[75247]:   <clock offset='utc'>
Dec 06 12:43:38 user nova-compute[75247]:     <timer name='pit' tickpolicy='delay'/>
Dec 06 12:43:38 user nova-compute[75247]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 06 12:43:38 user nova-compute[75247]:     <timer name='hpet' present='no'/>
Dec 06 12:43:38 user nova-compute[75247]:   </clock>
Dec 06 12:43:38 user nova-compute[75247]:   <on_poweroff>destroy</on_poweroff>
Dec 06 12:43:38 user nova-compute[75247]:   <on_reboot>restart</on_reboot>
Dec 06 12:43:38 user nova-compute[75247]:   <on_crash>destroy</on_crash>
Dec 06 12:43:38 user nova-compute[75247]:   <devices>
Dec 06 12:43:38 user nova-compute[75247]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 06 12:43:38 user nova-compute[75247]:     <disk type='file' device='disk'>
Dec 06 12:43:38 user nova-compute[75247]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 06 12:43:38 user nova-compute[75247]:       <source file='/opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk' index='2'/>
Dec 06 12:43:38 user nova-compute[75247]:       <backingStore type='file' index='3'>
Dec 06 12:43:38 user nova-compute[75247]:         <format type='raw'/>
Dec 06 12:43:38 user nova-compute[75247]:         <source file='/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec'/>
Dec 06 12:43:38 user nova-compute[75247]:         <backingStore/>
Dec 06 12:43:38 user nova-compute[75247]:       </backingStore>
Dec 06 12:43:38 user nova-compute[75247]:       <target dev='vda' bus='virtio'/>
Dec 06 12:43:38 user nova-compute[75247]:       <alias name='virtio-disk0'/>
Dec 06 12:43:38 user nova-compute[75247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 06 12:43:38 user nova-compute[75247]:     </disk>
Dec 06 12:43:38 user nova-compute[75247]:     <disk type='file' device='cdrom'>
Dec 06 12:43:38 user nova-compute[75247]:       <driver name='qemu' type='raw' cache='none'/>
Dec 06 12:43:38 user nova-compute[75247]:       <source file='/opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk.config' index='1'/>
Dec 06 12:43:38 user nova-compute[75247]:       <backingStore/>
Dec 06 12:43:38 user nova-compute[75247]:       <target dev='hda' bus='ide'/>
Dec 06 12:43:38 user nova-compute[75247]:       <readonly/>
Dec 06 12:43:38 user nova-compute[75247]:       <alias name='ide0-0-0'/>
Dec 06 12:43:38 user nova-compute[75247]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 06 12:43:38 user nova-compute[75247]:     </disk>
Dec 06 12:43:38 user nova-compute[75247]:     <controller type='usb' index='0' model='none'>
Dec 06 12:43:38 user nova-compute[75247]:       <alias name='usb'/>
Dec 06 12:43:38 user nova-compute[75247]:     </controller>
Dec 06 12:43:38 user nova-compute[75247]:     <controller type='pci' index='0' model='pci-root'>
Dec 06 12:43:38 user nova-compute[75247]:       <alias name='pci.0'/>
Dec 06 12:43:38 user nova-compute[75247]:     </controller>
Dec 06 12:43:38 user nova-compute[75247]:     <controller type='ide' index='0'>
Dec 06 12:43:38 user nova-compute[75247]:       <alias name='ide'/>
Dec 06 12:43:38 user nova-compute[75247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 06 12:43:38 user nova-compute[75247]:     </controller>
Dec 06 12:43:38 user nova-compute[75247]:     <interface type='ethernet'>
Dec 06 12:43:38 user nova-compute[75247]:       <mac address='fa:16:3e:b0:12:84'/>
Dec 06 12:43:38 user nova-compute[75247]:       <target dev='tap68ab6435-5c'/>
Dec 06 12:43:38 user nova-compute[75247]:       <model type='virtio'/>
Dec 06 12:43:38 user nova-compute[75247]:       <mtu size='1442'/>
Dec 06 12:43:38 user nova-compute[75247]:       <alias name='net0'/>
Dec 06 12:43:38 user nova-compute[75247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 06 12:43:38 user nova-compute[75247]:     </interface>
Dec 06 12:43:38 user nova-compute[75247]:     <serial type='pty'>
Dec 06 12:43:38 user nova-compute[75247]:       <source path='/dev/pts/8'/>
Dec 06 12:43:38 user nova-compute[75247]:       <log file='/opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/console.log' append='off'/>
Dec 06 12:43:38 user nova-compute[75247]:       <target type='isa-serial' port='0'>
Dec 06 12:43:38 user nova-compute[75247]:         <model name='isa-serial'/>
Dec 06 12:43:38 user nova-compute[75247]:       </target>
Dec 06 12:43:38 user nova-compute[75247]:       <alias name='serial0'/>
Dec 06 12:43:38 user nova-compute[75247]:     </serial>
Dec 06 12:43:38 user nova-compute[75247]:     <console type='pty' tty='/dev/pts/8'>
Dec 06 12:43:38 user nova-compute[75247]:       <source path='/dev/pts/8'/>
Dec 06 12:43:38 user nova-compute[75247]:       <log file='/opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/console.log' append='off'/>
Dec 06 12:43:38 user nova-compute[75247]:       <target type='serial' port='0'/>
Dec 06 12:43:38 user nova-compute[75247]:       <alias name='serial0'/>
Dec 06 12:43:38 user nova-compute[75247]:     </console>
Dec 06 12:43:38 user nova-compute[75247]:     <input type='mouse' bus='ps2'>
Dec 06 12:43:38 user nova-compute[75247]:       <alias name='input0'/>
Dec 06 12:43:38 user nova-compute[75247]:     </input>
Dec 06 12:43:38 user nova-compute[75247]:     <input type='keyboard' bus='ps2'>
Dec 06 12:43:38 user nova-compute[75247]:       <alias name='input1'/>
Dec 06 12:43:38 user nova-compute[75247]:     </input>
Dec 06 12:43:38 user nova-compute[75247]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Dec 06 12:43:38 user nova-compute[75247]:       <listen type='address' address='0.0.0.0'/>
Dec 06 12:43:38 user nova-compute[75247]:     </graphics>
Dec 06 12:43:38 user nova-compute[75247]:     <audio id='1' type='none'/>
Dec 06 12:43:38 user nova-compute[75247]:     <video>
Dec 06 12:43:38 user nova-compute[75247]:       <model type='virtio' heads='1' primary='yes'/>
Dec 06 12:43:38 user nova-compute[75247]:       <alias name='video0'/>
Dec 06 12:43:38 user nova-compute[75247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 06 12:43:38 user nova-compute[75247]:     </video>
Dec 06 12:43:38 user nova-compute[75247]:     <memballoon model='virtio'>
Dec 06 12:43:38 user nova-compute[75247]:       <stats period='10'/>
Dec 06 12:43:38 user nova-compute[75247]:       <alias name='balloon0'/>
Dec 06 12:43:38 user nova-compute[75247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 06 12:43:38 user nova-compute[75247]:     </memballoon>
Dec 06 12:43:38 user nova-compute[75247]:     <rng model='virtio'>
Dec 06 12:43:38 user nova-compute[75247]:       <backend model='random'>/dev/urandom</backend>
Dec 06 12:43:38 user nova-compute[75247]:       <alias name='rng0'/>
Dec 06 12:43:38 user nova-compute[75247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 06 12:43:38 user nova-compute[75247]:     </rng>
Dec 06 12:43:38 user nova-compute[75247]:   </devices>
Dec 06 12:43:38 user nova-compute[75247]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 06 12:43:38 user nova-compute[75247]:     <label>libvirt-f2e75618-9164-4527-a6a3-5f5195effccf</label>
Dec 06 12:43:38 user nova-compute[75247]:     <imagelabel>libvirt-f2e75618-9164-4527-a6a3-5f5195effccf</imagelabel>
Dec 06 12:43:38 user nova-compute[75247]:   </seclabel>
Dec 06 12:43:38 user nova-compute[75247]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 06 12:43:38 user nova-compute[75247]:     <label>+64055:+108</label>
Dec 06 12:43:38 user nova-compute[75247]:     <imagelabel>+64055:+108</imagelabel>
Dec 06 12:43:38 user nova-compute[75247]:   </seclabel>
Dec 06 12:43:38 user nova-compute[75247]: </domain>
Dec 06 12:43:38 user nova-compute[75247]:  {{(pid=75247) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 06 12:43:38 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Successfully detached device tap4b46350b-53 from instance f2e75618-9164-4527-a6a3-5f5195effccf from the live domain config.
Dec 06 12:43:38 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1618747013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1618747013',id=9,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJqUDXevj4gXj7N7wpZj/XCteR5V+dPOM68FsqKu9Fudl378/ktu9MdzbbKdcoiSMygbRXxj+WBcn7A30ZdIiAz+sQjvUKqzGUuXAmht+5SuCJrZIb25AK4InwaKc1iVg==',key_name='tempest-keypair-76799662',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:40:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4031371ec46d42c2bd887bac7edf42a4',ramdisk_id='',reservation_id='r-ouoqw3qc',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1141791142',owner_user_name='tempest-TaggedAttachmentsTest-1141791142-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:40:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14563ea794be4e5bb54c7b4cabde8ee0',uuid=f2e75618-9164-4527-a6a3-5f5195effccf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b46350b-531d-4f9c-89eb-1ebab7067497", "address": "fa:16:3e:5d:69:9f", "network": {"id": "a51d59c1-8168-46ad-a649-919cd6307bb7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1124351624", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b46350b-53", "ovs_interfaceid": "4b46350b-531d-4f9c-89eb-1ebab7067497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:43:38 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Converting VIF {"id": "4b46350b-531d-4f9c-89eb-1ebab7067497", "address": "fa:16:3e:5d:69:9f", "network": {"id": "a51d59c1-8168-46ad-a649-919cd6307bb7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1124351624", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b46350b-53", "ovs_interfaceid": "4b46350b-531d-4f9c-89eb-1ebab7067497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:43:38 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:69:9f,bridge_name='br-int',has_traffic_filtering=True,id=4b46350b-531d-4f9c-89eb-1ebab7067497,network=Network(a51d59c1-8168-46ad-a649-919cd6307bb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b46350b-53') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:43:38 user nova-compute[75247]: DEBUG os_vif [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:69:9f,bridge_name='br-int',has_traffic_filtering=True,id=4b46350b-531d-4f9c-89eb-1ebab7067497,network=Network(a51d59c1-8168-46ad-a649-919cd6307bb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b46350b-53') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:43:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b46350b-53, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:43:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df318298-7c3e-4149-9c94-eb936bd5a331) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:43:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:38 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] swap_volume: Updating volume a981a788-9ae3-41c7-b06f-3b797b194bf6 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "ycZYnIDC", "auth_password": "BX1CYnmKpAtRrP", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "82a4a39f-5874-4d9f-8936-c14e2d8a0ca8"}, "status": "reserved", "instance": "dbb64a66-f500-407b-ae92-80f27eb6ce2e", "attached_at": "", "detached_at": "", "volume_id": "82a4a39f-5874-4d9f-8936-c14e2d8a0ca8", "serial": "82a4a39f-5874-4d9f-8936-c14e2d8a0ca8"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '82a4a39f-5874-4d9f-8936-c14e2d8a0ca8', 'no_device': None, 'attachment_id': 'a5d2a3f6-3d94-43a4-89b4-c33f1f9d13b2'} {{(pid=75247) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Dec 06 12:43:38 user nova-compute[75247]: INFO os_vif [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:69:9f,bridge_name='br-int',has_traffic_filtering=True,id=4b46350b-531d-4f9c-89eb-1ebab7067497,network=Network(a51d59c1-8168-46ad-a649-919cd6307bb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b46350b-53')
Dec 06 12:43:38 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:43:38 user nova-compute[75247]:   <nova:package version="0.0.0"/>
Dec 06 12:43:38 user nova-compute[75247]:   <nova:name>tempest-device-tagging-server-1618747013</nova:name>
Dec 06 12:43:38 user nova-compute[75247]:   <nova:creationTime>2023-12-06 12:43:38</nova:creationTime>
Dec 06 12:43:38 user nova-compute[75247]:   <nova:flavor name="m1.tiny">
Dec 06 12:43:38 user nova-compute[75247]:     <nova:memory>512</nova:memory>
Dec 06 12:43:38 user nova-compute[75247]:     <nova:disk>1</nova:disk>
Dec 06 12:43:38 user nova-compute[75247]:     <nova:swap>0</nova:swap>
Dec 06 12:43:38 user nova-compute[75247]:     <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:43:38 user nova-compute[75247]:     <nova:vcpus>1</nova:vcpus>
Dec 06 12:43:38 user nova-compute[75247]:   </nova:flavor>
Dec 06 12:43:38 user nova-compute[75247]:   <nova:owner>
Dec 06 12:43:38 user nova-compute[75247]:     <nova:user uuid="14563ea794be4e5bb54c7b4cabde8ee0">tempest-TaggedAttachmentsTest-1141791142-project-member</nova:user>
Dec 06 12:43:38 user nova-compute[75247]:     <nova:project uuid="4031371ec46d42c2bd887bac7edf42a4">tempest-TaggedAttachmentsTest-1141791142</nova:project>
Dec 06 12:43:38 user nova-compute[75247]:   </nova:owner>
Dec 06 12:43:38 user nova-compute[75247]:   <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:43:38 user nova-compute[75247]:   <nova:ports>
Dec 06 12:43:38 user nova-compute[75247]:     <nova:port uuid="68ab6435-5cd9-45bf-891c-c20b68415e11">
Dec 06 12:43:38 user nova-compute[75247]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 12:43:38 user nova-compute[75247]:     </nova:port>
Dec 06 12:43:38 user nova-compute[75247]:   </nova:ports>
Dec 06 12:43:38 user nova-compute[75247]: </nova:instance>
Dec 06 12:43:38 user nova-compute[75247]:  {{(pid=75247) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 06 12:43:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c15c70b3-1b59-4b63-bddb-d1d38d2e8343 tempest-TestVolumeSwap-1501017166 tempest-TestVolumeSwap-1501017166-project-admin] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.893s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Acquiring lock "refresh_cache-f2e75618-9164-4527-a6a3-5f5195effccf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Acquired lock "refresh_cache-f2e75618-9164-4527-a6a3-5f5195effccf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.network.neutron [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.compute.manager [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:43:39 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Instance spawned successfully.
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.compute.manager [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.objects.instance [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75247) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45d47a7e-f108-410c-8f8b-fb032da67513 tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.092s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:39 user nova-compute[75247]: INFO nova.network.neutron [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Port 4b46350b-531d-4f9c-89eb-1ebab7067497 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.network.neutron [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Updating instance_info_cache with network_info: [{"id": "68ab6435-5cd9-45bf-891c-c20b68415e11", "address": "fa:16:3e:b0:12:84", "network": {"id": "c5765401-4948-42dc-bfce-fe0e5ebf3a42", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-751579203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ab6435-5c", "ovs_interfaceid": "68ab6435-5cd9-45bf-891c-c20b68415e11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.compute.manager [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.compute.manager [req-ee437bdf-f615-4ba0-a994-0cff5ad65f76 req-3cd869cb-5125-471b-ab48-65682cd798c5 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Received event network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ee437bdf-f615-4ba0-a994-0cff5ad65f76 req-3cd869cb-5125-471b-ab48-65682cd798c5 service nova] Acquiring lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ee437bdf-f615-4ba0-a994-0cff5ad65f76 req-3cd869cb-5125-471b-ab48-65682cd798c5 service nova] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ee437bdf-f615-4ba0-a994-0cff5ad65f76 req-3cd869cb-5125-471b-ab48-65682cd798c5 service nova] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.compute.manager [req-ee437bdf-f615-4ba0-a994-0cff5ad65f76 req-3cd869cb-5125-471b-ab48-65682cd798c5 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] No waiting events found dispatching network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:43:39 user nova-compute[75247]: WARNING nova.compute.manager [req-ee437bdf-f615-4ba0-a994-0cff5ad65f76 req-3cd869cb-5125-471b-ab48-65682cd798c5 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Received unexpected event network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d for instance with vm_state building and task_state spawning.
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.compute.manager [req-ee437bdf-f615-4ba0-a994-0cff5ad65f76 req-3cd869cb-5125-471b-ab48-65682cd798c5 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Received event network-vif-deleted-4b46350b-531d-4f9c-89eb-1ebab7067497 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:39 user nova-compute[75247]: INFO nova.compute.manager [req-ee437bdf-f615-4ba0-a994-0cff5ad65f76 req-3cd869cb-5125-471b-ab48-65682cd798c5 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Neutron deleted interface 4b46350b-531d-4f9c-89eb-1ebab7067497; detaching it from the instance and deleting it from the info cache
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.network.neutron [req-ee437bdf-f615-4ba0-a994-0cff5ad65f76 req-3cd869cb-5125-471b-ab48-65682cd798c5 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Updating instance_info_cache with network_info: [{"id": "68ab6435-5cd9-45bf-891c-c20b68415e11", "address": "fa:16:3e:b0:12:84", "network": {"id": "c5765401-4948-42dc-bfce-fe0e5ebf3a42", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-751579203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ab6435-5c", "ovs_interfaceid": "68ab6435-5cd9-45bf-891c-c20b68415e11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Releasing lock "refresh_cache-f2e75618-9164-4527-a6a3-5f5195effccf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:43:39 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Instance spawned successfully.
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f0a4d003-7d8a-461a-b561-780683010193 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "interface-f2e75618-9164-4527-a6a3-5f5195effccf-4b46350b-531d-4f9c-89eb-1ebab7067497" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.618s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.objects.instance [req-ee437bdf-f615-4ba0-a994-0cff5ad65f76 req-3cd869cb-5125-471b-ab48-65682cd798c5 service nova] Lazy-loading 'system_metadata' on Instance uuid f2e75618-9164-4527-a6a3-5f5195effccf {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.objects.instance [req-ee437bdf-f615-4ba0-a994-0cff5ad65f76 req-3cd869cb-5125-471b-ab48-65682cd798c5 service nova] Lazy-loading 'flavor' on Instance uuid f2e75618-9164-4527-a6a3-5f5195effccf {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.objects.base [req-ee437bdf-f615-4ba0-a994-0cff5ad65f76 req-3cd869cb-5125-471b-ab48-65682cd798c5 service nova] Object Instance<f2e75618-9164-4527-a6a3-5f5195effccf> lazy-loaded attributes: system_metadata,flavor {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [req-ee437bdf-f615-4ba0-a994-0cff5ad65f76 req-3cd869cb-5125-471b-ab48-65682cd798c5 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1618747013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1618747013',id=9,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJqUDXevj4gXj7N7wpZj/XCteR5V+dPOM68FsqKu9Fudl378/ktu9MdzbbKdcoiSMygbRXxj+WBcn7A30ZdIiAz+sQjvUKqzGUuXAmht+5SuCJrZIb25AK4InwaKc1iVg==',key_name='tempest-keypair-76799662',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:40:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4031371ec46d42c2bd887bac7edf42a4',ramdisk_id='',reservation_id='r-ouoqw3qc',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1141791142',owner_user_name='tempest-TaggedAttachmentsTest-1141791142-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:40:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14563ea794be4e5bb54c7b4cabde8ee0',uuid=f2e75618-9164-4527-a6a3-5f5195effccf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b46350b-531d-4f9c-89eb-1ebab7067497", "address": "fa:16:3e:5d:69:9f", "network": {"id": "a51d59c1-8168-46ad-a649-919cd6307bb7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1124351624", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b46350b-53", "ovs_interfaceid": "4b46350b-531d-4f9c-89eb-1ebab7067497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.network.os_vif_util [req-ee437bdf-f615-4ba0-a994-0cff5ad65f76 req-3cd869cb-5125-471b-ab48-65682cd798c5 service nova] Converting VIF {"id": "4b46350b-531d-4f9c-89eb-1ebab7067497", "address": "fa:16:3e:5d:69:9f", "network": {"id": "a51d59c1-8168-46ad-a649-919cd6307bb7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1124351624", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b46350b-53", "ovs_interfaceid": "4b46350b-531d-4f9c-89eb-1ebab7067497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.network.os_vif_util [req-ee437bdf-f615-4ba0-a994-0cff5ad65f76 req-3cd869cb-5125-471b-ab48-65682cd798c5 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:69:9f,bridge_name='br-int',has_traffic_filtering=True,id=4b46350b-531d-4f9c-89eb-1ebab7067497,network=Network(a51d59c1-8168-46ad-a649-919cd6307bb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b46350b-53') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [req-ee437bdf-f615-4ba0-a994-0cff5ad65f76 req-3cd869cb-5125-471b-ab48-65682cd798c5 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5d:69:9f"/><model type="virtio"/><mtu size="1442"/><target dev="tap4b46350b-53"/></interface> {{(pid=75247) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [req-ee437bdf-f615-4ba0-a994-0cff5ad65f76 req-3cd869cb-5125-471b-ab48-65682cd798c5 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:5d:69:9f"/><model type="virtio"/><mtu size="1442"/><target dev="tap4b46350b-53"/></interface>not found in domain: <domain type='kvm' id='9'>
Dec 06 12:43:39 user nova-compute[75247]:   <name>instance-00000009</name>
Dec 06 12:43:39 user nova-compute[75247]:   <uuid>f2e75618-9164-4527-a6a3-5f5195effccf</uuid>
Dec 06 12:43:39 user nova-compute[75247]:   <metadata>
Dec 06 12:43:39 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:43:39 user nova-compute[75247]:   <nova:package version="0.0.0"/>
Dec 06 12:43:39 user nova-compute[75247]:   <nova:name>tempest-device-tagging-server-1618747013</nova:name>
Dec 06 12:43:39 user nova-compute[75247]:   <nova:creationTime>2023-12-06 12:43:38</nova:creationTime>
Dec 06 12:43:39 user nova-compute[75247]:   <nova:flavor name="m1.tiny">
Dec 06 12:43:39 user nova-compute[75247]:     <nova:memory>512</nova:memory>
Dec 06 12:43:39 user nova-compute[75247]:     <nova:disk>1</nova:disk>
Dec 06 12:43:39 user nova-compute[75247]:     <nova:swap>0</nova:swap>
Dec 06 12:43:39 user nova-compute[75247]:     <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:43:39 user nova-compute[75247]:     <nova:vcpus>1</nova:vcpus>
Dec 06 12:43:39 user nova-compute[75247]:   </nova:flavor>
Dec 06 12:43:39 user nova-compute[75247]:   <nova:owner>
Dec 06 12:43:39 user nova-compute[75247]:     <nova:user uuid="14563ea794be4e5bb54c7b4cabde8ee0">tempest-TaggedAttachmentsTest-1141791142-project-member</nova:user>
Dec 06 12:43:39 user nova-compute[75247]:     <nova:project uuid="4031371ec46d42c2bd887bac7edf42a4">tempest-TaggedAttachmentsTest-1141791142</nova:project>
Dec 06 12:43:39 user nova-compute[75247]:   </nova:owner>
Dec 06 12:43:39 user nova-compute[75247]:   <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:43:39 user nova-compute[75247]:   <nova:ports>
Dec 06 12:43:39 user nova-compute[75247]:     <nova:port uuid="68ab6435-5cd9-45bf-891c-c20b68415e11">
Dec 06 12:43:39 user nova-compute[75247]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 12:43:39 user nova-compute[75247]:     </nova:port>
Dec 06 12:43:39 user nova-compute[75247]:   </nova:ports>
Dec 06 12:43:39 user nova-compute[75247]: </nova:instance>
Dec 06 12:43:39 user nova-compute[75247]:   </metadata>
Dec 06 12:43:39 user nova-compute[75247]:   <memory unit='KiB'>524288</memory>
Dec 06 12:43:39 user nova-compute[75247]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 06 12:43:39 user nova-compute[75247]:   <vcpu placement='static'>1</vcpu>
Dec 06 12:43:39 user nova-compute[75247]:   <resource>
Dec 06 12:43:39 user nova-compute[75247]:     <partition>/machine</partition>
Dec 06 12:43:39 user nova-compute[75247]:   </resource>
Dec 06 12:43:39 user nova-compute[75247]:   <sysinfo type='smbios'>
Dec 06 12:43:39 user nova-compute[75247]:     <system>
Dec 06 12:43:39 user nova-compute[75247]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 06 12:43:39 user nova-compute[75247]:       <entry name='product'>OpenStack Nova</entry>
Dec 06 12:43:39 user nova-compute[75247]:       <entry name='version'>0.0.0</entry>
Dec 06 12:43:39 user nova-compute[75247]:       <entry name='serial'>f2e75618-9164-4527-a6a3-5f5195effccf</entry>
Dec 06 12:43:39 user nova-compute[75247]:       <entry name='uuid'>f2e75618-9164-4527-a6a3-5f5195effccf</entry>
Dec 06 12:43:39 user nova-compute[75247]:       <entry name='family'>Virtual Machine</entry>
Dec 06 12:43:39 user nova-compute[75247]:     </system>
Dec 06 12:43:39 user nova-compute[75247]:   </sysinfo>
Dec 06 12:43:39 user nova-compute[75247]:   <os>
Dec 06 12:43:39 user nova-compute[75247]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 06 12:43:39 user nova-compute[75247]:     <boot dev='hd'/>
Dec 06 12:43:39 user nova-compute[75247]:     <smbios mode='sysinfo'/>
Dec 06 12:43:39 user nova-compute[75247]:   </os>
Dec 06 12:43:39 user nova-compute[75247]:   <features>
Dec 06 12:43:39 user nova-compute[75247]:     <acpi/>
Dec 06 12:43:39 user nova-compute[75247]:     <apic/>
Dec 06 12:43:39 user nova-compute[75247]:     <vmcoreinfo state='on'/>
Dec 06 12:43:39 user nova-compute[75247]:   </features>
Dec 06 12:43:39 user nova-compute[75247]:   <cpu mode='custom' match='exact' check='full'>
Dec 06 12:43:39 user nova-compute[75247]:     <model fallback='forbid'>Nehalem</model>
Dec 06 12:43:39 user nova-compute[75247]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 06 12:43:39 user nova-compute[75247]:     <feature policy='require' name='vme'/>
Dec 06 12:43:39 user nova-compute[75247]:     <feature policy='require' name='x2apic'/>
Dec 06 12:43:39 user nova-compute[75247]:     <feature policy='require' name='hypervisor'/>
Dec 06 12:43:39 user nova-compute[75247]:   </cpu>
Dec 06 12:43:39 user nova-compute[75247]:   <clock offset='utc'>
Dec 06 12:43:39 user nova-compute[75247]:     <timer name='pit' tickpolicy='delay'/>
Dec 06 12:43:39 user nova-compute[75247]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 06 12:43:39 user nova-compute[75247]:     <timer name='hpet' present='no'/>
Dec 06 12:43:39 user nova-compute[75247]:   </clock>
Dec 06 12:43:39 user nova-compute[75247]:   <on_poweroff>destroy</on_poweroff>
Dec 06 12:43:39 user nova-compute[75247]:   <on_reboot>restart</on_reboot>
Dec 06 12:43:39 user nova-compute[75247]:   <on_crash>destroy</on_crash>
Dec 06 12:43:39 user nova-compute[75247]:   <devices>
Dec 06 12:43:39 user nova-compute[75247]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 06 12:43:39 user nova-compute[75247]:     <disk type='file' device='disk'>
Dec 06 12:43:39 user nova-compute[75247]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 06 12:43:39 user nova-compute[75247]:       <source file='/opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk' index='2'/>
Dec 06 12:43:39 user nova-compute[75247]:       <backingStore type='file' index='3'>
Dec 06 12:43:39 user nova-compute[75247]:         <format type='raw'/>
Dec 06 12:43:39 user nova-compute[75247]:         <source file='/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec'/>
Dec 06 12:43:39 user nova-compute[75247]:         <backingStore/>
Dec 06 12:43:39 user nova-compute[75247]:       </backingStore>
Dec 06 12:43:39 user nova-compute[75247]:       <target dev='vda' bus='virtio'/>
Dec 06 12:43:39 user nova-compute[75247]:       <alias name='virtio-disk0'/>
Dec 06 12:43:39 user nova-compute[75247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 06 12:43:39 user nova-compute[75247]:     </disk>
Dec 06 12:43:39 user nova-compute[75247]:     <disk type='file' device='cdrom'>
Dec 06 12:43:39 user nova-compute[75247]:       <driver name='qemu' type='raw' cache='none'/>
Dec 06 12:43:39 user nova-compute[75247]:       <source file='/opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk.config' index='1'/>
Dec 06 12:43:39 user nova-compute[75247]:       <backingStore/>
Dec 06 12:43:39 user nova-compute[75247]:       <target dev='hda' bus='ide'/>
Dec 06 12:43:39 user nova-compute[75247]:       <readonly/>
Dec 06 12:43:39 user nova-compute[75247]:       <alias name='ide0-0-0'/>
Dec 06 12:43:39 user nova-compute[75247]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 06 12:43:39 user nova-compute[75247]:     </disk>
Dec 06 12:43:39 user nova-compute[75247]:     <controller type='usb' index='0' model='none'>
Dec 06 12:43:39 user nova-compute[75247]:       <alias name='usb'/>
Dec 06 12:43:39 user nova-compute[75247]:     </controller>
Dec 06 12:43:39 user nova-compute[75247]:     <controller type='pci' index='0' model='pci-root'>
Dec 06 12:43:39 user nova-compute[75247]:       <alias name='pci.0'/>
Dec 06 12:43:39 user nova-compute[75247]:     </controller>
Dec 06 12:43:39 user nova-compute[75247]:     <controller type='ide' index='0'>
Dec 06 12:43:39 user nova-compute[75247]:       <alias name='ide'/>
Dec 06 12:43:39 user nova-compute[75247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 06 12:43:39 user nova-compute[75247]:     </controller>
Dec 06 12:43:39 user nova-compute[75247]:     <interface type='ethernet'>
Dec 06 12:43:39 user nova-compute[75247]:       <mac address='fa:16:3e:b0:12:84'/>
Dec 06 12:43:39 user nova-compute[75247]:       <target dev='tap68ab6435-5c'/>
Dec 06 12:43:39 user nova-compute[75247]:       <model type='virtio'/>
Dec 06 12:43:39 user nova-compute[75247]:       <mtu size='1442'/>
Dec 06 12:43:39 user nova-compute[75247]:       <alias name='net0'/>
Dec 06 12:43:39 user nova-compute[75247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 06 12:43:39 user nova-compute[75247]:     </interface>
Dec 06 12:43:39 user nova-compute[75247]:     <serial type='pty'>
Dec 06 12:43:39 user nova-compute[75247]:       <source path='/dev/pts/8'/>
Dec 06 12:43:39 user nova-compute[75247]:       <log file='/opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/console.log' append='off'/>
Dec 06 12:43:39 user nova-compute[75247]:       <target type='isa-serial' port='0'>
Dec 06 12:43:39 user nova-compute[75247]:         <model name='isa-serial'/>
Dec 06 12:43:39 user nova-compute[75247]:       </target>
Dec 06 12:43:39 user nova-compute[75247]:       <alias name='serial0'/>
Dec 06 12:43:39 user nova-compute[75247]:     </serial>
Dec 06 12:43:39 user nova-compute[75247]:     <console type='pty' tty='/dev/pts/8'>
Dec 06 12:43:39 user nova-compute[75247]:       <source path='/dev/pts/8'/>
Dec 06 12:43:39 user nova-compute[75247]:       <log file='/opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/console.log' append='off'/>
Dec 06 12:43:39 user nova-compute[75247]:       <target type='serial' port='0'/>
Dec 06 12:43:39 user nova-compute[75247]:       <alias name='serial0'/>
Dec 06 12:43:39 user nova-compute[75247]:     </console>
Dec 06 12:43:39 user nova-compute[75247]:     <input type='mouse' bus='ps2'>
Dec 06 12:43:39 user nova-compute[75247]:       <alias name='input0'/>
Dec 06 12:43:39 user nova-compute[75247]:     </input>
Dec 06 12:43:39 user nova-compute[75247]:     <input type='keyboard' bus='ps2'>
Dec 06 12:43:39 user nova-compute[75247]:       <alias name='input1'/>
Dec 06 12:43:39 user nova-compute[75247]:     </input>
Dec 06 12:43:39 user nova-compute[75247]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Dec 06 12:43:39 user nova-compute[75247]:       <listen type='address' address='0.0.0.0'/>
Dec 06 12:43:39 user nova-compute[75247]:     </graphics>
Dec 06 12:43:39 user nova-compute[75247]:     <audio id='1' type='none'/>
Dec 06 12:43:39 user nova-compute[75247]:     <video>
Dec 06 12:43:39 user nova-compute[75247]:       <model type='virtio' heads='1' primary='yes'/>
Dec 06 12:43:39 user nova-compute[75247]:       <alias name='video0'/>
Dec 06 12:43:39 user nova-compute[75247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 06 12:43:39 user nova-compute[75247]:     </video>
Dec 06 12:43:39 user nova-compute[75247]:     <memballoon model='virtio'>
Dec 06 12:43:39 user nova-compute[75247]:       <stats period='10'/>
Dec 06 12:43:39 user nova-compute[75247]:       <alias name='balloon0'/>
Dec 06 12:43:39 user nova-compute[75247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 06 12:43:39 user nova-compute[75247]:     </memballoon>
Dec 06 12:43:39 user nova-compute[75247]:     <rng model='virtio'>
Dec 06 12:43:39 user nova-compute[75247]:       <backend model='random'>/dev/urandom</backend>
Dec 06 12:43:39 user nova-compute[75247]:       <alias name='rng0'/>
Dec 06 12:43:39 user nova-compute[75247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 06 12:43:39 user nova-compute[75247]:     </rng>
Dec 06 12:43:39 user nova-compute[75247]:   </devices>
Dec 06 12:43:39 user nova-compute[75247]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 06 12:43:39 user nova-compute[75247]:     <label>libvirt-f2e75618-9164-4527-a6a3-5f5195effccf</label>
Dec 06 12:43:39 user nova-compute[75247]:     <imagelabel>libvirt-f2e75618-9164-4527-a6a3-5f5195effccf</imagelabel>
Dec 06 12:43:39 user nova-compute[75247]:   </seclabel>
Dec 06 12:43:39 user nova-compute[75247]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 06 12:43:39 user nova-compute[75247]:     <label>+64055:+108</label>
Dec 06 12:43:39 user nova-compute[75247]:     <imagelabel>+64055:+108</imagelabel>
Dec 06 12:43:39 user nova-compute[75247]:   </seclabel>
Dec 06 12:43:39 user nova-compute[75247]: </domain>
Dec 06 12:43:39 user nova-compute[75247]:  {{(pid=75247) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [req-ee437bdf-f615-4ba0-a994-0cff5ad65f76 req-3cd869cb-5125-471b-ab48-65682cd798c5 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5d:69:9f"/><model type="virtio"/><mtu size="1442"/><target dev="tap4b46350b-53"/></interface> {{(pid=75247) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [req-ee437bdf-f615-4ba0-a994-0cff5ad65f76 req-3cd869cb-5125-471b-ab48-65682cd798c5 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:5d:69:9f"/><model type="virtio"/><mtu size="1442"/><target dev="tap4b46350b-53"/></interface>not found in domain: <domain type='kvm' id='9'>
Dec 06 12:43:39 user nova-compute[75247]:   <name>instance-00000009</name>
Dec 06 12:43:39 user nova-compute[75247]:   <uuid>f2e75618-9164-4527-a6a3-5f5195effccf</uuid>
Dec 06 12:43:39 user nova-compute[75247]:   <metadata>
Dec 06 12:43:39 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:43:39 user nova-compute[75247]:   <nova:package version="0.0.0"/>
Dec 06 12:43:39 user nova-compute[75247]:   <nova:name>tempest-device-tagging-server-1618747013</nova:name>
Dec 06 12:43:39 user nova-compute[75247]:   <nova:creationTime>2023-12-06 12:43:38</nova:creationTime>
Dec 06 12:43:39 user nova-compute[75247]:   <nova:flavor name="m1.tiny">
Dec 06 12:43:39 user nova-compute[75247]:     <nova:memory>512</nova:memory>
Dec 06 12:43:39 user nova-compute[75247]:     <nova:disk>1</nova:disk>
Dec 06 12:43:39 user nova-compute[75247]:     <nova:swap>0</nova:swap>
Dec 06 12:43:39 user nova-compute[75247]:     <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:43:39 user nova-compute[75247]:     <nova:vcpus>1</nova:vcpus>
Dec 06 12:43:39 user nova-compute[75247]:   </nova:flavor>
Dec 06 12:43:39 user nova-compute[75247]:   <nova:owner>
Dec 06 12:43:39 user nova-compute[75247]:     <nova:user uuid="14563ea794be4e5bb54c7b4cabde8ee0">tempest-TaggedAttachmentsTest-1141791142-project-member</nova:user>
Dec 06 12:43:39 user nova-compute[75247]:     <nova:project uuid="4031371ec46d42c2bd887bac7edf42a4">tempest-TaggedAttachmentsTest-1141791142</nova:project>
Dec 06 12:43:39 user nova-compute[75247]:   </nova:owner>
Dec 06 12:43:39 user nova-compute[75247]:   <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:43:39 user nova-compute[75247]:   <nova:ports>
Dec 06 12:43:39 user nova-compute[75247]:     <nova:port uuid="68ab6435-5cd9-45bf-891c-c20b68415e11">
Dec 06 12:43:39 user nova-compute[75247]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 12:43:39 user nova-compute[75247]:     </nova:port>
Dec 06 12:43:39 user nova-compute[75247]:   </nova:ports>
Dec 06 12:43:39 user nova-compute[75247]: </nova:instance>
Dec 06 12:43:39 user nova-compute[75247]:   </metadata>
Dec 06 12:43:39 user nova-compute[75247]:   <memory unit='KiB'>524288</memory>
Dec 06 12:43:39 user nova-compute[75247]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 06 12:43:39 user nova-compute[75247]:   <vcpu placement='static'>1</vcpu>
Dec 06 12:43:39 user nova-compute[75247]:   <resource>
Dec 06 12:43:39 user nova-compute[75247]:     <partition>/machine</partition>
Dec 06 12:43:39 user nova-compute[75247]:   </resource>
Dec 06 12:43:39 user nova-compute[75247]:   <sysinfo type='smbios'>
Dec 06 12:43:39 user nova-compute[75247]:     <system>
Dec 06 12:43:39 user nova-compute[75247]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 06 12:43:39 user nova-compute[75247]:       <entry name='product'>OpenStack Nova</entry>
Dec 06 12:43:39 user nova-compute[75247]:       <entry name='version'>0.0.0</entry>
Dec 06 12:43:39 user nova-compute[75247]:       <entry name='serial'>f2e75618-9164-4527-a6a3-5f5195effccf</entry>
Dec 06 12:43:39 user nova-compute[75247]:       <entry name='uuid'>f2e75618-9164-4527-a6a3-5f5195effccf</entry>
Dec 06 12:43:39 user nova-compute[75247]:       <entry name='family'>Virtual Machine</entry>
Dec 06 12:43:39 user nova-compute[75247]:     </system>
Dec 06 12:43:39 user nova-compute[75247]:   </sysinfo>
Dec 06 12:43:39 user nova-compute[75247]:   <os>
Dec 06 12:43:39 user nova-compute[75247]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 06 12:43:39 user nova-compute[75247]:     <boot dev='hd'/>
Dec 06 12:43:39 user nova-compute[75247]:     <smbios mode='sysinfo'/>
Dec 06 12:43:39 user nova-compute[75247]:   </os>
Dec 06 12:43:39 user nova-compute[75247]:   <features>
Dec 06 12:43:39 user nova-compute[75247]:     <acpi/>
Dec 06 12:43:39 user nova-compute[75247]:     <apic/>
Dec 06 12:43:39 user nova-compute[75247]:     <vmcoreinfo state='on'/>
Dec 06 12:43:39 user nova-compute[75247]:   </features>
Dec 06 12:43:39 user nova-compute[75247]:   <cpu mode='custom' match='exact' check='full'>
Dec 06 12:43:39 user nova-compute[75247]:     <model fallback='forbid'>Nehalem</model>
Dec 06 12:43:39 user nova-compute[75247]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 06 12:43:39 user nova-compute[75247]:     <feature policy='require' name='vme'/>
Dec 06 12:43:39 user nova-compute[75247]:     <feature policy='require' name='x2apic'/>
Dec 06 12:43:39 user nova-compute[75247]:     <feature policy='require' name='hypervisor'/>
Dec 06 12:43:39 user nova-compute[75247]:   </cpu>
Dec 06 12:43:39 user nova-compute[75247]:   <clock offset='utc'>
Dec 06 12:43:39 user nova-compute[75247]:     <timer name='pit' tickpolicy='delay'/>
Dec 06 12:43:39 user nova-compute[75247]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 06 12:43:39 user nova-compute[75247]:     <timer name='hpet' present='no'/>
Dec 06 12:43:39 user nova-compute[75247]:   </clock>
Dec 06 12:43:39 user nova-compute[75247]:   <on_poweroff>destroy</on_poweroff>
Dec 06 12:43:39 user nova-compute[75247]:   <on_reboot>restart</on_reboot>
Dec 06 12:43:39 user nova-compute[75247]:   <on_crash>destroy</on_crash>
Dec 06 12:43:39 user nova-compute[75247]:   <devices>
Dec 06 12:43:39 user nova-compute[75247]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 06 12:43:39 user nova-compute[75247]:     <disk type='file' device='disk'>
Dec 06 12:43:39 user nova-compute[75247]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 06 12:43:39 user nova-compute[75247]:       <source file='/opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk' index='2'/>
Dec 06 12:43:39 user nova-compute[75247]:       <backingStore type='file' index='3'>
Dec 06 12:43:39 user nova-compute[75247]:         <format type='raw'/>
Dec 06 12:43:39 user nova-compute[75247]:         <source file='/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec'/>
Dec 06 12:43:39 user nova-compute[75247]:         <backingStore/>
Dec 06 12:43:39 user nova-compute[75247]:       </backingStore>
Dec 06 12:43:39 user nova-compute[75247]:       <target dev='vda' bus='virtio'/>
Dec 06 12:43:39 user nova-compute[75247]:       <alias name='virtio-disk0'/>
Dec 06 12:43:39 user nova-compute[75247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 06 12:43:39 user nova-compute[75247]:     </disk>
Dec 06 12:43:39 user nova-compute[75247]:     <disk type='file' device='cdrom'>
Dec 06 12:43:39 user nova-compute[75247]:       <driver name='qemu' type='raw' cache='none'/>
Dec 06 12:43:39 user nova-compute[75247]:       <source file='/opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/disk.config' index='1'/>
Dec 06 12:43:39 user nova-compute[75247]:       <backingStore/>
Dec 06 12:43:39 user nova-compute[75247]:       <target dev='hda' bus='ide'/>
Dec 06 12:43:39 user nova-compute[75247]:       <readonly/>
Dec 06 12:43:39 user nova-compute[75247]:       <alias name='ide0-0-0'/>
Dec 06 12:43:39 user nova-compute[75247]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 06 12:43:39 user nova-compute[75247]:     </disk>
Dec 06 12:43:39 user nova-compute[75247]:     <controller type='usb' index='0' model='none'>
Dec 06 12:43:39 user nova-compute[75247]:       <alias name='usb'/>
Dec 06 12:43:39 user nova-compute[75247]:     </controller>
Dec 06 12:43:39 user nova-compute[75247]:     <controller type='pci' index='0' model='pci-root'>
Dec 06 12:43:39 user nova-compute[75247]:       <alias name='pci.0'/>
Dec 06 12:43:39 user nova-compute[75247]:     </controller>
Dec 06 12:43:39 user nova-compute[75247]:     <controller type='ide' index='0'>
Dec 06 12:43:39 user nova-compute[75247]:       <alias name='ide'/>
Dec 06 12:43:39 user nova-compute[75247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 06 12:43:39 user nova-compute[75247]:     </controller>
Dec 06 12:43:39 user nova-compute[75247]:     <interface type='ethernet'>
Dec 06 12:43:39 user nova-compute[75247]:       <mac address='fa:16:3e:b0:12:84'/>
Dec 06 12:43:39 user nova-compute[75247]:       <target dev='tap68ab6435-5c'/>
Dec 06 12:43:39 user nova-compute[75247]:       <model type='virtio'/>
Dec 06 12:43:39 user nova-compute[75247]:       <mtu size='1442'/>
Dec 06 12:43:39 user nova-compute[75247]:       <alias name='net0'/>
Dec 06 12:43:39 user nova-compute[75247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 06 12:43:39 user nova-compute[75247]:     </interface>
Dec 06 12:43:39 user nova-compute[75247]:     <serial type='pty'>
Dec 06 12:43:39 user nova-compute[75247]:       <source path='/dev/pts/8'/>
Dec 06 12:43:39 user nova-compute[75247]:       <log file='/opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/console.log' append='off'/>
Dec 06 12:43:39 user nova-compute[75247]:       <target type='isa-serial' port='0'>
Dec 06 12:43:39 user nova-compute[75247]:         <model name='isa-serial'/>
Dec 06 12:43:39 user nova-compute[75247]:       </target>
Dec 06 12:43:39 user nova-compute[75247]:       <alias name='serial0'/>
Dec 06 12:43:39 user nova-compute[75247]:     </serial>
Dec 06 12:43:39 user nova-compute[75247]:     <console type='pty' tty='/dev/pts/8'>
Dec 06 12:43:39 user nova-compute[75247]:       <source path='/dev/pts/8'/>
Dec 06 12:43:39 user nova-compute[75247]:       <log file='/opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf/console.log' append='off'/>
Dec 06 12:43:39 user nova-compute[75247]:       <target type='serial' port='0'/>
Dec 06 12:43:39 user nova-compute[75247]:       <alias name='serial0'/>
Dec 06 12:43:39 user nova-compute[75247]:     </console>
Dec 06 12:43:39 user nova-compute[75247]:     <input type='mouse' bus='ps2'>
Dec 06 12:43:39 user nova-compute[75247]:       <alias name='input0'/>
Dec 06 12:43:39 user nova-compute[75247]:     </input>
Dec 06 12:43:39 user nova-compute[75247]:     <input type='keyboard' bus='ps2'>
Dec 06 12:43:39 user nova-compute[75247]:       <alias name='input1'/>
Dec 06 12:43:39 user nova-compute[75247]:     </input>
Dec 06 12:43:39 user nova-compute[75247]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Dec 06 12:43:39 user nova-compute[75247]:       <listen type='address' address='0.0.0.0'/>
Dec 06 12:43:39 user nova-compute[75247]:     </graphics>
Dec 06 12:43:39 user nova-compute[75247]:     <audio id='1' type='none'/>
Dec 06 12:43:39 user nova-compute[75247]:     <video>
Dec 06 12:43:39 user nova-compute[75247]:       <model type='virtio' heads='1' primary='yes'/>
Dec 06 12:43:39 user nova-compute[75247]:       <alias name='video0'/>
Dec 06 12:43:39 user nova-compute[75247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 06 12:43:39 user nova-compute[75247]:     </video>
Dec 06 12:43:39 user nova-compute[75247]:     <memballoon model='virtio'>
Dec 06 12:43:39 user nova-compute[75247]:       <stats period='10'/>
Dec 06 12:43:39 user nova-compute[75247]:       <alias name='balloon0'/>
Dec 06 12:43:39 user nova-compute[75247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 06 12:43:39 user nova-compute[75247]:     </memballoon>
Dec 06 12:43:39 user nova-compute[75247]:     <rng model='virtio'>
Dec 06 12:43:39 user nova-compute[75247]:       <backend model='random'>/dev/urandom</backend>
Dec 06 12:43:39 user nova-compute[75247]:       <alias name='rng0'/>
Dec 06 12:43:39 user nova-compute[75247]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 06 12:43:39 user nova-compute[75247]:     </rng>
Dec 06 12:43:39 user nova-compute[75247]:   </devices>
Dec 06 12:43:39 user nova-compute[75247]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 06 12:43:39 user nova-compute[75247]:     <label>libvirt-f2e75618-9164-4527-a6a3-5f5195effccf</label>
Dec 06 12:43:39 user nova-compute[75247]:     <imagelabel>libvirt-f2e75618-9164-4527-a6a3-5f5195effccf</imagelabel>
Dec 06 12:43:39 user nova-compute[75247]:   </seclabel>
Dec 06 12:43:39 user nova-compute[75247]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 06 12:43:39 user nova-compute[75247]:     <label>+64055:+108</label>
Dec 06 12:43:39 user nova-compute[75247]:     <imagelabel>+64055:+108</imagelabel>
Dec 06 12:43:39 user nova-compute[75247]:   </seclabel>
Dec 06 12:43:39 user nova-compute[75247]: </domain>
Dec 06 12:43:39 user nova-compute[75247]:  {{(pid=75247) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 06 12:43:39 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [req-ee437bdf-f615-4ba0-a994-0cff5ad65f76 req-3cd869cb-5125-471b-ab48-65682cd798c5 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Detaching interface fa:16:3e:5d:69:9f failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap4b46350b-53' not found.
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [req-ee437bdf-f615-4ba0-a994-0cff5ad65f76 req-3cd869cb-5125-471b-ab48-65682cd798c5 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1618747013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1618747013',id=9,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJqUDXevj4gXj7N7wpZj/XCteR5V+dPOM68FsqKu9Fudl378/ktu9MdzbbKdcoiSMygbRXxj+WBcn7A30ZdIiAz+sQjvUKqzGUuXAmht+5SuCJrZIb25AK4InwaKc1iVg==',key_name='tempest-keypair-76799662',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:40:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4031371ec46d42c2bd887bac7edf42a4',ramdisk_id='',reservation_id='r-ouoqw3qc',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1141791142',owner_user_name='tempest-TaggedAttachmentsTest-1141791142-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:40:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14563ea794be4e5bb54c7b4cabde8ee0',uuid=f2e75618-9164-4527-a6a3-5f5195effccf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b46350b-531d-4f9c-89eb-1ebab7067497", "address": "fa:16:3e:5d:69:9f", "network": {"id": "a51d59c1-8168-46ad-a649-919cd6307bb7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1124351624", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b46350b-53", "ovs_interfaceid": "4b46350b-531d-4f9c-89eb-1ebab7067497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.network.os_vif_util [req-ee437bdf-f615-4ba0-a994-0cff5ad65f76 req-3cd869cb-5125-471b-ab48-65682cd798c5 service nova] Converting VIF {"id": "4b46350b-531d-4f9c-89eb-1ebab7067497", "address": "fa:16:3e:5d:69:9f", "network": {"id": "a51d59c1-8168-46ad-a649-919cd6307bb7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1124351624", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b46350b-53", "ovs_interfaceid": "4b46350b-531d-4f9c-89eb-1ebab7067497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.network.os_vif_util [req-ee437bdf-f615-4ba0-a994-0cff5ad65f76 req-3cd869cb-5125-471b-ab48-65682cd798c5 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:69:9f,bridge_name='br-int',has_traffic_filtering=True,id=4b46350b-531d-4f9c-89eb-1ebab7067497,network=Network(a51d59c1-8168-46ad-a649-919cd6307bb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b46350b-53') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG os_vif [req-ee437bdf-f615-4ba0-a994-0cff5ad65f76 req-3cd869cb-5125-471b-ab48-65682cd798c5 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:69:9f,bridge_name='br-int',has_traffic_filtering=True,id=4b46350b-531d-4f9c-89eb-1ebab7067497,network=Network(a51d59c1-8168-46ad-a649-919cd6307bb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b46350b-53') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b46350b-53, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:43:39 user nova-compute[75247]: INFO nova.compute.manager [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Took 7.16 seconds to spawn the instance on the hypervisor.
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.compute.manager [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:43:39 user nova-compute[75247]: INFO os_vif [req-ee437bdf-f615-4ba0-a994-0cff5ad65f76 req-3cd869cb-5125-471b-ab48-65682cd798c5 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:69:9f,bridge_name='br-int',has_traffic_filtering=True,id=4b46350b-531d-4f9c-89eb-1ebab7067497,network=Network(a51d59c1-8168-46ad-a649-919cd6307bb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b46350b-53')
Dec 06 12:43:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [req-ee437bdf-f615-4ba0-a994-0cff5ad65f76 req-3cd869cb-5125-471b-ab48-65682cd798c5 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:43:39 user nova-compute[75247]:   <nova:package version="0.0.0"/>
Dec 06 12:43:39 user nova-compute[75247]:   <nova:name>tempest-device-tagging-server-1618747013</nova:name>
Dec 06 12:43:39 user nova-compute[75247]:   <nova:creationTime>2023-12-06 12:43:39</nova:creationTime>
Dec 06 12:43:39 user nova-compute[75247]:   <nova:flavor name="m1.tiny">
Dec 06 12:43:39 user nova-compute[75247]:     <nova:memory>512</nova:memory>
Dec 06 12:43:39 user nova-compute[75247]:     <nova:disk>1</nova:disk>
Dec 06 12:43:39 user nova-compute[75247]:     <nova:swap>0</nova:swap>
Dec 06 12:43:39 user nova-compute[75247]:     <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:43:39 user nova-compute[75247]:     <nova:vcpus>1</nova:vcpus>
Dec 06 12:43:39 user nova-compute[75247]:   </nova:flavor>
Dec 06 12:43:39 user nova-compute[75247]:   <nova:owner>
Dec 06 12:43:39 user nova-compute[75247]:     <nova:user uuid="14563ea794be4e5bb54c7b4cabde8ee0">tempest-TaggedAttachmentsTest-1141791142-project-member</nova:user>
Dec 06 12:43:39 user nova-compute[75247]:     <nova:project uuid="4031371ec46d42c2bd887bac7edf42a4">tempest-TaggedAttachmentsTest-1141791142</nova:project>
Dec 06 12:43:39 user nova-compute[75247]:   </nova:owner>
Dec 06 12:43:39 user nova-compute[75247]:   <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:43:39 user nova-compute[75247]:   <nova:ports>
Dec 06 12:43:39 user nova-compute[75247]:     <nova:port uuid="68ab6435-5cd9-45bf-891c-c20b68415e11">
Dec 06 12:43:39 user nova-compute[75247]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 12:43:39 user nova-compute[75247]:     </nova:port>
Dec 06 12:43:39 user nova-compute[75247]:   </nova:ports>
Dec 06 12:43:39 user nova-compute[75247]: </nova:instance>
Dec 06 12:43:39 user nova-compute[75247]:  {{(pid=75247) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 06 12:43:39 user nova-compute[75247]: INFO nova.compute.manager [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Took 26.10 seconds to build instance.
Dec 06 12:43:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-891f3041-5b68-4371-9712-7619186410cb tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.262s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Acquiring lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:40 user nova-compute[75247]: INFO nova.compute.manager [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Detaching volume 82a4a39f-5874-4d9f-8936-c14e2d8a0ca8
Dec 06 12:43:40 user nova-compute[75247]: INFO nova.virt.block_device [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Attempting to driver detach volume 82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 from mountpoint /dev/vdb
Dec 06 12:43:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Attempting to detach device vdb from instance dbb64a66-f500-407b-ae92-80f27eb6ce2e from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 12:43:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:43:40 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:43:40 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:43:40 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:43:40 user nova-compute[75247]:   <serial>82a4a39f-5874-4d9f-8936-c14e2d8a0ca8</serial>
Dec 06 12:43:40 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:43:40 user nova-compute[75247]: </disk>
Dec 06 12:43:40 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:43:40 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Successfully detached device vdb from instance dbb64a66-f500-407b-ae92-80f27eb6ce2e from the persistent domain config.
Dec 06 12:43:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dbb64a66-f500-407b-ae92-80f27eb6ce2e from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 12:43:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:43:40 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:43:40 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:43:40 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:43:40 user nova-compute[75247]:   <serial>82a4a39f-5874-4d9f-8936-c14e2d8a0ca8</serial>
Dec 06 12:43:40 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:43:40 user nova-compute[75247]: </disk>
Dec 06 12:43:40 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:43:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dbb64a66-f500-407b-ae92-80f27eb6ce2e {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 12:43:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5548ddc3-b2e6-4d7c-9d22-5a5b0228e7f8 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Acquiring lock "12f40dad-65dc-4281-aa53-6036aa7e26d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5548ddc3-b2e6-4d7c-9d22-5a5b0228e7f8 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Lock "12f40dad-65dc-4281-aa53-6036aa7e26d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5548ddc3-b2e6-4d7c-9d22-5a5b0228e7f8 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Acquiring lock "12f40dad-65dc-4281-aa53-6036aa7e26d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5548ddc3-b2e6-4d7c-9d22-5a5b0228e7f8 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Lock "12f40dad-65dc-4281-aa53-6036aa7e26d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5548ddc3-b2e6-4d7c-9d22-5a5b0228e7f8 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Lock "12f40dad-65dc-4281-aa53-6036aa7e26d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:57 user nova-compute[75247]: INFO nova.compute.manager [None req-5548ddc3-b2e6-4d7c-9d22-5a5b0228e7f8 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Terminating instance
Dec 06 12:43:57 user nova-compute[75247]: DEBUG nova.compute.manager [None req-5548ddc3-b2e6-4d7c-9d22-5a5b0228e7f8 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG nova.compute.manager [req-f3a9a06f-dbe5-408a-aca5-8b4931f1dc98 req-c132f0ca-56fe-4445-86f4-67d3fdd532dd service nova] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Received event network-vif-unplugged-bf793824-98be-4226-82eb-5e37152fcb2a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f3a9a06f-dbe5-408a-aca5-8b4931f1dc98 req-c132f0ca-56fe-4445-86f4-67d3fdd532dd service nova] Acquiring lock "12f40dad-65dc-4281-aa53-6036aa7e26d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f3a9a06f-dbe5-408a-aca5-8b4931f1dc98 req-c132f0ca-56fe-4445-86f4-67d3fdd532dd service nova] Lock "12f40dad-65dc-4281-aa53-6036aa7e26d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f3a9a06f-dbe5-408a-aca5-8b4931f1dc98 req-c132f0ca-56fe-4445-86f4-67d3fdd532dd service nova] Lock "12f40dad-65dc-4281-aa53-6036aa7e26d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG nova.compute.manager [req-f3a9a06f-dbe5-408a-aca5-8b4931f1dc98 req-c132f0ca-56fe-4445-86f4-67d3fdd532dd service nova] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] No waiting events found dispatching network-vif-unplugged-bf793824-98be-4226-82eb-5e37152fcb2a {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG nova.compute.manager [req-f3a9a06f-dbe5-408a-aca5-8b4931f1dc98 req-c132f0ca-56fe-4445-86f4-67d3fdd532dd service nova] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Received event network-vif-unplugged-bf793824-98be-4226-82eb-5e37152fcb2a for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:43:57 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Instance destroyed successfully.
Dec 06 12:43:57 user nova-compute[75247]: DEBUG nova.objects.instance [None req-5548ddc3-b2e6-4d7c-9d22-5a5b0228e7f8 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Lazy-loading 'resources' on Instance uuid 12f40dad-65dc-4281-aa53-6036aa7e26d9 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-5548ddc3-b2e6-4d7c-9d22-5a5b0228e7f8 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-420503403',display_name='tempest-VolumesAssistedSnapshotsTest-server-420503403',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-420503403',id=10,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbj1/Kgv5W+6xLfvIlI+GDJ12fcktlvoLGi4BJ6NWoyqPhMVBUFH79JnEi2/xmBxMixju/9rV5asHLS6uB98jXCJD1IsSMnQqapcqUueJBxT6DXf8kXGat2P0MDNjXFEA==',key_name='tempest-keypair-562827463',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:40:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b039f4b1235348e9b27104df9753f5be',ramdisk_id='',reservation_id='r-0smjx46r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-368900782',owner_user_name='tempest-VolumesAssistedSnapshotsTest-368900782-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:41:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91f7ee4ab7cf416ba6e806db970133e9',uuid=12f40dad-65dc-4281-aa53-6036aa7e26d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf793824-98be-4226-82eb-5e37152fcb2a", "address": "fa:16:3e:0d:07:76", "network": {"id": "cd593cd1-d7c8-41f9-89eb-844e385dcbac", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1184891647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b039f4b1235348e9b27104df9753f5be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf793824-98", "ovs_interfaceid": "bf793824-98be-4226-82eb-5e37152fcb2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-5548ddc3-b2e6-4d7c-9d22-5a5b0228e7f8 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Converting VIF {"id": "bf793824-98be-4226-82eb-5e37152fcb2a", "address": "fa:16:3e:0d:07:76", "network": {"id": "cd593cd1-d7c8-41f9-89eb-844e385dcbac", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1184891647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b039f4b1235348e9b27104df9753f5be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf793824-98", "ovs_interfaceid": "bf793824-98be-4226-82eb-5e37152fcb2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-5548ddc3-b2e6-4d7c-9d22-5a5b0228e7f8 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:07:76,bridge_name='br-int',has_traffic_filtering=True,id=bf793824-98be-4226-82eb-5e37152fcb2a,network=Network(cd593cd1-d7c8-41f9-89eb-844e385dcbac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf793824-98') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG os_vif [None req-5548ddc3-b2e6-4d7c-9d22-5a5b0228e7f8 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:07:76,bridge_name='br-int',has_traffic_filtering=True,id=bf793824-98be-4226-82eb-5e37152fcb2a,network=Network(cd593cd1-d7c8-41f9-89eb-844e385dcbac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf793824-98') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf793824-98, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f99aa6d8-6bef-4da3-a82e-dc84be38180d) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:57 user nova-compute[75247]: INFO os_vif [None req-5548ddc3-b2e6-4d7c-9d22-5a5b0228e7f8 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:07:76,bridge_name='br-int',has_traffic_filtering=True,id=bf793824-98be-4226-82eb-5e37152fcb2a,network=Network(cd593cd1-d7c8-41f9-89eb-844e385dcbac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf793824-98')
Dec 06 12:43:57 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-5548ddc3-b2e6-4d7c-9d22-5a5b0228e7f8 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Deleting instance files /opt/stack/data/nova/instances/12f40dad-65dc-4281-aa53-6036aa7e26d9_del
Dec 06 12:43:57 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-5548ddc3-b2e6-4d7c-9d22-5a5b0228e7f8 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Deletion of /opt/stack/data/nova/instances/12f40dad-65dc-4281-aa53-6036aa7e26d9_del complete
Dec 06 12:43:57 user nova-compute[75247]: INFO nova.compute.manager [None req-5548ddc3-b2e6-4d7c-9d22-5a5b0228e7f8 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Took 0.90 seconds to destroy the instance on the hypervisor.
Dec 06 12:43:57 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-5548ddc3-b2e6-4d7c-9d22-5a5b0228e7f8 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:43:57 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:43:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:59 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:43:59 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Took 1.21 seconds to deallocate network for instance.
Dec 06 12:43:59 user nova-compute[75247]: DEBUG nova.compute.manager [req-528b80f9-5a85-4e15-b57a-65ce1c1660ad req-781f7dda-1c7b-4a9a-afb9-1f62031b66ff service nova] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Received event network-vif-deleted-bf793824-98be-4226-82eb-5e37152fcb2a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:59 user nova-compute[75247]: INFO nova.compute.manager [req-528b80f9-5a85-4e15-b57a-65ce1c1660ad req-781f7dda-1c7b-4a9a-afb9-1f62031b66ff service nova] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Neutron deleted interface bf793824-98be-4226-82eb-5e37152fcb2a; detaching it from the instance and deleting it from the info cache
Dec 06 12:43:59 user nova-compute[75247]: DEBUG nova.network.neutron [req-528b80f9-5a85-4e15-b57a-65ce1c1660ad req-781f7dda-1c7b-4a9a-afb9-1f62031b66ff service nova] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:43:59 user nova-compute[75247]: DEBUG nova.compute.manager [req-528b80f9-5a85-4e15-b57a-65ce1c1660ad req-781f7dda-1c7b-4a9a-afb9-1f62031b66ff service nova] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Detach interface failed, port_id=bf793824-98be-4226-82eb-5e37152fcb2a, reason: Instance 12f40dad-65dc-4281-aa53-6036aa7e26d9 could not be found. {{(pid=75247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 12:43:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5548ddc3-b2e6-4d7c-9d22-5a5b0228e7f8 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5548ddc3-b2e6-4d7c-9d22-5a5b0228e7f8 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:59 user nova-compute[75247]: DEBUG nova.compute.manager [req-d4558010-8214-4593-9c6b-b49c72945d43 req-0d7940da-fc86-4a3f-9a8c-3d04facc36b9 service nova] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Received event network-vif-plugged-bf793824-98be-4226-82eb-5e37152fcb2a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:43:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d4558010-8214-4593-9c6b-b49c72945d43 req-0d7940da-fc86-4a3f-9a8c-3d04facc36b9 service nova] Acquiring lock "12f40dad-65dc-4281-aa53-6036aa7e26d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:43:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d4558010-8214-4593-9c6b-b49c72945d43 req-0d7940da-fc86-4a3f-9a8c-3d04facc36b9 service nova] Lock "12f40dad-65dc-4281-aa53-6036aa7e26d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:43:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d4558010-8214-4593-9c6b-b49c72945d43 req-0d7940da-fc86-4a3f-9a8c-3d04facc36b9 service nova] Lock "12f40dad-65dc-4281-aa53-6036aa7e26d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:59 user nova-compute[75247]: DEBUG nova.compute.manager [req-d4558010-8214-4593-9c6b-b49c72945d43 req-0d7940da-fc86-4a3f-9a8c-3d04facc36b9 service nova] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] No waiting events found dispatching network-vif-plugged-bf793824-98be-4226-82eb-5e37152fcb2a {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:43:59 user nova-compute[75247]: WARNING nova.compute.manager [req-d4558010-8214-4593-9c6b-b49c72945d43 req-0d7940da-fc86-4a3f-9a8c-3d04facc36b9 service nova] [instance: 12f40dad-65dc-4281-aa53-6036aa7e26d9] Received unexpected event network-vif-plugged-bf793824-98be-4226-82eb-5e37152fcb2a for instance with vm_state deleted and task_state None.
Dec 06 12:43:59 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-5548ddc3-b2e6-4d7c-9d22-5a5b0228e7f8 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:43:59 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-5548ddc3-b2e6-4d7c-9d22-5a5b0228e7f8 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:43:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5548ddc3-b2e6-4d7c-9d22-5a5b0228e7f8 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:59 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-5548ddc3-b2e6-4d7c-9d22-5a5b0228e7f8 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Deleted allocations for instance 12f40dad-65dc-4281-aa53-6036aa7e26d9
Dec 06 12:43:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5548ddc3-b2e6-4d7c-9d22-5a5b0228e7f8 tempest-VolumesAssistedSnapshotsTest-368900782 tempest-VolumesAssistedSnapshotsTest-368900782-project-member] Lock "12f40dad-65dc-4281-aa53-6036aa7e26d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.762s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:43:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:43:59 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:44:00 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dbb64a66-f500-407b-ae92-80f27eb6ce2e is timed out.
Dec 06 12:44:00 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Successfully detached device vdb from instance dbb64a66-f500-407b-ae92-80f27eb6ce2e from the live domain config.
Dec 06 12:44:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycZYnIDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '82a4a39f-5874-4d9f-8936-c14e2d8a0ca8'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:44:00 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:44:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ccd5f7-4e7e-4742-8fd0-d5669c388406]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:44:00 user nova-compute[75247]: No targets found.
Dec 06 12:44:00 user nova-compute[75247]: iSNS:
Dec 06 12:44:00 user nova-compute[75247]: No targets found.
Dec 06 12:44:00 user nova-compute[75247]: STATIC:
Dec 06 12:44:00 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8
Dec 06 12:44:00 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:44:00 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:44:00 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496
Dec 06 12:44:00 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:44:00 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:44:00 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:44:00 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:44:00 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:44:00 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0
Dec 06 12:44:00 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:44:00 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:44:00 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482
Dec 06 12:44:00 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:44:00 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:44:00 user nova-compute[75247]: FIRMWARE:
Dec 06 12:44:00 user nova-compute[75247]: No targets found.
Dec 06 12:44:00 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:44:00 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:44:00 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef86a7a-d46b-4fb8-8630-6bb894cb8829]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[27611615-9671-4e93-9050-d99095584d55]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:44:00 user nova-compute[75247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:44:00 user nova-compute[75247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:44:00 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:44:00 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:44:00 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 (non-flash)
Dec 06 12:44:00 user nova-compute[75247]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:44:00 user nova-compute[75247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:44:00 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:44:00 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:44:00 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd7301913f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8'): ({'sdb'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Removing single pathed devices sdb {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b490de9f-bd09-4837-af01-2d6664f73163]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff1acf8-7026-4bf7-9bb8-c4c9c59a7db4]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Flushing IO for device /dev/sdb {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:44:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b08d1a0-d59e-42cf-b0ef-b148124f7272]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e04345b-58ee-4014-8c40-ce16f6999686]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba99eaba-9f97-4040-a976-2b48d67e57d1]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[41659c83-baa5-4181-98c9-9edc24c1f62c]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8, portal: 172.16.0.220,3260]
Dec 06 12:44:01 user nova-compute[75247]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8, portal: 172.16.0.220,3260] successful.
Dec 06 12:44:01 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82a4a39f-5874-4d9f-8936-c14e2d8a0ca8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[26822f8a-ec6f-4aa0-83c0-a0f4a37cfe53]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] <== disconnect_volume: return (310ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:44:01 user nova-compute[75247]: DEBUG nova.objects.instance [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lazy-loading 'flavor' on Instance uuid dbb64a66-f500-407b-ae92-80f27eb6ce2e {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:44:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d975cb63-9989-4349-8830-d2ffa2a7909e tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.859s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:02 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:44:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:03 user nova-compute[75247]: DEBUG nova.compute.manager [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:44:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:44:03 user nova-compute[75247]: INFO nova.compute.claims [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Claim successful on node user
Dec 06 12:44:04 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:44:04 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:44:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:04 user nova-compute[75247]: DEBUG nova.compute.manager [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:44:04 user nova-compute[75247]: DEBUG nova.compute.manager [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:44:04 user nova-compute[75247]: DEBUG nova.network.neutron [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:44:04 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:44:04 user nova-compute[75247]: DEBUG nova.compute.manager [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:44:04 user nova-compute[75247]: DEBUG nova.policy [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4548c5d3575e45d787758e52fbf274d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4c40ccbb8a410aa0e65c1f5897de97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:44:04 user nova-compute[75247]: DEBUG nova.compute.manager [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:44:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:44:04 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Creating image(s)
Dec 06 12:44:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "/opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "/opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "9d46650896f9d747b9b763e9025ff6d0988cc343" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "9d46650896f9d747b9b763e9025ff6d0988cc343" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d46650896f9d747b9b763e9025ff6d0988cc343.part --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d46650896f9d747b9b763e9025ff6d0988cc343.part --force-share --output=json" returned: 0 in 0.214s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:05 user nova-compute[75247]: DEBUG nova.virt.images [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] a4449aa0-dc9e-4135-81a7-803ee3d8f136 was qcow2, converting to raw {{(pid=75247) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 12:44:05 user nova-compute[75247]: DEBUG nova.privsep.utils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 12:44:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9d46650896f9d747b9b763e9025ff6d0988cc343.part /opt/stack/data/nova/instances/_base/9d46650896f9d747b9b763e9025ff6d0988cc343.converted {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:05 user nova-compute[75247]: DEBUG nova.network.neutron [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Successfully created port: a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:44:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9d46650896f9d747b9b763e9025ff6d0988cc343.part /opt/stack/data/nova/instances/_base/9d46650896f9d747b9b763e9025ff6d0988cc343.converted" returned: 0 in 0.376s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d46650896f9d747b9b763e9025ff6d0988cc343.converted --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d46650896f9d747b9b763e9025ff6d0988cc343.converted --force-share --output=json" returned: 0 in 0.211s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "9d46650896f9d747b9b763e9025ff6d0988cc343" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.366s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d46650896f9d747b9b763e9025ff6d0988cc343 --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:05 user nova-compute[75247]: DEBUG nova.network.neutron [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Successfully updated port: a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:44:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "refresh_cache-0a86fe94-933a-4e0d-8a65-4834c3d3e40b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:44:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquired lock "refresh_cache-0a86fe94-933a-4e0d-8a65-4834c3d3e40b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:44:05 user nova-compute[75247]: DEBUG nova.network.neutron [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:44:05 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:44:05 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 12:44:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-ceb6a291-f621-4569-8b44-f3aa13435657 req-4ed9eacf-d401-42bb-8feb-0322a2f9eb7a service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received event network-changed-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-ceb6a291-f621-4569-8b44-f3aa13435657 req-4ed9eacf-d401-42bb-8feb-0322a2f9eb7a service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Refreshing instance network info cache due to event network-changed-a8d5f682-76a1-4b39-8153-487fe53a127a. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:44:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ceb6a291-f621-4569-8b44-f3aa13435657 req-4ed9eacf-d401-42bb-8feb-0322a2f9eb7a service nova] Acquiring lock "refresh_cache-0a86fe94-933a-4e0d-8a65-4834c3d3e40b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d46650896f9d747b9b763e9025ff6d0988cc343 --force-share --output=json" returned: 0 in 0.174s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "9d46650896f9d747b9b763e9025ff6d0988cc343" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "9d46650896f9d747b9b763e9025ff6d0988cc343" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d46650896f9d747b9b763e9025ff6d0988cc343 --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.network.neutron [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d46650896f9d747b9b763e9025ff6d0988cc343 --force-share --output=json" returned: 0 in 0.194s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d46650896f9d747b9b763e9025ff6d0988cc343,backing_fmt=raw /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d46650896f9d747b9b763e9025ff6d0988cc343,backing_fmt=raw /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk 1073741824" returned: 0 in 0.059s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "9d46650896f9d747b9b763e9025ff6d0988cc343" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d46650896f9d747b9b763e9025ff6d0988cc343 --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d46650896f9d747b9b763e9025ff6d0988cc343 --force-share --output=json" returned: 0 in 0.183s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.network.neutron [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Updating instance_info_cache with network_info: [{"id": "a8d5f682-76a1-4b39-8153-487fe53a127a", "address": "fa:16:3e:a7:11:06", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d5f682-76", "ovs_interfaceid": "a8d5f682-76a1-4b39-8153-487fe53a127a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Releasing lock "refresh_cache-0a86fe94-933a-4e0d-8a65-4834c3d3e40b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.compute.manager [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Instance network_info: |[{"id": "a8d5f682-76a1-4b39-8153-487fe53a127a", "address": "fa:16:3e:a7:11:06", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d5f682-76", "ovs_interfaceid": "a8d5f682-76a1-4b39-8153-487fe53a127a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ceb6a291-f621-4569-8b44-f3aa13435657 req-4ed9eacf-d401-42bb-8feb-0322a2f9eb7a service nova] Acquired lock "refresh_cache-0a86fe94-933a-4e0d-8a65-4834c3d3e40b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.network.neutron [req-ceb6a291-f621-4569-8b44-f3aa13435657 req-4ed9eacf-d401-42bb-8feb-0322a2f9eb7a service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Refreshing network info cache for port a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Cannot resize image /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Ensure instance console log exists: /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Start _get_guest_xml network_info=[{"id": "a8d5f682-76a1-4b39-8153-487fe53a127a", "address": "fa:16:3e:a7:11:06", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d5f682-76", "ovs_interfaceid": "a8d5f682-76a1-4b39-8153-487fe53a127a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:44:01Z,direct_url=<?>,disk_format='qcow2',id=a4449aa0-dc9e-4135-81a7-803ee3d8f136,min_disk=0,min_ram=0,name='tempest-scenario-img--905874383',owner='df4c40ccbb8a410aa0e65c1f5897de97',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:44:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': 'a4449aa0-dc9e-4135-81a7-803ee3d8f136'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:44:06 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:44:06 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:44:01Z,direct_url=<?>,disk_format='qcow2',id=a4449aa0-dc9e-4135-81a7-803ee3d8f136,min_disk=0,min_ram=0,name='tempest-scenario-img--905874383',owner='df4c40ccbb8a410aa0e65c1f5897de97',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:44:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2121046985',display_name='tempest-TestMinimumBasicScenario-server-2121046985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2121046985',id=15,image_ref='a4449aa0-dc9e-4135-81a7-803ee3d8f136',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENALU6V+1C8Yive07KA1tVNytMgJkyJ7zBITPFD/k7QX/C53xnZxG7Nj3ga2MhNQdhymkiPaD/Qm+Y3zch0QuL7UEl+iGb5BUzeR0Hi6d88zrxWSGsr13B14Fl5cFNYSA==',key_name='tempest-TestMinimumBasicScenario-1562390602',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df4c40ccbb8a410aa0e65c1f5897de97',ramdisk_id='',reservation_id='r-4am3hdod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a4449aa0-dc9e-4135-81a7-803ee3d8f136',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1052287778',owner_user_name='tempest-TestMinimumBasicScenario-1052287778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:44:04Z,user_data=None,user_id='4548c5d3575e45d787758e52fbf274d6',uuid=0a86fe94-933a-4e0d-8a65-4834c3d3e40b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8d5f682-76a1-4b39-8153-487fe53a127a", "address": "fa:16:3e:a7:11:06", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d5f682-76", "ovs_interfaceid": "a8d5f682-76a1-4b39-8153-487fe53a127a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Converting VIF {"id": "a8d5f682-76a1-4b39-8153-487fe53a127a", "address": "fa:16:3e:a7:11:06", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d5f682-76", "ovs_interfaceid": "a8d5f682-76a1-4b39-8153-487fe53a127a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:11:06,bridge_name='br-int',has_traffic_filtering=True,id=a8d5f682-76a1-4b39-8153-487fe53a127a,network=Network(56756e7a-b384-43a0-88dc-bab3b11e5f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d5f682-76') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.objects.instance [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a86fe94-933a-4e0d-8a65-4834c3d3e40b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:44:06 user nova-compute[75247]:   <uuid>0a86fe94-933a-4e0d-8a65-4834c3d3e40b</uuid>
Dec 06 12:44:06 user nova-compute[75247]:   <name>instance-0000000f</name>
Dec 06 12:44:06 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:44:06 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:44:06 user nova-compute[75247]:   <metadata>
Dec 06 12:44:06 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:44:06 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:44:06 user nova-compute[75247]:       <nova:name>tempest-TestMinimumBasicScenario-server-2121046985</nova:name>
Dec 06 12:44:06 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:44:06</nova:creationTime>
Dec 06 12:44:06 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:44:06 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:44:06 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:44:06 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:44:06 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:44:06 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:44:06 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:44:06 user nova-compute[75247]:       <nova:owner>
Dec 06 12:44:06 user nova-compute[75247]:         <nova:user uuid="4548c5d3575e45d787758e52fbf274d6">tempest-TestMinimumBasicScenario-1052287778-project-member</nova:user>
Dec 06 12:44:06 user nova-compute[75247]:         <nova:project uuid="df4c40ccbb8a410aa0e65c1f5897de97">tempest-TestMinimumBasicScenario-1052287778</nova:project>
Dec 06 12:44:06 user nova-compute[75247]:       </nova:owner>
Dec 06 12:44:06 user nova-compute[75247]:       <nova:root type="image" uuid="a4449aa0-dc9e-4135-81a7-803ee3d8f136"/>
Dec 06 12:44:06 user nova-compute[75247]:       <nova:ports>
Dec 06 12:44:06 user nova-compute[75247]:         <nova:port uuid="a8d5f682-76a1-4b39-8153-487fe53a127a">
Dec 06 12:44:06 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 06 12:44:06 user nova-compute[75247]:         </nova:port>
Dec 06 12:44:06 user nova-compute[75247]:       </nova:ports>
Dec 06 12:44:06 user nova-compute[75247]:     </nova:instance>
Dec 06 12:44:06 user nova-compute[75247]:   </metadata>
Dec 06 12:44:06 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:44:06 user nova-compute[75247]:     <system>
Dec 06 12:44:06 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:44:06 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:44:06 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:44:06 user nova-compute[75247]:       <entry name="serial">0a86fe94-933a-4e0d-8a65-4834c3d3e40b</entry>
Dec 06 12:44:06 user nova-compute[75247]:       <entry name="uuid">0a86fe94-933a-4e0d-8a65-4834c3d3e40b</entry>
Dec 06 12:44:06 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:44:06 user nova-compute[75247]:     </system>
Dec 06 12:44:06 user nova-compute[75247]:   </sysinfo>
Dec 06 12:44:06 user nova-compute[75247]:   <os>
Dec 06 12:44:06 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:44:06 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:44:06 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:44:06 user nova-compute[75247]:   </os>
Dec 06 12:44:06 user nova-compute[75247]:   <features>
Dec 06 12:44:06 user nova-compute[75247]:     <acpi/>
Dec 06 12:44:06 user nova-compute[75247]:     <apic/>
Dec 06 12:44:06 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:44:06 user nova-compute[75247]:   </features>
Dec 06 12:44:06 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:44:06 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:44:06 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:44:06 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:44:06 user nova-compute[75247]:   </clock>
Dec 06 12:44:06 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:44:06 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:44:06 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:44:06 user nova-compute[75247]:   </cpu>
Dec 06 12:44:06 user nova-compute[75247]:   <devices>
Dec 06 12:44:06 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:44:06 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:44:06 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk"/>
Dec 06 12:44:06 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:44:06 user nova-compute[75247]:     </disk>
Dec 06 12:44:06 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:44:06 user nova-compute[75247]:       <mac address="fa:16:3e:a7:11:06"/>
Dec 06 12:44:06 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:44:06 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:44:06 user nova-compute[75247]:       <target dev="tapa8d5f682-76"/>
Dec 06 12:44:06 user nova-compute[75247]:     </interface>
Dec 06 12:44:06 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:44:06 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/console.log" append="off"/>
Dec 06 12:44:06 user nova-compute[75247]:     </serial>
Dec 06 12:44:06 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:44:06 user nova-compute[75247]:     <video>
Dec 06 12:44:06 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:44:06 user nova-compute[75247]:     </video>
Dec 06 12:44:06 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:44:06 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:44:06 user nova-compute[75247]:     </rng>
Dec 06 12:44:06 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:44:06 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:44:06 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:44:06 user nova-compute[75247]:     </memballoon>
Dec 06 12:44:06 user nova-compute[75247]:   </devices>
Dec 06 12:44:06 user nova-compute[75247]: </domain>
Dec 06 12:44:06 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2121046985',display_name='tempest-TestMinimumBasicScenario-server-2121046985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2121046985',id=15,image_ref='a4449aa0-dc9e-4135-81a7-803ee3d8f136',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENALU6V+1C8Yive07KA1tVNytMgJkyJ7zBITPFD/k7QX/C53xnZxG7Nj3ga2MhNQdhymkiPaD/Qm+Y3zch0QuL7UEl+iGb5BUzeR0Hi6d88zrxWSGsr13B14Fl5cFNYSA==',key_name='tempest-TestMinimumBasicScenario-1562390602',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df4c40ccbb8a410aa0e65c1f5897de97',ramdisk_id='',reservation_id='r-4am3hdod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a4449aa0-dc9e-4135-81a7-803ee3d8f136',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1052287778',owner_user_name='tempest-TestMinimumBasicScenario-1052287778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:44:04Z,user_data=None,user_id='4548c5d3575e45d787758e52fbf274d6',uuid=0a86fe94-933a-4e0d-8a65-4834c3d3e40b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8d5f682-76a1-4b39-8153-487fe53a127a", "address": "fa:16:3e:a7:11:06", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d5f682-76", "ovs_interfaceid": "a8d5f682-76a1-4b39-8153-487fe53a127a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Converting VIF {"id": "a8d5f682-76a1-4b39-8153-487fe53a127a", "address": "fa:16:3e:a7:11:06", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d5f682-76", "ovs_interfaceid": "a8d5f682-76a1-4b39-8153-487fe53a127a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:11:06,bridge_name='br-int',has_traffic_filtering=True,id=a8d5f682-76a1-4b39-8153-487fe53a127a,network=Network(56756e7a-b384-43a0-88dc-bab3b11e5f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d5f682-76') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG os_vif [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:11:06,bridge_name='br-int',has_traffic_filtering=True,id=a8d5f682-76a1-4b39-8153-487fe53a127a,network=Network(56756e7a-b384-43a0-88dc-bab3b11e5f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d5f682-76') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a6c0242-f1d6-5c1b-bbcf-454a4569680f', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8d5f682-76, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8d5f682-76, col_values=(('qos', UUID('88201f7a-abe3-42f4-8ccc-3132b0d5ea14')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8d5f682-76, col_values=(('external_ids', {'iface-id': 'a8d5f682-76a1-4b39-8153-487fe53a127a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:11:06', 'vm-uuid': '0a86fe94-933a-4e0d-8a65-4834c3d3e40b'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:06 user nova-compute[75247]: INFO os_vif [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:11:06,bridge_name='br-int',has_traffic_filtering=True,id=a8d5f682-76a1-4b39-8153-487fe53a127a,network=Network(56756e7a-b384-43a0-88dc-bab3b11e5f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d5f682-76')
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] No VIF found with MAC fa:16:3e:a7:11:06, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Updating instance_info_cache with network_info: [{"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:44:06 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG nova.network.neutron [req-ceb6a291-f621-4569-8b44-f3aa13435657 req-4ed9eacf-d401-42bb-8feb-0322a2f9eb7a service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Updated VIF entry in instance network info cache for port a8d5f682-76a1-4b39-8153-487fe53a127a. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG nova.network.neutron [req-ceb6a291-f621-4569-8b44-f3aa13435657 req-4ed9eacf-d401-42bb-8feb-0322a2f9eb7a service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Updating instance_info_cache with network_info: [{"id": "a8d5f682-76a1-4b39-8153-487fe53a127a", "address": "fa:16:3e:a7:11:06", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d5f682-76", "ovs_interfaceid": "a8d5f682-76a1-4b39-8153-487fe53a127a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ceb6a291-f621-4569-8b44-f3aa13435657 req-4ed9eacf-d401-42bb-8feb-0322a2f9eb7a service nova] Releasing lock "refresh_cache-0a86fe94-933a-4e0d-8a65-4834c3d3e40b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "4531bf11-b948-4d57-bf55-f33563815e26" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "4531bf11-b948-4d57-bf55-f33563815e26" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG nova.objects.instance [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lazy-loading 'flavor' on Instance uuid 4531bf11-b948-4d57-bf55-f33563815e26 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "4531bf11-b948-4d57-bf55-f33563815e26" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:44:07 user nova-compute[75247]: INFO nova.compute.claims [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Claim successful on node user
Dec 06 12:44:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "4531bf11-b948-4d57-bf55-f33563815e26" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "4531bf11-b948-4d57-bf55-f33563815e26" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:07 user nova-compute[75247]: INFO nova.compute.manager [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Attaching volume 6492a8c0-e442-4b99-867a-e95fa38234db to /dev/vdb
Dec 06 12:44:07 user nova-compute[75247]: DEBUG os_brick.utils [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c11894-2f81-4369-8db0-313e1c037101]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a86a0f-bb47-464c-82d1-5219e9450004]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.066s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9107f367-a8c8-4c57-afc6-afb704e94368]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ee0a60-d3a7-498d-a5d6-4d4d998ce3fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:44:08 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:44:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:44:08 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:44:08 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[09448810-c092-4c3d-8d99-0ccec4786320]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:08 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:44:08 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:44:08 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:44:08 user nova-compute[75247]: DEBUG os_brick.utils [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] <== get_connector_properties: return (225ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:44:08 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Updating existing volume attachment record: 11c36bcf-b92b-4f06-ae04-a707a7b8e705 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:44:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:08 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:44:08 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:44:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.893s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:44:08 user nova-compute[75247]: DEBUG nova.compute.manager [req-6eb288b1-5efb-465d-b101-8d03eaeb856d req-8147b5fe-4936-4566-b668-762ae449e690 service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received event network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6eb288b1-5efb-465d-b101-8d03eaeb856d req-8147b5fe-4936-4566-b668-762ae449e690 service nova] Acquiring lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6eb288b1-5efb-465d-b101-8d03eaeb856d req-8147b5fe-4936-4566-b668-762ae449e690 service nova] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6eb288b1-5efb-465d-b101-8d03eaeb856d req-8147b5fe-4936-4566-b668-762ae449e690 service nova] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:08 user nova-compute[75247]: DEBUG nova.compute.manager [req-6eb288b1-5efb-465d-b101-8d03eaeb856d req-8147b5fe-4936-4566-b668-762ae449e690 service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] No waiting events found dispatching network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:44:08 user nova-compute[75247]: WARNING nova.compute.manager [req-6eb288b1-5efb-465d-b101-8d03eaeb856d req-8147b5fe-4936-4566-b668-762ae449e690 service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received unexpected event network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a for instance with vm_state building and task_state spawning.
Dec 06 12:44:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:44:08 user nova-compute[75247]: DEBUG nova.network.neutron [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:44:08 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:44:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:44:08 user nova-compute[75247]: DEBUG nova.policy [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc13843d8f074da189dbd3e93750b811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ccf15765714ca2a8c4700d2d6e3ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:44:09 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Creating image(s)
Dec 06 12:44:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "/opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "/opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8631a84d-1fc2-4e0a-9179-c87fcacd1e37 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Acquiring lock "f2e75618-9164-4527-a6a3-5f5195effccf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8631a84d-1fc2-4e0a-9179-c87fcacd1e37 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "f2e75618-9164-4527-a6a3-5f5195effccf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8631a84d-1fc2-4e0a-9179-c87fcacd1e37 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Acquiring lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8631a84d-1fc2-4e0a-9179-c87fcacd1e37 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8631a84d-1fc2-4e0a-9179-c87fcacd1e37 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:09 user nova-compute[75247]: INFO nova.compute.manager [None req-8631a84d-1fc2-4e0a-9179-c87fcacd1e37 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Terminating instance
Dec 06 12:44:09 user nova-compute[75247]: DEBUG nova.compute.manager [None req-8631a84d-1fc2-4e0a-9179-c87fcacd1e37 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.251s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.235s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk 1073741824" returned: 0 in 0.071s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.245s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG nova.network.neutron [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Successfully created port: 434efb9d-06e4-413b-b470-4952e114c298 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:09 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Instance destroyed successfully.
Dec 06 12:44:09 user nova-compute[75247]: DEBUG nova.objects.instance [None req-8631a84d-1fc2-4e0a-9179-c87fcacd1e37 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lazy-loading 'resources' on Instance uuid f2e75618-9164-4527-a6a3-5f5195effccf {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-8631a84d-1fc2-4e0a-9179-c87fcacd1e37 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1618747013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1618747013',id=9,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJqUDXevj4gXj7N7wpZj/XCteR5V+dPOM68FsqKu9Fudl378/ktu9MdzbbKdcoiSMygbRXxj+WBcn7A30ZdIiAz+sQjvUKqzGUuXAmht+5SuCJrZIb25AK4InwaKc1iVg==',key_name='tempest-keypair-76799662',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:40:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4031371ec46d42c2bd887bac7edf42a4',ramdisk_id='',reservation_id='r-ouoqw3qc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1141791142',owner_user_name='tempest-TaggedAttachmentsTest-1141791142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:40:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14563ea794be4e5bb54c7b4cabde8ee0',uuid=f2e75618-9164-4527-a6a3-5f5195effccf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68ab6435-5cd9-45bf-891c-c20b68415e11", "address": "fa:16:3e:b0:12:84", "network": {"id": "c5765401-4948-42dc-bfce-fe0e5ebf3a42", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-751579203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ab6435-5c", "ovs_interfaceid": "68ab6435-5cd9-45bf-891c-c20b68415e11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-8631a84d-1fc2-4e0a-9179-c87fcacd1e37 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Converting VIF {"id": "68ab6435-5cd9-45bf-891c-c20b68415e11", "address": "fa:16:3e:b0:12:84", "network": {"id": "c5765401-4948-42dc-bfce-fe0e5ebf3a42", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-751579203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4031371ec46d42c2bd887bac7edf42a4", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ab6435-5c", "ovs_interfaceid": "68ab6435-5cd9-45bf-891c-c20b68415e11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-8631a84d-1fc2-4e0a-9179-c87fcacd1e37 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:12:84,bridge_name='br-int',has_traffic_filtering=True,id=68ab6435-5cd9-45bf-891c-c20b68415e11,network=Network(c5765401-4948-42dc-bfce-fe0e5ebf3a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68ab6435-5c') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG os_vif [None req-8631a84d-1fc2-4e0a-9179-c87fcacd1e37 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:12:84,bridge_name='br-int',has_traffic_filtering=True,id=68ab6435-5cd9-45bf-891c-c20b68415e11,network=Network(c5765401-4948-42dc-bfce-fe0e5ebf3a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68ab6435-5c') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68ab6435-5c, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Cannot resize image /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Ensure instance console log exists: /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d2d64155-b44c-4942-bba4-7293b5eb45ce) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:10 user nova-compute[75247]: INFO os_vif [None req-8631a84d-1fc2-4e0a-9179-c87fcacd1e37 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:12:84,bridge_name='br-int',has_traffic_filtering=True,id=68ab6435-5cd9-45bf-891c-c20b68415e11,network=Network(c5765401-4948-42dc-bfce-fe0e5ebf3a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68ab6435-5c')
Dec 06 12:44:10 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-8631a84d-1fc2-4e0a-9179-c87fcacd1e37 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Deleting instance files /opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf_del
Dec 06 12:44:10 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-8631a84d-1fc2-4e0a-9179-c87fcacd1e37 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Deletion of /opt/stack/data/nova/instances/f2e75618-9164-4527-a6a3-5f5195effccf_del complete
Dec 06 12:44:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:10 user nova-compute[75247]: INFO nova.compute.manager [None req-8631a84d-1fc2-4e0a-9179-c87fcacd1e37 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Took 1.19 seconds to destroy the instance on the hypervisor.
Dec 06 12:44:10 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-8631a84d-1fc2-4e0a-9179-c87fcacd1e37 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-52dce005-0e09-4366-8513-83235dbfb1ee req-ea5348ff-4faa-44fa-90d7-b0ac792077e7 service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received event network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-52dce005-0e09-4366-8513-83235dbfb1ee req-ea5348ff-4faa-44fa-90d7-b0ac792077e7 service nova] Acquiring lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-52dce005-0e09-4366-8513-83235dbfb1ee req-ea5348ff-4faa-44fa-90d7-b0ac792077e7 service nova] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-52dce005-0e09-4366-8513-83235dbfb1ee req-ea5348ff-4faa-44fa-90d7-b0ac792077e7 service nova] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-52dce005-0e09-4366-8513-83235dbfb1ee req-ea5348ff-4faa-44fa-90d7-b0ac792077e7 service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] No waiting events found dispatching network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:44:10 user nova-compute[75247]: WARNING nova.compute.manager [req-52dce005-0e09-4366-8513-83235dbfb1ee req-ea5348ff-4faa-44fa-90d7-b0ac792077e7 service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received unexpected event network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a for instance with vm_state building and task_state spawning.
Dec 06 12:44:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-52dce005-0e09-4366-8513-83235dbfb1ee req-ea5348ff-4faa-44fa-90d7-b0ac792077e7 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Received event network-vif-unplugged-68ab6435-5cd9-45bf-891c-c20b68415e11 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-52dce005-0e09-4366-8513-83235dbfb1ee req-ea5348ff-4faa-44fa-90d7-b0ac792077e7 service nova] Acquiring lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-52dce005-0e09-4366-8513-83235dbfb1ee req-ea5348ff-4faa-44fa-90d7-b0ac792077e7 service nova] Lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-52dce005-0e09-4366-8513-83235dbfb1ee req-ea5348ff-4faa-44fa-90d7-b0ac792077e7 service nova] Lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-52dce005-0e09-4366-8513-83235dbfb1ee req-ea5348ff-4faa-44fa-90d7-b0ac792077e7 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] No waiting events found dispatching network-vif-unplugged-68ab6435-5cd9-45bf-891c-c20b68415e11 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-52dce005-0e09-4366-8513-83235dbfb1ee req-ea5348ff-4faa-44fa-90d7-b0ac792077e7 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Received event network-vif-unplugged-68ab6435-5cd9-45bf-891c-c20b68415e11 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-52dce005-0e09-4366-8513-83235dbfb1ee req-ea5348ff-4faa-44fa-90d7-b0ac792077e7 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Received event network-vif-plugged-68ab6435-5cd9-45bf-891c-c20b68415e11 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-52dce005-0e09-4366-8513-83235dbfb1ee req-ea5348ff-4faa-44fa-90d7-b0ac792077e7 service nova] Acquiring lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-52dce005-0e09-4366-8513-83235dbfb1ee req-ea5348ff-4faa-44fa-90d7-b0ac792077e7 service nova] Lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-52dce005-0e09-4366-8513-83235dbfb1ee req-ea5348ff-4faa-44fa-90d7-b0ac792077e7 service nova] Lock "f2e75618-9164-4527-a6a3-5f5195effccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-52dce005-0e09-4366-8513-83235dbfb1ee req-ea5348ff-4faa-44fa-90d7-b0ac792077e7 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] No waiting events found dispatching network-vif-plugged-68ab6435-5cd9-45bf-891c-c20b68415e11 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:44:10 user nova-compute[75247]: WARNING nova.compute.manager [req-52dce005-0e09-4366-8513-83235dbfb1ee req-ea5348ff-4faa-44fa-90d7-b0ac792077e7 service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Received unexpected event network-vif-plugged-68ab6435-5cd9-45bf-891c-c20b68415e11 for instance with vm_state active and task_state deleting.
Dec 06 12:44:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.network.neutron [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Successfully updated port: 434efb9d-06e4-413b-b470-4952e114c298 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "refresh_cache-cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquired lock "refresh_cache-cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.network.neutron [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.compute.manager [req-1d6cf5b7-4e9d-43c0-a20c-faac7b2c4a4c req-f53a07c6-ad25-4259-8517-22bb18ef089d service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Received event network-changed-434efb9d-06e4-413b-b470-4952e114c298 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.compute.manager [req-1d6cf5b7-4e9d-43c0-a20c-faac7b2c4a4c req-f53a07c6-ad25-4259-8517-22bb18ef089d service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Refreshing instance network info cache due to event network-changed-434efb9d-06e4-413b-b470-4952e114c298. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1d6cf5b7-4e9d-43c0-a20c-faac7b2c4a4c req-f53a07c6-ad25-4259-8517-22bb18ef089d service nova] Acquiring lock "refresh_cache-cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.compute.manager [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:44:11 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Instance spawned successfully.
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.network.neutron [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:11 user nova-compute[75247]: INFO nova.compute.manager [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Took 6.86 seconds to spawn the instance on the hypervisor.
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.compute.manager [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:44:11 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Took 1.10 seconds to deallocate network for instance.
Dec 06 12:44:11 user nova-compute[75247]: INFO nova.compute.manager [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Took 7.71 seconds to build instance.
Dec 06 12:44:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-45dac7b6-4143-41aa-990e-7b9d62da4d0f tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.804s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8631a84d-1fc2-4e0a-9179-c87fcacd1e37 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8631a84d-1fc2-4e0a-9179-c87fcacd1e37 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.network.neutron [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Updating instance_info_cache with network_info: [{"id": "434efb9d-06e4-413b-b470-4952e114c298", "address": "fa:16:3e:b5:b1:be", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434efb9d-06", "ovs_interfaceid": "434efb9d-06e4-413b-b470-4952e114c298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Releasing lock "refresh_cache-cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Instance network_info: |[{"id": "434efb9d-06e4-413b-b470-4952e114c298", "address": "fa:16:3e:b5:b1:be", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434efb9d-06", "ovs_interfaceid": "434efb9d-06e4-413b-b470-4952e114c298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1d6cf5b7-4e9d-43c0-a20c-faac7b2c4a4c req-f53a07c6-ad25-4259-8517-22bb18ef089d service nova] Acquired lock "refresh_cache-cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.network.neutron [req-1d6cf5b7-4e9d-43c0-a20c-faac7b2c4a4c req-f53a07c6-ad25-4259-8517-22bb18ef089d service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Refreshing network info cache for port 434efb9d-06e4-413b-b470-4952e114c298 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Start _get_guest_xml network_info=[{"id": "434efb9d-06e4-413b-b470-4952e114c298", "address": "fa:16:3e:b5:b1:be", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434efb9d-06", "ovs_interfaceid": "434efb9d-06e4-413b-b470-4952e114c298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:44:11 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:44:11 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:44:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2133511103',display_name='tempest-tempest.common.compute-instance-2133511103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2133511103',id=16,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBDhQTUEw1R3RfVHPhzTtaiheMfD6p83eCfaICq1MZJ1xFdfRrt1xoh/Vh31BgL5j0HqUltFVWq6oXJAAH3kNbtsonPlpThgj+8ZXQcR+K3dodbuTA7Es5PaooP9IaaWg==',key_name='tempest-keypair-1057326227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0ccf15765714ca2a8c4700d2d6e3ed2',ramdisk_id='',reservation_id='r-1mxkfe1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2075667053',owner_user_name='tempest-ServerActionsTestOtherA-2075667053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:44:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13843d8f074da189dbd3e93750b811',uuid=cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "434efb9d-06e4-413b-b470-4952e114c298", "address": "fa:16:3e:b5:b1:be", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434efb9d-06", "ovs_interfaceid": "434efb9d-06e4-413b-b470-4952e114c298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converting VIF {"id": "434efb9d-06e4-413b-b470-4952e114c298", "address": "fa:16:3e:b5:b1:be", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434efb9d-06", "ovs_interfaceid": "434efb9d-06e4-413b-b470-4952e114c298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b1:be,bridge_name='br-int',has_traffic_filtering=True,id=434efb9d-06e4-413b-b470-4952e114c298,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434efb9d-06') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.objects.instance [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lazy-loading 'pci_devices' on Instance uuid cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:44:11 user nova-compute[75247]:   <uuid>cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b</uuid>
Dec 06 12:44:11 user nova-compute[75247]:   <name>instance-00000010</name>
Dec 06 12:44:11 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:44:11 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:44:11 user nova-compute[75247]:   <metadata>
Dec 06 12:44:11 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:44:11 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:44:11 user nova-compute[75247]:       <nova:name>tempest-tempest.common.compute-instance-2133511103</nova:name>
Dec 06 12:44:11 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:44:11</nova:creationTime>
Dec 06 12:44:11 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:44:11 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:44:11 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:44:11 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:44:11 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:44:11 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:44:11 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:44:11 user nova-compute[75247]:       <nova:owner>
Dec 06 12:44:11 user nova-compute[75247]:         <nova:user uuid="fc13843d8f074da189dbd3e93750b811">tempest-ServerActionsTestOtherA-2075667053-project-member</nova:user>
Dec 06 12:44:11 user nova-compute[75247]:         <nova:project uuid="a0ccf15765714ca2a8c4700d2d6e3ed2">tempest-ServerActionsTestOtherA-2075667053</nova:project>
Dec 06 12:44:11 user nova-compute[75247]:       </nova:owner>
Dec 06 12:44:11 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:44:11 user nova-compute[75247]:       <nova:ports>
Dec 06 12:44:11 user nova-compute[75247]:         <nova:port uuid="434efb9d-06e4-413b-b470-4952e114c298">
Dec 06 12:44:11 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 06 12:44:11 user nova-compute[75247]:         </nova:port>
Dec 06 12:44:11 user nova-compute[75247]:       </nova:ports>
Dec 06 12:44:11 user nova-compute[75247]:     </nova:instance>
Dec 06 12:44:11 user nova-compute[75247]:   </metadata>
Dec 06 12:44:11 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:44:11 user nova-compute[75247]:     <system>
Dec 06 12:44:11 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:44:11 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:44:11 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:44:11 user nova-compute[75247]:       <entry name="serial">cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b</entry>
Dec 06 12:44:11 user nova-compute[75247]:       <entry name="uuid">cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b</entry>
Dec 06 12:44:11 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:44:11 user nova-compute[75247]:     </system>
Dec 06 12:44:11 user nova-compute[75247]:   </sysinfo>
Dec 06 12:44:11 user nova-compute[75247]:   <os>
Dec 06 12:44:11 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:44:11 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:44:11 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:44:11 user nova-compute[75247]:   </os>
Dec 06 12:44:11 user nova-compute[75247]:   <features>
Dec 06 12:44:11 user nova-compute[75247]:     <acpi/>
Dec 06 12:44:11 user nova-compute[75247]:     <apic/>
Dec 06 12:44:11 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:44:11 user nova-compute[75247]:   </features>
Dec 06 12:44:11 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:44:11 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:44:11 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:44:11 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:44:11 user nova-compute[75247]:   </clock>
Dec 06 12:44:11 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:44:11 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:44:11 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:44:11 user nova-compute[75247]:   </cpu>
Dec 06 12:44:11 user nova-compute[75247]:   <devices>
Dec 06 12:44:11 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:44:11 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:44:11 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk"/>
Dec 06 12:44:11 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:44:11 user nova-compute[75247]:     </disk>
Dec 06 12:44:11 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:44:11 user nova-compute[75247]:       <mac address="fa:16:3e:b5:b1:be"/>
Dec 06 12:44:11 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:44:11 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:44:11 user nova-compute[75247]:       <target dev="tap434efb9d-06"/>
Dec 06 12:44:11 user nova-compute[75247]:     </interface>
Dec 06 12:44:11 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:44:11 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/console.log" append="off"/>
Dec 06 12:44:11 user nova-compute[75247]:     </serial>
Dec 06 12:44:11 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:44:11 user nova-compute[75247]:     <video>
Dec 06 12:44:11 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:44:11 user nova-compute[75247]:     </video>
Dec 06 12:44:11 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:44:11 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:44:11 user nova-compute[75247]:     </rng>
Dec 06 12:44:11 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:44:11 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:44:11 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:44:11 user nova-compute[75247]:     </memballoon>
Dec 06 12:44:11 user nova-compute[75247]:   </devices>
Dec 06 12:44:11 user nova-compute[75247]: </domain>
Dec 06 12:44:11 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:44:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2133511103',display_name='tempest-tempest.common.compute-instance-2133511103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2133511103',id=16,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBDhQTUEw1R3RfVHPhzTtaiheMfD6p83eCfaICq1MZJ1xFdfRrt1xoh/Vh31BgL5j0HqUltFVWq6oXJAAH3kNbtsonPlpThgj+8ZXQcR+K3dodbuTA7Es5PaooP9IaaWg==',key_name='tempest-keypair-1057326227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0ccf15765714ca2a8c4700d2d6e3ed2',ramdisk_id='',reservation_id='r-1mxkfe1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2075667053',owner_user_name='tempest-ServerActionsTestOtherA-2075667053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:44:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13843d8f074da189dbd3e93750b811',uuid=cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "434efb9d-06e4-413b-b470-4952e114c298", "address": "fa:16:3e:b5:b1:be", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434efb9d-06", "ovs_interfaceid": "434efb9d-06e4-413b-b470-4952e114c298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converting VIF {"id": "434efb9d-06e4-413b-b470-4952e114c298", "address": "fa:16:3e:b5:b1:be", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434efb9d-06", "ovs_interfaceid": "434efb9d-06e4-413b-b470-4952e114c298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b1:be,bridge_name='br-int',has_traffic_filtering=True,id=434efb9d-06e4-413b-b470-4952e114c298,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434efb9d-06') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG os_vif [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b1:be,bridge_name='br-int',has_traffic_filtering=True,id=434efb9d-06e4-413b-b470-4952e114c298,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434efb9d-06') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4cea2c49-bfdd-5ecf-9c01-074f92595daa', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap434efb9d-06, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap434efb9d-06, col_values=(('qos', UUID('421e10f8-10e8-4f27-a889-bba2d6a3ba60')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap434efb9d-06, col_values=(('external_ids', {'iface-id': '434efb9d-06e4-413b-b470-4952e114c298', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:b1:be', 'vm-uuid': 'cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:44:11 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Error from libvirt while getting description of instance-00000009: [Error Code 42] Domain not found: no domain with matching uuid 'f2e75618-9164-4527-a6a3-5f5195effccf' (instance-00000009): libvirt.libvirtError: Domain not found: no domain with matching uuid 'f2e75618-9164-4527-a6a3-5f5195effccf' (instance-00000009)
Dec 06 12:44:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:12 user nova-compute[75247]: INFO os_vif [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b1:be,bridge_name='br-int',has_traffic_filtering=True,id=434efb9d-06e4-413b-b470-4952e114c298,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434efb9d-06')
Dec 06 12:44:12 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:44:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:12 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-8631a84d-1fc2-4e0a-9179-c87fcacd1e37 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:44:12 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:44:12 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] No VIF found with MAC fa:16:3e:b5:b1:be, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:44:12 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-8631a84d-1fc2-4e0a-9179-c87fcacd1e37 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:44:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8631a84d-1fc2-4e0a-9179-c87fcacd1e37 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.912s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:12 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-8631a84d-1fc2-4e0a-9179-c87fcacd1e37 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Deleted allocations for instance f2e75618-9164-4527-a6a3-5f5195effccf
Dec 06 12:44:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940d69a3-4737-4e84-b077-fe2eff86753f/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8631a84d-1fc2-4e0a-9179-c87fcacd1e37 tempest-TaggedAttachmentsTest-1141791142 tempest-TaggedAttachmentsTest-1141791142-project-member] Lock "f2e75618-9164-4527-a6a3-5f5195effccf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.540s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940d69a3-4737-4e84-b077-fe2eff86753f/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940d69a3-4737-4e84-b077-fe2eff86753f/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:12 user nova-compute[75247]: DEBUG nova.network.neutron [req-1d6cf5b7-4e9d-43c0-a20c-faac7b2c4a4c req-f53a07c6-ad25-4259-8517-22bb18ef089d service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Updated VIF entry in instance network info cache for port 434efb9d-06e4-413b-b470-4952e114c298. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:44:12 user nova-compute[75247]: DEBUG nova.network.neutron [req-1d6cf5b7-4e9d-43c0-a20c-faac7b2c4a4c req-f53a07c6-ad25-4259-8517-22bb18ef089d service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Updating instance_info_cache with network_info: [{"id": "434efb9d-06e4-413b-b470-4952e114c298", "address": "fa:16:3e:b5:b1:be", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434efb9d-06", "ovs_interfaceid": "434efb9d-06e4-413b-b470-4952e114c298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:44:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1d6cf5b7-4e9d-43c0-a20c-faac7b2c4a4c req-f53a07c6-ad25-4259-8517-22bb18ef089d service nova] Releasing lock "refresh_cache-cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:44:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940d69a3-4737-4e84-b077-fe2eff86753f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:44:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-bfd180a4-3540-4abc-a2af-d4473f146e48 req-fe8e4278-d04c-403c-a26c-a3fe1dfa21ba service nova] [instance: f2e75618-9164-4527-a6a3-5f5195effccf] Received event network-vif-deleted-68ab6435-5cd9-45bf-891c-c20b68415e11 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:16 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:44:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:44:16 user nova-compute[75247]: DEBUG nova.compute.manager [req-f7bc42ef-5844-487a-bd32-af43509c5238 req-36d360fd-cc6d-496c-bc10-1200848aaaf2 service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Received event network-vif-plugged-434efb9d-06e4-413b-b470-4952e114c298 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f7bc42ef-5844-487a-bd32-af43509c5238 req-36d360fd-cc6d-496c-bc10-1200848aaaf2 service nova] Acquiring lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f7bc42ef-5844-487a-bd32-af43509c5238 req-36d360fd-cc6d-496c-bc10-1200848aaaf2 service nova] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f7bc42ef-5844-487a-bd32-af43509c5238 req-36d360fd-cc6d-496c-bc10-1200848aaaf2 service nova] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:16 user nova-compute[75247]: DEBUG nova.compute.manager [req-f7bc42ef-5844-487a-bd32-af43509c5238 req-36d360fd-cc6d-496c-bc10-1200848aaaf2 service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] No waiting events found dispatching network-vif-plugged-434efb9d-06e4-413b-b470-4952e114c298 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:44:16 user nova-compute[75247]: WARNING nova.compute.manager [req-f7bc42ef-5844-487a-bd32-af43509c5238 req-36d360fd-cc6d-496c-bc10-1200848aaaf2 service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Received unexpected event network-vif-plugged-434efb9d-06e4-413b-b470-4952e114c298 for instance with vm_state building and task_state spawning.
Dec 06 12:44:16 user nova-compute[75247]: DEBUG nova.compute.manager [req-f7bc42ef-5844-487a-bd32-af43509c5238 req-36d360fd-cc6d-496c-bc10-1200848aaaf2 service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Received event network-vif-plugged-434efb9d-06e4-413b-b470-4952e114c298 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f7bc42ef-5844-487a-bd32-af43509c5238 req-36d360fd-cc6d-496c-bc10-1200848aaaf2 service nova] Acquiring lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f7bc42ef-5844-487a-bd32-af43509c5238 req-36d360fd-cc6d-496c-bc10-1200848aaaf2 service nova] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f7bc42ef-5844-487a-bd32-af43509c5238 req-36d360fd-cc6d-496c-bc10-1200848aaaf2 service nova] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:16 user nova-compute[75247]: DEBUG nova.compute.manager [req-f7bc42ef-5844-487a-bd32-af43509c5238 req-36d360fd-cc6d-496c-bc10-1200848aaaf2 service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] No waiting events found dispatching network-vif-plugged-434efb9d-06e4-413b-b470-4952e114c298 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:44:16 user nova-compute[75247]: WARNING nova.compute.manager [req-f7bc42ef-5844-487a-bd32-af43509c5238 req-36d360fd-cc6d-496c-bc10-1200848aaaf2 service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Received unexpected event network-vif-plugged-434efb9d-06e4-413b-b470-4952e114c298 for instance with vm_state building and task_state spawning.
Dec 06 12:44:16 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Instance spawned successfully.
Dec 06 12:44:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:44:16 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:44:16 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:44:16 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=7857MB free_disk=25.390426635742188GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 12:44:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:44:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:44:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:44:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:44:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:44:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:44:16 user nova-compute[75247]: INFO nova.compute.manager [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Took 7.90 seconds to spawn the instance on the hypervisor.
Dec 06 12:44:16 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:44:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:17 user nova-compute[75247]: INFO nova.compute.manager [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Took 9.35 seconds to build instance.
Dec 06 12:44:17 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 70c4664e-ae7a-47de-bba7-18300391d209 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:44:17 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 782289e2-91cd-4aee-9a08-eadfb2a5965b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:44:17 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:44:17 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 4531bf11-b948-4d57-bf55-f33563815e26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:44:17 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance ec9eea5d-dc9a-4a65-881a-a89538e3a593 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:44:17 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance dbb64a66-f500-407b-ae92-80f27eb6ce2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:44:17 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance ed721541-3a94-496f-8b9d-88c74ac83ef7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:44:17 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 940d69a3-4737-4e84-b077-fe2eff86753f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:44:17 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 3e1b5197-dc38-48a5-b9f9-e053be499433 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:44:17 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 0a86fe94-933a-4e0d-8a65-4834c3d3e40b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:44:17 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:44:17 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 12:44:17 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 12:44:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6e52f177-57a9-455e-bbe3-5c5f775cc47c tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.454s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:17 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:44:17 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:44:17 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 12:44:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.888s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YiAyasdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:44:19 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:44:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:44:19 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:44:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:44:19 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:44:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[005e86fb-b9c1-4847-84e5-fae3e8bbe7b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:44:19 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[84762fbe-c3f1-4287-baf5-a06a107ee5a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db] added
Dec 06 12:44:19 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0cf716-9b95-492a-ade9-e634817cd643]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae1f278-e0fc-47ab-84a9-680ffe6c6823]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YiAyasdQ {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YiAyasdQ" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cba79f9-6914-4de4-b2fe-6f73efb24ba9]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YiAyasdQ'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac2ac1d-43d7-4003-aeb2-6d62c684f97d]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd66281-b221-4737-abc0-f4b129f55e6f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:44:19 user nova-compute[75247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:44:19 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:44:19 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:44:19 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:44:19 user nova-compute[75247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:44:19 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:44:19 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:44:19 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:44:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --login" returned: 0 in 0.153s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21f2c37-b200-4469-9252-626750440603]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db, portal: 172.16.0.220,3260]
Dec 06 12:44:20 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db, portal: 172.16.0.220,3260] successful.
Dec 06 12:44:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c5fc90-6db3-4312-8242-497e96525b77]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c645ca-229f-402a-9321-39ff9b6de5d2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:44:20 user nova-compute[75247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:44:20 user nova-compute[75247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:44:20 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:44:20 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:44:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:44:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:44:20 user nova-compute[75247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:44:20 user nova-compute[75247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:44:20 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:44:20 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:44:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:44:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.411s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:44:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:44:20 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:44:20 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:44:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2e5c3a-8ca2-45b4-8a8e-0ecf39fc53c0]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:20 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:44:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YiAyasdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:44:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.466s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:44:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] <== connect_volume: return (1467ms) {'type': 'block', 'scsi_wwn': '23837616363616163', 'path': '/dev/sdb'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:44:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837616363616163', 'path': '/dev/sdb'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:44:21 user nova-compute[75247]: DEBUG nova.objects.instance [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lazy-loading 'flavor' on Instance uuid 4531bf11-b948-4d57-bf55-f33563815e26 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:44:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 12:44:21 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:44:21 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:44:21 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:44:21 user nova-compute[75247]:   <serial>6492a8c0-e442-4b99-867a-e95fa38234db</serial>
Dec 06 12:44:21 user nova-compute[75247]: </disk>
Dec 06 12:44:21 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 12:44:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:44:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:44:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] No VIF found with MAC fa:16:3e:7d:fe:f6, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:44:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-82db0170-208f-491b-b751-e0318791d086 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "4531bf11-b948-4d57-bf55-f33563815e26" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.168s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-eac24faf-e706-4175-b479-eeea2ba3a6a1 req-c8b14932-4b7c-4022-b9ed-219afe0fbe3d service nova] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Received event network-changed-8e6e824b-bb71-493a-ac2d-b45b1a95fd69 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-eac24faf-e706-4175-b479-eeea2ba3a6a1 req-c8b14932-4b7c-4022-b9ed-219afe0fbe3d service nova] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Refreshing instance network info cache due to event network-changed-8e6e824b-bb71-493a-ac2d-b45b1a95fd69. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:44:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-eac24faf-e706-4175-b479-eeea2ba3a6a1 req-c8b14932-4b7c-4022-b9ed-219afe0fbe3d service nova] Acquiring lock "refresh_cache-940d69a3-4737-4e84-b077-fe2eff86753f" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:44:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-eac24faf-e706-4175-b479-eeea2ba3a6a1 req-c8b14932-4b7c-4022-b9ed-219afe0fbe3d service nova] Acquired lock "refresh_cache-940d69a3-4737-4e84-b077-fe2eff86753f" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:44:23 user nova-compute[75247]: DEBUG nova.network.neutron [req-eac24faf-e706-4175-b479-eeea2ba3a6a1 req-c8b14932-4b7c-4022-b9ed-219afe0fbe3d service nova] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Refreshing network info cache for port 8e6e824b-bb71-493a-ac2d-b45b1a95fd69 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG nova.network.neutron [req-eac24faf-e706-4175-b479-eeea2ba3a6a1 req-c8b14932-4b7c-4022-b9ed-219afe0fbe3d service nova] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Updated VIF entry in instance network info cache for port 8e6e824b-bb71-493a-ac2d-b45b1a95fd69. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG nova.network.neutron [req-eac24faf-e706-4175-b479-eeea2ba3a6a1 req-c8b14932-4b7c-4022-b9ed-219afe0fbe3d service nova] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Updating instance_info_cache with network_info: [{"id": "8e6e824b-bb71-493a-ac2d-b45b1a95fd69", "address": "fa:16:3e:ec:cd:d2", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e6e824b-bb", "ovs_interfaceid": "8e6e824b-bb71-493a-ac2d-b45b1a95fd69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG nova.objects.instance [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'flavor' on Instance uuid a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-eac24faf-e706-4175-b479-eeea2ba3a6a1 req-c8b14932-4b7c-4022-b9ed-219afe0fbe3d service nova] Releasing lock "refresh_cache-940d69a3-4737-4e84-b077-fe2eff86753f" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "refresh_cache-a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquired lock "refresh_cache-a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG nova.network.neutron [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG nova.objects.instance [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'info_cache' on Instance uuid a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bab81ea6-b9a3-4cc2-aec1-8feab9e89e94 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "940d69a3-4737-4e84-b077-fe2eff86753f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bab81ea6-b9a3-4cc2-aec1-8feab9e89e94 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "940d69a3-4737-4e84-b077-fe2eff86753f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bab81ea6-b9a3-4cc2-aec1-8feab9e89e94 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "940d69a3-4737-4e84-b077-fe2eff86753f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bab81ea6-b9a3-4cc2-aec1-8feab9e89e94 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "940d69a3-4737-4e84-b077-fe2eff86753f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bab81ea6-b9a3-4cc2-aec1-8feab9e89e94 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "940d69a3-4737-4e84-b077-fe2eff86753f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:24 user nova-compute[75247]: INFO nova.compute.manager [None req-bab81ea6-b9a3-4cc2-aec1-8feab9e89e94 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Terminating instance
Dec 06 12:44:24 user nova-compute[75247]: DEBUG nova.compute.manager [None req-bab81ea6-b9a3-4cc2-aec1-8feab9e89e94 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG nova.objects.base [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Object Instance<a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a> lazy-loaded attributes: flavor,info_cache {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG nova.network.neutron [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Updating instance_info_cache with network_info: [{"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Releasing lock "refresh_cache-a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Stashing vm_state: active {{(pid=75247) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG nova.compute.manager [req-92870a04-e928-4719-8a35-016d0484f261 req-413ff1a2-7c20-4da5-bdcc-da3a1313acc8 service nova] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Received event network-vif-unplugged-8e6e824b-bb71-493a-ac2d-b45b1a95fd69 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-92870a04-e928-4719-8a35-016d0484f261 req-413ff1a2-7c20-4da5-bdcc-da3a1313acc8 service nova] Acquiring lock "940d69a3-4737-4e84-b077-fe2eff86753f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-92870a04-e928-4719-8a35-016d0484f261 req-413ff1a2-7c20-4da5-bdcc-da3a1313acc8 service nova] Lock "940d69a3-4737-4e84-b077-fe2eff86753f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-92870a04-e928-4719-8a35-016d0484f261 req-413ff1a2-7c20-4da5-bdcc-da3a1313acc8 service nova] Lock "940d69a3-4737-4e84-b077-fe2eff86753f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG nova.compute.manager [req-92870a04-e928-4719-8a35-016d0484f261 req-413ff1a2-7c20-4da5-bdcc-da3a1313acc8 service nova] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] No waiting events found dispatching network-vif-unplugged-8e6e824b-bb71-493a-ac2d-b45b1a95fd69 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG nova.compute.manager [req-92870a04-e928-4719-8a35-016d0484f261 req-413ff1a2-7c20-4da5-bdcc-da3a1313acc8 service nova] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Received event network-vif-unplugged-8e6e824b-bb71-493a-ac2d-b45b1a95fd69 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:44:24 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Instance destroyed successfully.
Dec 06 12:44:24 user nova-compute[75247]: DEBUG nova.objects.instance [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'resources' on Instance uuid a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG nova.objects.base [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Object Instance<a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1942005817',display_name='tempest-AttachVolumeTestJSON-server-1942005817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1942005817',id=4,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGz+hJ0HTVL1CpIzjfndN5RB0FYKnfV0muFx2QzLM69CRA62Oly9Vvvkkj6Ccf/qOmS6iQUbmUmx8/zqty8k8DI7l9pqS+f/lxdpJZ0usxBwqzknFRlQwwi6Ig22Eo3VA==',key_name='tempest-keypair-21482804',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:40:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4f3aeaf6ffdb4cc0807d90e73e92fa7e',ramdisk_id='',reservation_id='r-wenfkxlt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-209684424',owner_user_name='tempest-AttachVolumeTestJSON-209684424-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:42:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cb0e32ba6094d1e8053787bc1979b65',uuid=a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Converting VIF {"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2f:c5,bridge_name='br-int',has_traffic_filtering=True,id=b7c5418b-5afb-45b5-af6c-c46f82ef72cc,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5418b-5a') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG os_vif [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2f:c5,bridge_name='br-int',has_traffic_filtering=True,id=b7c5418b-5afb-45b5-af6c-c46f82ef72cc,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5418b-5a') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7c5418b-5a, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9c7451c-ad67-4d52-9c97-9e06c1f56a85) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:24 user nova-compute[75247]: INFO os_vif [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2f:c5,bridge_name='br-int',has_traffic_filtering=True,id=b7c5418b-5afb-45b5-af6c-c46f82ef72cc,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5418b-5a')
Dec 06 12:44:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vtTPyWGA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:44:24 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:44:24 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1753b93-9561-40f9-833c-c9123b177431]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:44:24 user nova-compute[75247]: No targets found.
Dec 06 12:44:24 user nova-compute[75247]: iSNS:
Dec 06 12:44:24 user nova-compute[75247]: No targets found.
Dec 06 12:44:24 user nova-compute[75247]: STATIC:
Dec 06 12:44:24 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496
Dec 06 12:44:24 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:44:24 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:44:24 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:44:24 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:44:24 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:44:24 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0
Dec 06 12:44:24 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:44:24 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:44:24 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db
Dec 06 12:44:24 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:44:24 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:44:24 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482
Dec 06 12:44:24 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:44:24 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:44:24 user nova-compute[75247]: FIRMWARE:
Dec 06 12:44:24 user nova-compute[75247]: No targets found.
Dec 06 12:44:24 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:44:24 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:44:24 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51b1202-5817-4bba-8bcb-ee5b48d4a835]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:44:24 user nova-compute[75247]: INFO nova.compute.claims [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Claim successful on node user
Dec 06 12:44:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4b1d42-39b7-46b6-b5b2-3a4e876b0b50]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:44:24 user nova-compute[75247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:44:24 user nova-compute[75247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:44:24 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:44:24 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:44:24 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:44:24 user nova-compute[75247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:44:24 user nova-compute[75247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:44:24 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:44:24 user nova-compute[75247]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:44:24 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd7301912d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482'): ({'sdh'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Removing single pathed devices sdh {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:44:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe16bdb-75b5-4f79-ab5a-9784aeeccf90]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:25 user nova-compute[75247]: INFO nova.compute.resource_tracker [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Updating resource usage from migration ebd7dca9-1b0a-4f79-971b-48b7913fd325
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[090b0b73-2e33-413e-960b-9316855cab05]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Flushing IO for device /dev/sdh {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:25 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Instance destroyed successfully.
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.objects.instance [None req-bab81ea6-b9a3-4cc2-aec1-8feab9e89e94 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lazy-loading 'resources' on Instance uuid 940d69a3-4737-4e84-b077-fe2eff86753f {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5d33f7-20cc-4035-ae66-54434911f74b]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-bab81ea6-b9a3-4cc2-aec1-8feab9e89e94 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:42:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1362113558',display_name='tempest-AttachVolumeNegativeTest-server-1362113558',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1362113558',id=13,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3RdpFFkxu/x+zMjteaIxrNkHpxuX7Q9GzuhoK4nRz6goNjP+84mU06vqWICneIeTNu82emf8U1QfBvFHNjI+yyjhQhFpaTAkNxYcNl7FeRuduoxMHLfzJa+kgpLFD5lQ==',key_name='tempest-keypair-1259610535',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:42:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a6b077946334f1c8fd16d091a7738e1',ramdisk_id='',reservation_id='r-wkyi0913',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2136789566',owner_user_name='tempest-AttachVolumeNegativeTest-2136789566-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:42:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d7becd4d5734bc2b652e6f37492eb5e',uuid=940d69a3-4737-4e84-b077-fe2eff86753f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e6e824b-bb71-493a-ac2d-b45b1a95fd69", "address": "fa:16:3e:ec:cd:d2", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e6e824b-bb", "ovs_interfaceid": "8e6e824b-bb71-493a-ac2d-b45b1a95fd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-bab81ea6-b9a3-4cc2-aec1-8feab9e89e94 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Converting VIF {"id": "8e6e824b-bb71-493a-ac2d-b45b1a95fd69", "address": "fa:16:3e:ec:cd:d2", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e6e824b-bb", "ovs_interfaceid": "8e6e824b-bb71-493a-ac2d-b45b1a95fd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-bab81ea6-b9a3-4cc2-aec1-8feab9e89e94 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:cd:d2,bridge_name='br-int',has_traffic_filtering=True,id=8e6e824b-bb71-493a-ac2d-b45b1a95fd69,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e6e824b-bb') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_vif [None req-bab81ea6-b9a3-4cc2-aec1-8feab9e89e94 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:cd:d2,bridge_name='br-int',has_traffic_filtering=True,id=8e6e824b-bb71-493a-ac2d-b45b1a95fd69,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e6e824b-bb') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e6e824b-bb, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa4d21ff-9e9b-402b-83da-9b801beb983e) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:25 user nova-compute[75247]: INFO os_vif [None req-bab81ea6-b9a3-4cc2-aec1-8feab9e89e94 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:cd:d2,bridge_name='br-int',has_traffic_filtering=True,id=8e6e824b-bb71-493a-ac2d-b45b1a95fd69,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e6e824b-bb')
Dec 06 12:44:25 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-bab81ea6-b9a3-4cc2-aec1-8feab9e89e94 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Deleting instance files /opt/stack/data/nova/instances/940d69a3-4737-4e84-b077-fe2eff86753f_del
Dec 06 12:44:25 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-bab81ea6-b9a3-4cc2-aec1-8feab9e89e94 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Deletion of /opt/stack/data/nova/instances/940d69a3-4737-4e84-b077-fe2eff86753f_del complete
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fe2e15-a748-4a56-b536-a518e4e61a4b]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] SCSI volumes sdh have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec8f987-c048-47c1-97c6-731ce94475a9]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:25 user nova-compute[75247]: INFO nova.compute.manager [None req-bab81ea6-b9a3-4cc2-aec1-8feab9e89e94 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Took 1.09 seconds to destroy the instance on the hypervisor.
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-bab81ea6-b9a3-4cc2-aec1-8feab9e89e94 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --logout" returned: 0 in 0.144s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[525d5f13-07ca-4013-9e43-b664a64a0a47]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482, portal: 172.16.0.220,3260]
Dec 06 12:44:25 user nova-compute[75247]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482, portal: 172.16.0.220,3260] successful.
Dec 06 12:44:25 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f1a466-da0f-44ed-bd7b-27acf9a7a3ad]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.553s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] <== disconnect_volume: return (554ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Start _get_guest_xml network_info=[{"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'bc3fc00b-1541-462f-a44f-0af5ba7bd48a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vtTPyWGA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc33ee51-434a-4506-8266-17b7b706f482', 'serial': 'cc33ee51-434a-4506-8266-17b7b706f482'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.objects.instance [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'numa_topology' on Instance uuid a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.objects.base [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Object Instance<a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:44:25 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:44:25 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.objects.instance [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'vcpu_model' on Instance uuid a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.objects.base [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Object Instance<a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vtTPyWGA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:44:25 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:44:25 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:44:25 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9e6401-2c3b-4ea5-8c30-645fe9b0a87b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:44:25 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[74df4be6-ad5a-4660-b786-72b195ae6f07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482] added
Dec 06 12:44:25 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[736b2904-fc8b-4b26-bb30-227933ecc057]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee7bd9f-7665-42d2-a1f6-61c29aafeac7]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vtTPyWGA {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vtTPyWGA" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdae234-1dab-4526-8164-412f3423d211]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vtTPyWGA'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e236bea-6ec5-4b4b-8f4d-5b6aa91b2dc5]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.798s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:25 user nova-compute[75247]: INFO nova.compute.manager [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Migrating
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:44:25 user nova-compute[75247]: INFO nova.compute.rpcapi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bdc886-4aea-4510-a024-602b9db4dd39]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:44:25 user nova-compute[75247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:44:25 user nova-compute[75247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:44:25 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:44:25 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:44:25 user nova-compute[75247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:44:25 user nova-compute[75247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:44:25 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:44:25 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "refresh_cache-4531bf11-b948-4d57-bf55-f33563815e26" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquired lock "refresh_cache-4531bf11-b948-4d57-bf55-f33563815e26" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG nova.network.neutron [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[513db4fe-718e-41ed-bdc9-6c4aa530ad21]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482, portal: 172.16.0.220,3260]
Dec 06 12:44:25 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482, portal: 172.16.0.220,3260] successful.
Dec 06 12:44:25 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6033e2b8-bfea-4e9c-8d14-478d0239bd52]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[620ff155-2dd1-4eda-945c-55f4e1dedaf7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:44:25 user nova-compute[75247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:44:25 user nova-compute[75247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:44:25 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:44:25 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:44:25 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:44:25 user nova-compute[75247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:44:25 user nova-compute[75247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:44:25 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:44:25 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:44:25 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f84ffae-e5bf-446d-8db3-6e72130e4c3f]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:44:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vtTPyWGA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:44:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-7585fe94-bb62-465e-acd9-3d47d529e9ae req-1ab38e82-7d1a-4f10-8ab5-3644b8d41a6c service nova] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Received event network-vif-plugged-8e6e824b-bb71-493a-ac2d-b45b1a95fd69 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7585fe94-bb62-465e-acd9-3d47d529e9ae req-1ab38e82-7d1a-4f10-8ab5-3644b8d41a6c service nova] Acquiring lock "940d69a3-4737-4e84-b077-fe2eff86753f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7585fe94-bb62-465e-acd9-3d47d529e9ae req-1ab38e82-7d1a-4f10-8ab5-3644b8d41a6c service nova] Lock "940d69a3-4737-4e84-b077-fe2eff86753f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7585fe94-bb62-465e-acd9-3d47d529e9ae req-1ab38e82-7d1a-4f10-8ab5-3644b8d41a6c service nova] Lock "940d69a3-4737-4e84-b077-fe2eff86753f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-7585fe94-bb62-465e-acd9-3d47d529e9ae req-1ab38e82-7d1a-4f10-8ab5-3644b8d41a6c service nova] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] No waiting events found dispatching network-vif-plugged-8e6e824b-bb71-493a-ac2d-b45b1a95fd69 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:44:26 user nova-compute[75247]: WARNING nova.compute.manager [req-7585fe94-bb62-465e-acd9-3d47d529e9ae req-1ab38e82-7d1a-4f10-8ab5-3644b8d41a6c service nova] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Received unexpected event network-vif-plugged-8e6e824b-bb71-493a-ac2d-b45b1a95fd69 for instance with vm_state active and task_state deleting.
Dec 06 12:44:26 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:44:26 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23763626533373635', 'path': '/dev/sde'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:44:26 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763626533373635', 'path': '/dev/sde'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:44:26 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1942005817',display_name='tempest-AttachVolumeTestJSON-server-1942005817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1942005817',id=4,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGz+hJ0HTVL1CpIzjfndN5RB0FYKnfV0muFx2QzLM69CRA62Oly9Vvvkkj6Ccf/qOmS6iQUbmUmx8/zqty8k8DI7l9pqS+f/lxdpJZ0usxBwqzknFRlQwwi6Ig22Eo3VA==',key_name='tempest-keypair-21482804',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:40:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4f3aeaf6ffdb4cc0807d90e73e92fa7e',ramdisk_id='',reservation_id='r-wenfkxlt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-209684424',owner_user_name='tempest-AttachVolumeTestJSON-209684424-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:42:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cb0e32ba6094d1e8053787bc1979b65',uuid=a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:44:26 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Converting VIF {"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:44:26 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2f:c5,bridge_name='br-int',has_traffic_filtering=True,id=b7c5418b-5afb-45b5-af6c-c46f82ef72cc,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5418b-5a') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:44:26 user nova-compute[75247]: DEBUG nova.objects.instance [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'pci_devices' on Instance uuid a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:44:26 user nova-compute[75247]: DEBUG nova.objects.base [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Object Instance<a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:44:26 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:44:26 user nova-compute[75247]:   <uuid>a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a</uuid>
Dec 06 12:44:26 user nova-compute[75247]:   <name>instance-00000004</name>
Dec 06 12:44:26 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:44:26 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:44:26 user nova-compute[75247]:   <metadata>
Dec 06 12:44:26 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:44:26 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:44:26 user nova-compute[75247]:       <nova:name>tempest-AttachVolumeTestJSON-server-1942005817</nova:name>
Dec 06 12:44:26 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:44:25</nova:creationTime>
Dec 06 12:44:26 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:44:26 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:44:26 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:44:26 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:44:26 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:44:26 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:44:26 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:44:26 user nova-compute[75247]:       <nova:owner>
Dec 06 12:44:26 user nova-compute[75247]:         <nova:user uuid="4cb0e32ba6094d1e8053787bc1979b65">tempest-AttachVolumeTestJSON-209684424-project-member</nova:user>
Dec 06 12:44:26 user nova-compute[75247]:         <nova:project uuid="4f3aeaf6ffdb4cc0807d90e73e92fa7e">tempest-AttachVolumeTestJSON-209684424</nova:project>
Dec 06 12:44:26 user nova-compute[75247]:       </nova:owner>
Dec 06 12:44:26 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:44:26 user nova-compute[75247]:       <nova:ports>
Dec 06 12:44:26 user nova-compute[75247]:         <nova:port uuid="b7c5418b-5afb-45b5-af6c-c46f82ef72cc">
Dec 06 12:44:26 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 06 12:44:26 user nova-compute[75247]:         </nova:port>
Dec 06 12:44:26 user nova-compute[75247]:       </nova:ports>
Dec 06 12:44:26 user nova-compute[75247]:     </nova:instance>
Dec 06 12:44:26 user nova-compute[75247]:   </metadata>
Dec 06 12:44:26 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:44:26 user nova-compute[75247]:     <system>
Dec 06 12:44:26 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:44:26 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:44:26 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:44:26 user nova-compute[75247]:       <entry name="serial">a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a</entry>
Dec 06 12:44:26 user nova-compute[75247]:       <entry name="uuid">a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a</entry>
Dec 06 12:44:26 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:44:26 user nova-compute[75247]:     </system>
Dec 06 12:44:26 user nova-compute[75247]:   </sysinfo>
Dec 06 12:44:26 user nova-compute[75247]:   <os>
Dec 06 12:44:26 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:44:26 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:44:26 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:44:26 user nova-compute[75247]:   </os>
Dec 06 12:44:26 user nova-compute[75247]:   <features>
Dec 06 12:44:26 user nova-compute[75247]:     <acpi/>
Dec 06 12:44:26 user nova-compute[75247]:     <apic/>
Dec 06 12:44:26 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:44:26 user nova-compute[75247]:   </features>
Dec 06 12:44:26 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:44:26 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:44:26 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:44:26 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:44:26 user nova-compute[75247]:   </clock>
Dec 06 12:44:26 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:44:26 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:44:26 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:44:26 user nova-compute[75247]:   </cpu>
Dec 06 12:44:26 user nova-compute[75247]:   <devices>
Dec 06 12:44:26 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:44:26 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:44:26 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk"/>
Dec 06 12:44:26 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:44:26 user nova-compute[75247]:     </disk>
Dec 06 12:44:26 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 12:44:26 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:44:26 user nova-compute[75247]:       <source dev="/dev/sde"/>
Dec 06 12:44:26 user nova-compute[75247]:       <target dev="vdb" bus="virtio"/>
Dec 06 12:44:26 user nova-compute[75247]:       <serial>cc33ee51-434a-4506-8266-17b7b706f482</serial>
Dec 06 12:44:26 user nova-compute[75247]:     </disk>
Dec 06 12:44:26 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:44:26 user nova-compute[75247]:       <mac address="fa:16:3e:ae:2f:c5"/>
Dec 06 12:44:26 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:44:26 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:44:26 user nova-compute[75247]:       <target dev="tapb7c5418b-5a"/>
Dec 06 12:44:26 user nova-compute[75247]:     </interface>
Dec 06 12:44:26 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:44:26 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/console.log" append="off"/>
Dec 06 12:44:26 user nova-compute[75247]:     </serial>
Dec 06 12:44:26 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:44:26 user nova-compute[75247]:     <video>
Dec 06 12:44:26 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:44:26 user nova-compute[75247]:     </video>
Dec 06 12:44:26 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:44:26 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:44:26 user nova-compute[75247]:     </rng>
Dec 06 12:44:26 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:44:26 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:44:26 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:44:26 user nova-compute[75247]:     </memballoon>
Dec 06 12:44:26 user nova-compute[75247]:   </devices>
Dec 06 12:44:26 user nova-compute[75247]: </domain>
Dec 06 12:44:26 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:44:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG nova.network.neutron [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Updating instance_info_cache with network_info: [{"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Releasing lock "refresh_cache-4531bf11-b948-4d57-bf55-f33563815e26" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG nova.objects.instance [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'trusted_certs' on Instance uuid a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG nova.objects.base [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Object Instance<a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:27 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Took 2.20 seconds to deallocate network for instance.
Dec 06 12:44:27 user nova-compute[75247]: DEBUG nova.compute.manager [req-30859866-2d49-470a-8850-3ff2d75eb51d req-ce0f8768-4757-42dc-a853-552db531d74d service nova] [instance: 940d69a3-4737-4e84-b077-fe2eff86753f] Received event network-vif-deleted-8e6e824b-bb71-493a-ac2d-b45b1a95fd69 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Starting migrate_disk_and_power_off {{(pid=75247) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11490}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bab81ea6-b9a3-4cc2-aec1-8feab9e89e94 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bab81ea6-b9a3-4cc2-aec1-8feab9e89e94 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.190s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Cannot resize image /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG nova.objects.instance [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'migration_context' on Instance uuid a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG nova.objects.base [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Object Instance<a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1942005817',display_name='tempest-AttachVolumeTestJSON-server-1942005817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1942005817',id=4,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGz+hJ0HTVL1CpIzjfndN5RB0FYKnfV0muFx2QzLM69CRA62Oly9Vvvkkj6Ccf/qOmS6iQUbmUmx8/zqty8k8DI7l9pqS+f/lxdpJZ0usxBwqzknFRlQwwi6Ig22Eo3VA==',key_name='tempest-keypair-21482804',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:40:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='4f3aeaf6ffdb4cc0807d90e73e92fa7e',ramdisk_id='',reservation_id='r-wenfkxlt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-209684424',owner_user_name='tempest-AttachVolumeTestJSON-209684424-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:42:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cb0e32ba6094d1e8053787bc1979b65',uuid=a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Converting VIF {"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2f:c5,bridge_name='br-int',has_traffic_filtering=True,id=b7c5418b-5afb-45b5-af6c-c46f82ef72cc,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5418b-5a') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG os_vif [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2f:c5,bridge_name='br-int',has_traffic_filtering=True,id=b7c5418b-5afb-45b5-af6c-c46f82ef72cc,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5418b-5a') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '19928c8e-ba45-58a2-9df8-574e27ffb82c', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7c5418b-5a, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7c5418b-5a, col_values=(('qos', UUID('5e7ec562-f4e5-4841-8189-9c78675a323c')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7c5418b-5a, col_values=(('external_ids', {'iface-id': 'b7c5418b-5afb-45b5-af6c-c46f82ef72cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:2f:c5', 'vm-uuid': 'a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:44:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:27 user nova-compute[75247]: INFO os_vif [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2f:c5,bridge_name='br-int',has_traffic_filtering=True,id=b7c5418b-5afb-45b5-af6c-c46f82ef72cc,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5418b-5a')
Dec 06 12:44:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-10610fce-a7fc-4e0a-90fc-8bbe2cb8cc17 req-df5a2d99-d601-4f3d-9f87-35248330ad48 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received event network-vif-unplugged-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-10610fce-a7fc-4e0a-90fc-8bbe2cb8cc17 req-df5a2d99-d601-4f3d-9f87-35248330ad48 service nova] Acquiring lock "4531bf11-b948-4d57-bf55-f33563815e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-10610fce-a7fc-4e0a-90fc-8bbe2cb8cc17 req-df5a2d99-d601-4f3d-9f87-35248330ad48 service nova] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-10610fce-a7fc-4e0a-90fc-8bbe2cb8cc17 req-df5a2d99-d601-4f3d-9f87-35248330ad48 service nova] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-10610fce-a7fc-4e0a-90fc-8bbe2cb8cc17 req-df5a2d99-d601-4f3d-9f87-35248330ad48 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] No waiting events found dispatching network-vif-unplugged-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:44:28 user nova-compute[75247]: WARNING nova.compute.manager [req-10610fce-a7fc-4e0a-90fc-8bbe2cb8cc17 req-df5a2d99-d601-4f3d-9f87-35248330ad48 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received unexpected event network-vif-unplugged-348d8e54-a814-4893-8636-de9e795794a2 for instance with vm_state active and task_state resize_migrating.
Dec 06 12:44:28 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-bab81ea6-b9a3-4cc2-aec1-8feab9e89e94 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-bab81ea6-b9a3-4cc2-aec1-8feab9e89e94 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bab81ea6-b9a3-4cc2-aec1-8feab9e89e94 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.664s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:28 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-bab81ea6-b9a3-4cc2-aec1-8feab9e89e94 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Deleted allocations for instance 940d69a3-4737-4e84-b077-fe2eff86753f
Dec 06 12:44:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bab81ea6-b9a3-4cc2-aec1-8feab9e89e94 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "940d69a3-4737-4e84-b077-fe2eff86753f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.295s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:28 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Instance destroyed successfully.
Dec 06 12:44:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1307258181',display_name='tempest-ServerActionsTestOtherB-server-1307258181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1307258181',id=5,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXd4LdKL4pG7XKtcC6TX8wMNmPTD7z6hx6EQTzh/vLbbeocUHdpJ42qGTjwVyD4AThWLqebjjgjZMtQsvJgysEhbuskpjq8ZyizdS/bi/KghYHYkKPwpNCJccaNThNvgg==',key_name='tempest-keypair-1971386181',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:40:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='57ba4e5fa37f4fd29d6712069230d3e6',ramdisk_id='',reservation_id='r-wbn2uy0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-472154126',owner_user_name='tempest-ServerActionsTestOtherB-472154126-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:44:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd4165666a1426aa1134c2889214b0f',uuid=4531bf11-b948-4d57-bf55-f33563815e26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1124684059-network", "vif_mac": "fa:16:3e:7d:fe:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Converting VIF {"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1124684059-network", "vif_mac": "fa:16:3e:7d:fe:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=348d8e54-a814-4893-8636-de9e795794a2,network=Network(7d8127bc-30f6-40e2-9bd3-2054440440d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348d8e54-a8') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG os_vif [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=348d8e54-a814-4893-8636-de9e795794a2,network=Network(7d8127bc-30f6-40e2-9bd3-2054440440d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348d8e54-a8') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap348d8e54-a8, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3dc5bd8a-8377-4ab5-8632-23b1e5931a2d) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:28 user nova-compute[75247]: INFO os_vif [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=348d8e54-a814-4893-8636-de9e795794a2,network=Network(7d8127bc-30f6-40e2-9bd3-2054440440d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348d8e54-a8')
Dec 06 12:44:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YiAyasdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:44:28 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:44:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c83f6b2-faa9-4c8e-8b58-7d50d70b0c60]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:44:28 user nova-compute[75247]: No targets found.
Dec 06 12:44:28 user nova-compute[75247]: iSNS:
Dec 06 12:44:28 user nova-compute[75247]: No targets found.
Dec 06 12:44:28 user nova-compute[75247]: STATIC:
Dec 06 12:44:28 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496
Dec 06 12:44:28 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:44:28 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:44:28 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:44:28 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:44:28 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:44:28 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0
Dec 06 12:44:28 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:44:28 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:44:28 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db
Dec 06 12:44:28 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:44:28 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:44:28 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482
Dec 06 12:44:28 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:44:28 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:44:28 user nova-compute[75247]: FIRMWARE:
Dec 06 12:44:28 user nova-compute[75247]: No targets found.
Dec 06 12:44:28 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:44:28 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:44:28 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[51367a3c-aaaf-42e0-a99b-9a0b06b76cb4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[48564b93-005e-491a-8b82-2815ce45904d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:44:28 user nova-compute[75247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:44:28 user nova-compute[75247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:44:28 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:44:28 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:44:28 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:44:28 user nova-compute[75247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:44:28 user nova-compute[75247]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:44:28 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:44:28 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:44:28 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd73019e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db'): ({'sdb'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Removing single pathed devices sdb {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6361edfd-a130-40a7-a74a-b51576e70f7a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c7faaa-2ab9-4ebe-8b25-2785eefdfe00]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Flushing IO for device /dev/sdb {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36749e2-71c7-4857-aa4f-8cb749504a48]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:44:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.182s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5968593b-03f6-4334-aeba-d28d3e6b69ba]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08ce146-2ad2-4559-8e11-74aa8a239629]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6f4b9f-b3cf-4c79-bdcc-7197ef2294bd]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db, portal: 172.16.0.220,3260]
Dec 06 12:44:29 user nova-compute[75247]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db, portal: 172.16.0.220,3260] successful.
Dec 06 12:44:29 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e14bb0-9a98-43c3-8493-d5099a96fdeb]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.487s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] <== disconnect_volume: return (488ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26_resize/disk /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] CMD "cp -r /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26_resize/disk /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk" returned: 0 in 0.426s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26_resize/disk.info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk.info {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] CMD "cp -r /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26_resize/disk.info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk.info" returned: 0 in 0.052s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:30 user nova-compute[75247]: DEBUG nova.compute.manager [req-8973b159-d255-4a58-97a0-c0c33544edf2 req-6fa967c5-4e95-40c8-9a4a-84e9740dadcb service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received event network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-8973b159-d255-4a58-97a0-c0c33544edf2 req-6fa967c5-4e95-40c8-9a4a-84e9740dadcb service nova] Acquiring lock "4531bf11-b948-4d57-bf55-f33563815e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-8973b159-d255-4a58-97a0-c0c33544edf2 req-6fa967c5-4e95-40c8-9a4a-84e9740dadcb service nova] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-8973b159-d255-4a58-97a0-c0c33544edf2 req-6fa967c5-4e95-40c8-9a4a-84e9740dadcb service nova] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:30 user nova-compute[75247]: DEBUG nova.compute.manager [req-8973b159-d255-4a58-97a0-c0c33544edf2 req-6fa967c5-4e95-40c8-9a4a-84e9740dadcb service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] No waiting events found dispatching network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:44:30 user nova-compute[75247]: WARNING nova.compute.manager [req-8973b159-d255-4a58-97a0-c0c33544edf2 req-6fa967c5-4e95-40c8-9a4a-84e9740dadcb service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received unexpected event network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 for instance with vm_state active and task_state resize_migrating.
Dec 06 12:44:30 user nova-compute[75247]: DEBUG nova.compute.manager [req-7aa28e87-28de-444d-9656-e3cc332a50a4 req-2a5413b5-a49b-4d0e-8554-47aaef641480 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received event network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7aa28e87-28de-444d-9656-e3cc332a50a4 req-2a5413b5-a49b-4d0e-8554-47aaef641480 service nova] Acquiring lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7aa28e87-28de-444d-9656-e3cc332a50a4 req-2a5413b5-a49b-4d0e-8554-47aaef641480 service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7aa28e87-28de-444d-9656-e3cc332a50a4 req-2a5413b5-a49b-4d0e-8554-47aaef641480 service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:30 user nova-compute[75247]: DEBUG nova.compute.manager [req-7aa28e87-28de-444d-9656-e3cc332a50a4 req-2a5413b5-a49b-4d0e-8554-47aaef641480 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] No waiting events found dispatching network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:44:30 user nova-compute[75247]: WARNING nova.compute.manager [req-7aa28e87-28de-444d-9656-e3cc332a50a4 req-2a5413b5-a49b-4d0e-8554-47aaef641480 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received unexpected event network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc for instance with vm_state stopped and task_state powering-on.
Dec 06 12:44:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a633cb86-8324-42d3-b578-aa16dca2b9a7 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Acquiring lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a633cb86-8324-42d3-b578-aa16dca2b9a7 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a633cb86-8324-42d3-b578-aa16dca2b9a7 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Acquiring lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a633cb86-8324-42d3-b578-aa16dca2b9a7 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a633cb86-8324-42d3-b578-aa16dca2b9a7 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:30 user nova-compute[75247]: INFO nova.compute.manager [None req-a633cb86-8324-42d3-b578-aa16dca2b9a7 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Terminating instance
Dec 06 12:44:30 user nova-compute[75247]: DEBUG nova.compute.manager [None req-a633cb86-8324-42d3-b578-aa16dca2b9a7 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:44:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:31 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Instance destroyed successfully.
Dec 06 12:44:31 user nova-compute[75247]: DEBUG nova.objects.instance [None req-a633cb86-8324-42d3-b578-aa16dca2b9a7 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lazy-loading 'resources' on Instance uuid dbb64a66-f500-407b-ae92-80f27eb6ce2e {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:44:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-a633cb86-8324-42d3-b578-aa16dca2b9a7 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-511846269',display_name='tempest-TestVolumeSwap-server-511846269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-511846269',id=8,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMSSRL05OBf7q6EBiY5Wi+iA+BRCtnSnHfUpaMhcSzrT4gAeWrXOrO8Dt7eqx7VM46FFzMkf0EZob+q+ADX6damHqod3nRTcgkEnsE8x/DmKzkOlkBN7YB7HrUllMqL0Q==',key_name='tempest-keypair-1423327926',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:40:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09aa091fb4534e24b685fec6e6ca52e7',ramdisk_id='',reservation_id='r-1zc0u4bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-994069222',owner_user_name='tempest-TestVolumeSwap-994069222-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:40:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1e02d70124b494c839a0b4f9b8267d4',uuid=dbb64a66-f500-407b-ae92-80f27eb6ce2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee42c358-3097-4050-a477-8a48b500de81", "address": "fa:16:3e:fd:3e:cc", "network": {"id": "003dc158-ddf8-48e4-9fa4-d9fa5f102273", "bridge": "br-int", "label": "tempest-TestVolumeSwap-823652334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09aa091fb4534e24b685fec6e6ca52e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee42c358-30", "ovs_interfaceid": "ee42c358-3097-4050-a477-8a48b500de81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:44:31 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-a633cb86-8324-42d3-b578-aa16dca2b9a7 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Converting VIF {"id": "ee42c358-3097-4050-a477-8a48b500de81", "address": "fa:16:3e:fd:3e:cc", "network": {"id": "003dc158-ddf8-48e4-9fa4-d9fa5f102273", "bridge": "br-int", "label": "tempest-TestVolumeSwap-823652334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09aa091fb4534e24b685fec6e6ca52e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee42c358-30", "ovs_interfaceid": "ee42c358-3097-4050-a477-8a48b500de81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:44:31 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-a633cb86-8324-42d3-b578-aa16dca2b9a7 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:3e:cc,bridge_name='br-int',has_traffic_filtering=True,id=ee42c358-3097-4050-a477-8a48b500de81,network=Network(003dc158-ddf8-48e4-9fa4-d9fa5f102273),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee42c358-30') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:44:31 user nova-compute[75247]: DEBUG os_vif [None req-a633cb86-8324-42d3-b578-aa16dca2b9a7 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:3e:cc,bridge_name='br-int',has_traffic_filtering=True,id=ee42c358-3097-4050-a477-8a48b500de81,network=Network(003dc158-ddf8-48e4-9fa4-d9fa5f102273),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee42c358-30') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:44:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee42c358-30, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:44:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9730af39-7fab-4e90-8ff5-1d31359d1d77) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:44:31 user nova-compute[75247]: INFO os_vif [None req-a633cb86-8324-42d3-b578-aa16dca2b9a7 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:3e:cc,bridge_name='br-int',has_traffic_filtering=True,id=ee42c358-3097-4050-a477-8a48b500de81,network=Network(003dc158-ddf8-48e4-9fa4-d9fa5f102273),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee42c358-30')
Dec 06 12:44:31 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-a633cb86-8324-42d3-b578-aa16dca2b9a7 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Deleting instance files /opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e_del
Dec 06 12:44:31 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-a633cb86-8324-42d3-b578-aa16dca2b9a7 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Deletion of /opt/stack/data/nova/instances/dbb64a66-f500-407b-ae92-80f27eb6ce2e_del complete
Dec 06 12:44:31 user nova-compute[75247]: INFO nova.compute.manager [None req-a633cb86-8324-42d3-b578-aa16dca2b9a7 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Took 0.97 seconds to destroy the instance on the hypervisor.
Dec 06 12:44:31 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-a633cb86-8324-42d3-b578-aa16dca2b9a7 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:44:31 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:44:31 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:44:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:31 user nova-compute[75247]: DEBUG nova.network.neutron [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Port 348d8e54-a814-4893-8636-de9e795794a2 binding to destination host user is already ACTIVE {{(pid=75247) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "4531bf11-b948-4d57-bf55-f33563815e26-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "refresh_cache-4531bf11-b948-4d57-bf55-f33563815e26" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquired lock "refresh_cache-4531bf11-b948-4d57-bf55-f33563815e26" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG nova.network.neutron [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received event network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] Acquiring lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] No waiting events found dispatching network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:44:32 user nova-compute[75247]: WARNING nova.compute.manager [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received unexpected event network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc for instance with vm_state stopped and task_state powering-on.
Dec 06 12:44:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Received event network-vif-unplugged-ee42c358-3097-4050-a477-8a48b500de81 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] Acquiring lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] No waiting events found dispatching network-vif-unplugged-ee42c358-3097-4050-a477-8a48b500de81 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Received event network-vif-unplugged-ee42c358-3097-4050-a477-8a48b500de81 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Received event network-vif-plugged-ee42c358-3097-4050-a477-8a48b500de81 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] Acquiring lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] No waiting events found dispatching network-vif-plugged-ee42c358-3097-4050-a477-8a48b500de81 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:44:32 user nova-compute[75247]: WARNING nova.compute.manager [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Received unexpected event network-vif-plugged-ee42c358-3097-4050-a477-8a48b500de81 for instance with vm_state active and task_state deleting.
Dec 06 12:44:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Received event network-vif-plugged-ee42c358-3097-4050-a477-8a48b500de81 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] Acquiring lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] No waiting events found dispatching network-vif-plugged-ee42c358-3097-4050-a477-8a48b500de81 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:44:32 user nova-compute[75247]: WARNING nova.compute.manager [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Received unexpected event network-vif-plugged-ee42c358-3097-4050-a477-8a48b500de81 for instance with vm_state active and task_state deleting.
Dec 06 12:44:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Received event network-vif-plugged-ee42c358-3097-4050-a477-8a48b500de81 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] Acquiring lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] No waiting events found dispatching network-vif-plugged-ee42c358-3097-4050-a477-8a48b500de81 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:44:32 user nova-compute[75247]: WARNING nova.compute.manager [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Received unexpected event network-vif-plugged-ee42c358-3097-4050-a477-8a48b500de81 for instance with vm_state active and task_state deleting.
Dec 06 12:44:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Received event network-vif-unplugged-ee42c358-3097-4050-a477-8a48b500de81 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] Acquiring lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] No waiting events found dispatching network-vif-unplugged-ee42c358-3097-4050-a477-8a48b500de81 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Received event network-vif-unplugged-ee42c358-3097-4050-a477-8a48b500de81 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Received event network-vif-plugged-ee42c358-3097-4050-a477-8a48b500de81 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] Acquiring lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] No waiting events found dispatching network-vif-plugged-ee42c358-3097-4050-a477-8a48b500de81 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:44:32 user nova-compute[75247]: WARNING nova.compute.manager [req-65c0bb83-58d8-4ee8-87c0-9af917855adf req-7c939dd3-d232-400f-9964-c22c3cdbb05c service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Received unexpected event network-vif-plugged-ee42c358-3097-4050-a477-8a48b500de81 for instance with vm_state active and task_state deleting.
Dec 06 12:44:32 user nova-compute[75247]: DEBUG nova.compute.manager [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:44:32 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Instance rebooted successfully.
Dec 06 12:44:32 user nova-compute[75247]: DEBUG nova.compute.manager [None req-56595db2-49d2-4a4c-8cb2-bc387a05859c tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:44:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:33 user nova-compute[75247]: DEBUG nova.network.neutron [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Updating instance_info_cache with network_info: [{"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:44:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Releasing lock "refresh_cache-4531bf11-b948-4d57-bf55-f33563815e26" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:44:33 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:44:33 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Took 2.05 seconds to deallocate network for instance.
Dec 06 12:44:33 user nova-compute[75247]: DEBUG nova.compute.manager [req-27152cd1-b208-4b95-92da-e69687626e38 req-a3c1e8d3-fde7-42ce-9943-fa0ad259d977 service nova] [instance: dbb64a66-f500-407b-ae92-80f27eb6ce2e] Received event network-vif-deleted-ee42c358-3097-4050-a477-8a48b500de81 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:33 user nova-compute[75247]: DEBUG os_brick.utils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:44:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:33 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4373b5-1798-41e8-aed8-9d2daa5a8d10]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:33 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dbf5ee-52f4-4882-b540-f4b228a2acaa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a633cb86-8324-42d3-b578-aa16dca2b9a7 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a633cb86-8324-42d3-b578-aa16dca2b9a7 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:33 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4ace24-d916-4695-8f7c-bdc76e3d9574]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:33 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1121e2-63b9-4a2c-85f3-5d5a04510573]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:44:33 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:44:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:44:33 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:44:33 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f02290f-1029-4b3b-9e81-c03a870474dd]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:33 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:44:33 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:44:33 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:44:33 user nova-compute[75247]: DEBUG os_brick.utils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:44:34 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-a633cb86-8324-42d3-b578-aa16dca2b9a7 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:44:34 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-a633cb86-8324-42d3-b578-aa16dca2b9a7 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:44:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a633cb86-8324-42d3-b578-aa16dca2b9a7 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.631s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:34 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-a633cb86-8324-42d3-b578-aa16dca2b9a7 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Deleted allocations for instance dbb64a66-f500-407b-ae92-80f27eb6ce2e
Dec 06 12:44:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a633cb86-8324-42d3-b578-aa16dca2b9a7 tempest-TestVolumeSwap-994069222 tempest-TestVolumeSwap-994069222-project-member] Lock "dbb64a66-f500-407b-ae92-80f27eb6ce2e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.039s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:36 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Starting finish_migration {{(pid=75247) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11677}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Instance directory exists: not creating {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 06 12:44:45 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Creating image(s)
Dec 06 12:44:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.229s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk. size=21474836480 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk 21474836480 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk 21474836480" returned: 0 in 0.069s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Did not create local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Ensure instance console log exists: /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Start _get_guest_xml network_info=[{"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1124684059-network", "vif_mac": "fa:16:3e:7d:fe:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'f88c631c-787f-4a1f-a02c-2048e1a71e9a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YiAyasdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4531bf11-b948-4d57-bf55-f33563815e26', 'attached_at': '2023-12-06T12:44:45.000000', 'detached_at': '', 'volume_id': '6492a8c0-e442-4b99-867a-e95fa38234db', 'serial': '6492a8c0-e442-4b99-867a-e95fa38234db'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:44:45 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:44:45 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:44:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YiAyasdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:44:45 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:44:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:44:45 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:44:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:44:45 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:44:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbfab33-1ebc-4d32-9b1b-005dd3f0c174]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:44:45 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[469285fb-f150-40d7-8cc5-5553d6eb001e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db] added
Dec 06 12:44:45 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94db72e-d7a0-44d9-a327-3072bfaff4bc]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b2a1bb-071f-428d-9008-10a6ce338b4e]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YiAyasdQ {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YiAyasdQ" returned: 0 in 0.029s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3178d92-93bb-447a-ba13-6e4710d75aec]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YiAyasdQ'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2902e060-7f24-4867-a404-d0f5f38d9765]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d5b473-821f-427d-8ab1-ce34f5b4b2b2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:44:46 user nova-compute[75247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:44:46 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:44:46 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:44:46 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:44:46 user nova-compute[75247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:44:46 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:44:46 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:44:46 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15c64dc-3f16-4b76-b0da-9bb4dd25d307]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db, portal: 172.16.0.220,3260]
Dec 06 12:44:46 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db, portal: 172.16.0.220,3260] successful.
Dec 06 12:44:46 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dc6a9c-af62-414b-a77f-4b848b3973ad]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c937e3a-67f6-4685-861c-5e52aede9ff8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:44:46 user nova-compute[75247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:44:46 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:44:46 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:44:46 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:44:46 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:44:46 user nova-compute[75247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:44:46 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:44:46 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:44:46 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:44:46 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b42ee2a-1244-4f24-bb1b-36d36d128367]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YiAyasdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:44:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23837616363616163', 'path': '/dev/sdb'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837616363616163', 'path': '/dev/sdb'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1307258181',display_name='tempest-ServerActionsTestOtherB-server-1307258181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1307258181',id=5,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXd4LdKL4pG7XKtcC6TX8wMNmPTD7z6hx6EQTzh/vLbbeocUHdpJ42qGTjwVyD4AThWLqebjjgjZMtQsvJgysEhbuskpjq8ZyizdS/bi/KghYHYkKPwpNCJccaNThNvgg==',key_name='tempest-keypair-1971386181',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:40:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='57ba4e5fa37f4fd29d6712069230d3e6',ramdisk_id='',reservation_id='r-wbn2uy0x',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-472154126',owner_user_name='tempest-ServerActionsTestOtherB-472154126-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:44:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd4165666a1426aa1134c2889214b0f',uuid=4531bf11-b948-4d57-bf55-f33563815e26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1124684059-network", "vif_mac": "fa:16:3e:7d:fe:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Converting VIF {"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1124684059-network", "vif_mac": "fa:16:3e:7d:fe:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=348d8e54-a814-4893-8636-de9e795794a2,network=Network(7d8127bc-30f6-40e2-9bd3-2054440440d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348d8e54-a8') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:44:47 user nova-compute[75247]:   <uuid>4531bf11-b948-4d57-bf55-f33563815e26</uuid>
Dec 06 12:44:47 user nova-compute[75247]:   <name>instance-00000005</name>
Dec 06 12:44:47 user nova-compute[75247]:   <memory>2097152</memory>
Dec 06 12:44:47 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:44:47 user nova-compute[75247]:   <metadata>
Dec 06 12:44:47 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:44:47 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:44:47 user nova-compute[75247]:       <nova:name>tempest-ServerActionsTestOtherB-server-1307258181</nova:name>
Dec 06 12:44:47 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:44:45</nova:creationTime>
Dec 06 12:44:47 user nova-compute[75247]:       <nova:flavor name="m1.small">
Dec 06 12:44:47 user nova-compute[75247]:         <nova:memory>2048</nova:memory>
Dec 06 12:44:47 user nova-compute[75247]:         <nova:disk>20</nova:disk>
Dec 06 12:44:47 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:44:47 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:44:47 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:44:47 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:44:47 user nova-compute[75247]:       <nova:owner>
Dec 06 12:44:47 user nova-compute[75247]:         <nova:user uuid="5dd4165666a1426aa1134c2889214b0f">tempest-ServerActionsTestOtherB-472154126-project-member</nova:user>
Dec 06 12:44:47 user nova-compute[75247]:         <nova:project uuid="57ba4e5fa37f4fd29d6712069230d3e6">tempest-ServerActionsTestOtherB-472154126</nova:project>
Dec 06 12:44:47 user nova-compute[75247]:       </nova:owner>
Dec 06 12:44:47 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:44:47 user nova-compute[75247]:       <nova:ports>
Dec 06 12:44:47 user nova-compute[75247]:         <nova:port uuid="348d8e54-a814-4893-8636-de9e795794a2">
Dec 06 12:44:47 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 06 12:44:47 user nova-compute[75247]:         </nova:port>
Dec 06 12:44:47 user nova-compute[75247]:       </nova:ports>
Dec 06 12:44:47 user nova-compute[75247]:     </nova:instance>
Dec 06 12:44:47 user nova-compute[75247]:   </metadata>
Dec 06 12:44:47 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:44:47 user nova-compute[75247]:     <system>
Dec 06 12:44:47 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:44:47 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:44:47 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:44:47 user nova-compute[75247]:       <entry name="serial">4531bf11-b948-4d57-bf55-f33563815e26</entry>
Dec 06 12:44:47 user nova-compute[75247]:       <entry name="uuid">4531bf11-b948-4d57-bf55-f33563815e26</entry>
Dec 06 12:44:47 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:44:47 user nova-compute[75247]:     </system>
Dec 06 12:44:47 user nova-compute[75247]:   </sysinfo>
Dec 06 12:44:47 user nova-compute[75247]:   <os>
Dec 06 12:44:47 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:44:47 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:44:47 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:44:47 user nova-compute[75247]:   </os>
Dec 06 12:44:47 user nova-compute[75247]:   <features>
Dec 06 12:44:47 user nova-compute[75247]:     <acpi/>
Dec 06 12:44:47 user nova-compute[75247]:     <apic/>
Dec 06 12:44:47 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:44:47 user nova-compute[75247]:   </features>
Dec 06 12:44:47 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:44:47 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:44:47 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:44:47 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:44:47 user nova-compute[75247]:   </clock>
Dec 06 12:44:47 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:44:47 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:44:47 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:44:47 user nova-compute[75247]:   </cpu>
Dec 06 12:44:47 user nova-compute[75247]:   <devices>
Dec 06 12:44:47 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:44:47 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:44:47 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk"/>
Dec 06 12:44:47 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:44:47 user nova-compute[75247]:     </disk>
Dec 06 12:44:47 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 12:44:47 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:44:47 user nova-compute[75247]:       <source dev="/dev/sdb"/>
Dec 06 12:44:47 user nova-compute[75247]:       <target dev="vdb" bus="virtio"/>
Dec 06 12:44:47 user nova-compute[75247]:       <serial>6492a8c0-e442-4b99-867a-e95fa38234db</serial>
Dec 06 12:44:47 user nova-compute[75247]:     </disk>
Dec 06 12:44:47 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:44:47 user nova-compute[75247]:       <mac address="fa:16:3e:7d:fe:f6"/>
Dec 06 12:44:47 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:44:47 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:44:47 user nova-compute[75247]:       <target dev="tap348d8e54-a8"/>
Dec 06 12:44:47 user nova-compute[75247]:     </interface>
Dec 06 12:44:47 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:44:47 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/console.log" append="off"/>
Dec 06 12:44:47 user nova-compute[75247]:     </serial>
Dec 06 12:44:47 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:44:47 user nova-compute[75247]:     <video>
Dec 06 12:44:47 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:44:47 user nova-compute[75247]:     </video>
Dec 06 12:44:47 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:44:47 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:44:47 user nova-compute[75247]:     </rng>
Dec 06 12:44:47 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:44:47 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:44:47 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:44:47 user nova-compute[75247]:     </memballoon>
Dec 06 12:44:47 user nova-compute[75247]:   </devices>
Dec 06 12:44:47 user nova-compute[75247]: </domain>
Dec 06 12:44:47 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1307258181',display_name='tempest-ServerActionsTestOtherB-server-1307258181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1307258181',id=5,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXd4LdKL4pG7XKtcC6TX8wMNmPTD7z6hx6EQTzh/vLbbeocUHdpJ42qGTjwVyD4AThWLqebjjgjZMtQsvJgysEhbuskpjq8ZyizdS/bi/KghYHYkKPwpNCJccaNThNvgg==',key_name='tempest-keypair-1971386181',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:40:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='57ba4e5fa37f4fd29d6712069230d3e6',ramdisk_id='',reservation_id='r-wbn2uy0x',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-472154126',owner_user_name='tempest-ServerActionsTestOtherB-472154126-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:44:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd4165666a1426aa1134c2889214b0f',uuid=4531bf11-b948-4d57-bf55-f33563815e26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1124684059-network", "vif_mac": "fa:16:3e:7d:fe:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Converting VIF {"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1124684059-network", "vif_mac": "fa:16:3e:7d:fe:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=348d8e54-a814-4893-8636-de9e795794a2,network=Network(7d8127bc-30f6-40e2-9bd3-2054440440d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348d8e54-a8') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG os_vif [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=348d8e54-a814-4893-8636-de9e795794a2,network=Network(7d8127bc-30f6-40e2-9bd3-2054440440d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348d8e54-a8') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2e811f34-8db5-5fe0-9563-f5f73c51a248', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap348d8e54-a8, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap348d8e54-a8, col_values=(('qos', UUID('89b8eaa7-d3de-425a-bfd0-f0052e6b0175')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap348d8e54-a8, col_values=(('external_ids', {'iface-id': '348d8e54-a814-4893-8636-de9e795794a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:fe:f6', 'vm-uuid': '4531bf11-b948-4d57-bf55-f33563815e26'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:47 user nova-compute[75247]: INFO os_vif [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=348d8e54-a814-4893-8636-de9e795794a2,network=Network(7d8127bc-30f6-40e2-9bd3-2054440440d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348d8e54-a8')
Dec 06 12:44:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:44:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] No VIF found with MAC fa:16:3e:7d:fe:f6, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:44:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Acquiring lock "ed721541-3a94-496f-8b9d-88c74ac83ef7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "ed721541-3a94-496f-8b9d-88c74ac83ef7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Acquiring lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:48 user nova-compute[75247]: INFO nova.compute.manager [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Terminating instance
Dec 06 12:44:48 user nova-compute[75247]: DEBUG nova.compute.manager [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:44:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:48 user nova-compute[75247]: DEBUG nova.compute.manager [req-e2070fef-38c6-45fb-bec3-cfbfbe13ec4f req-458a7a4e-8f31-43c6-baf2-3b2de9ed7e26 service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Received event network-vif-unplugged-795878af-3950-4253-83f2-7656b6ce8fb0 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e2070fef-38c6-45fb-bec3-cfbfbe13ec4f req-458a7a4e-8f31-43c6-baf2-3b2de9ed7e26 service nova] Acquiring lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e2070fef-38c6-45fb-bec3-cfbfbe13ec4f req-458a7a4e-8f31-43c6-baf2-3b2de9ed7e26 service nova] Lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e2070fef-38c6-45fb-bec3-cfbfbe13ec4f req-458a7a4e-8f31-43c6-baf2-3b2de9ed7e26 service nova] Lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:48 user nova-compute[75247]: DEBUG nova.compute.manager [req-e2070fef-38c6-45fb-bec3-cfbfbe13ec4f req-458a7a4e-8f31-43c6-baf2-3b2de9ed7e26 service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] No waiting events found dispatching network-vif-unplugged-795878af-3950-4253-83f2-7656b6ce8fb0 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:44:48 user nova-compute[75247]: DEBUG nova.compute.manager [req-e2070fef-38c6-45fb-bec3-cfbfbe13ec4f req-458a7a4e-8f31-43c6-baf2-3b2de9ed7e26 service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Received event network-vif-unplugged-795878af-3950-4253-83f2-7656b6ce8fb0 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:44:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-afeceaac-992c-437c-9b14-d767deb71632 req-53bba64b-957d-483a-9c42-8fd043fa35b1 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received event network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-afeceaac-992c-437c-9b14-d767deb71632 req-53bba64b-957d-483a-9c42-8fd043fa35b1 service nova] Acquiring lock "4531bf11-b948-4d57-bf55-f33563815e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-afeceaac-992c-437c-9b14-d767deb71632 req-53bba64b-957d-483a-9c42-8fd043fa35b1 service nova] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-afeceaac-992c-437c-9b14-d767deb71632 req-53bba64b-957d-483a-9c42-8fd043fa35b1 service nova] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-afeceaac-992c-437c-9b14-d767deb71632 req-53bba64b-957d-483a-9c42-8fd043fa35b1 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] No waiting events found dispatching network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:44:49 user nova-compute[75247]: WARNING nova.compute.manager [req-afeceaac-992c-437c-9b14-d767deb71632 req-53bba64b-957d-483a-9c42-8fd043fa35b1 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received unexpected event network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 for instance with vm_state active and task_state resize_finish.
Dec 06 12:44:49 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Instance destroyed successfully.
Dec 06 12:44:49 user nova-compute[75247]: DEBUG nova.objects.instance [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lazy-loading 'resources' on Instance uuid ed721541-3a94-496f-8b9d-88c74ac83ef7 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T12:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1282622112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2112362070',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAvGjqKGelHMukSgIEWiaJYGvjKnXCgFhWE2e9opkG+MtYR0JDGRdm7aO7xPBVUPfutpJlFkjfqa+5bgZXZpZP3Yy5+bfGop2oLmWOnvB+kyfjNOJ8IAYFrs9oEZQCG4w==',key_name='tempest-keypair-863855062',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:43:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05d12120b32e41b891fd25ca49f9553a',ramdisk_id='',reservation_id='r-ouvdxg8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-888686040',owner_user_name='tempest-ServerActionsV293TestJSON-888686040-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:43:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12dc589ceb3429b8ae09c1413589709',uuid=ed721541-3a94-496f-8b9d-88c74ac83ef7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "795878af-3950-4253-83f2-7656b6ce8fb0", "address": "fa:16:3e:39:75:70", "network": {"id": "b8c04077-286f-434c-a3a6-cde7a124f301", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-378433228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d12120b32e41b891fd25ca49f9553a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795878af-39", "ovs_interfaceid": "795878af-3950-4253-83f2-7656b6ce8fb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Converting VIF {"id": "795878af-3950-4253-83f2-7656b6ce8fb0", "address": "fa:16:3e:39:75:70", "network": {"id": "b8c04077-286f-434c-a3a6-cde7a124f301", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-378433228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d12120b32e41b891fd25ca49f9553a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795878af-39", "ovs_interfaceid": "795878af-3950-4253-83f2-7656b6ce8fb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:75:70,bridge_name='br-int',has_traffic_filtering=True,id=795878af-3950-4253-83f2-7656b6ce8fb0,network=Network(b8c04077-286f-434c-a3a6-cde7a124f301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap795878af-39') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG os_vif [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:75:70,bridge_name='br-int',has_traffic_filtering=True,id=795878af-3950-4253-83f2-7656b6ce8fb0,network=Network(b8c04077-286f-434c-a3a6-cde7a124f301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap795878af-39') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap795878af-39, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=65f4736f-a746-4902-8f2e-ce1c359a9ad3) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:49 user nova-compute[75247]: INFO os_vif [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:75:70,bridge_name='br-int',has_traffic_filtering=True,id=795878af-3950-4253-83f2-7656b6ce8fb0,network=Network(b8c04077-286f-434c-a3a6-cde7a124f301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap795878af-39')
Dec 06 12:44:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'teobKPCy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:44:49 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:44:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[130a2f91-ee9d-4578-82d0-25b0d7a4b9d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:44:49 user nova-compute[75247]: No targets found.
Dec 06 12:44:49 user nova-compute[75247]: iSNS:
Dec 06 12:44:49 user nova-compute[75247]: No targets found.
Dec 06 12:44:49 user nova-compute[75247]: STATIC:
Dec 06 12:44:49 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496
Dec 06 12:44:49 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:44:49 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:44:49 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:44:49 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:44:49 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:44:49 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0
Dec 06 12:44:49 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:44:49 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:44:49 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db
Dec 06 12:44:49 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:44:49 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:44:49 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482
Dec 06 12:44:49 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:44:49 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:44:49 user nova-compute[75247]: FIRMWARE:
Dec 06 12:44:49 user nova-compute[75247]: No targets found.
Dec 06 12:44:49 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:44:49 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:44:49 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa3903b-c0b8-4c89-bca2-4ac884a0e6f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[da40e862-5f44-4e91-b78d-2d1aae32d8f0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:44:49 user nova-compute[75247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:44:49 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:44:49 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:44:49 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:44:49 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 (non-flash)
Dec 06 12:44:49 user nova-compute[75247]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:44:49 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:44:49 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:44:49 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:44:49 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c625870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0'): ({'sdc'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Removing single pathed devices sdc {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5ed44d-4dfa-4301-9ef1-c2341811c508]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[85abeaa8-e7b3-415a-8ef4-a6bb14b32347]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Flushing IO for device /dev/sdc {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e4f362-e716-4d56-a1f8-444110bc789b]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.064s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2e144b-73fb-4077-a4f7-45c8bda26e0d]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] SCSI volumes sdc have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[73251f3d-23b3-4287-8494-e6279a19680b]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1c88ca-5779-41e5-926e-4575939e617d]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0, portal: 172.16.0.220,3260]
Dec 06 12:44:49 user nova-compute[75247]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0, portal: 172.16.0.220,3260] successful.
Dec 06 12:44:49 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d30437-2abd-41f4-9626-a1ce202bacb0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9985a28-9bd0-4141-8b8a-5360054b7470]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] <== disconnect_volume: return (390ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:44:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:44:49 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Deleting instance files /opt/stack/data/nova/instances/ed721541-3a94-496f-8b9d-88c74ac83ef7_del
Dec 06 12:44:49 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Deletion of /opt/stack/data/nova/instances/ed721541-3a94-496f-8b9d-88c74ac83ef7_del complete
Dec 06 12:44:50 user nova-compute[75247]: INFO nova.compute.manager [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Took 2.03 seconds to destroy the instance on the hypervisor.
Dec 06 12:44:50 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:44:50 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:44:50 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:44:50 user nova-compute[75247]: DEBUG nova.compute.manager [req-9fda71bb-4bc7-4a3f-abee-36a563597f8e req-e7f5f03a-66df-4f8d-9eae-2789bc8657db service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Received event network-vif-plugged-795878af-3950-4253-83f2-7656b6ce8fb0 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-9fda71bb-4bc7-4a3f-abee-36a563597f8e req-e7f5f03a-66df-4f8d-9eae-2789bc8657db service nova] Acquiring lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-9fda71bb-4bc7-4a3f-abee-36a563597f8e req-e7f5f03a-66df-4f8d-9eae-2789bc8657db service nova] Lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-9fda71bb-4bc7-4a3f-abee-36a563597f8e req-e7f5f03a-66df-4f8d-9eae-2789bc8657db service nova] Lock "ed721541-3a94-496f-8b9d-88c74ac83ef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:50 user nova-compute[75247]: DEBUG nova.compute.manager [req-9fda71bb-4bc7-4a3f-abee-36a563597f8e req-e7f5f03a-66df-4f8d-9eae-2789bc8657db service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] No waiting events found dispatching network-vif-plugged-795878af-3950-4253-83f2-7656b6ce8fb0 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:44:50 user nova-compute[75247]: WARNING nova.compute.manager [req-9fda71bb-4bc7-4a3f-abee-36a563597f8e req-e7f5f03a-66df-4f8d-9eae-2789bc8657db service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Received unexpected event network-vif-plugged-795878af-3950-4253-83f2-7656b6ce8fb0 for instance with vm_state active and task_state deleting.
Dec 06 12:44:50 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:44:51 user nova-compute[75247]: DEBUG nova.compute.manager [req-bf5a0079-dae4-44d2-9cdf-c6e8fe9134ff req-9e4a9cd5-afe6-4e61-a617-53cc9b7bf87c service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Received event network-vif-deleted-795878af-3950-4253-83f2-7656b6ce8fb0 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:51 user nova-compute[75247]: INFO nova.compute.manager [req-bf5a0079-dae4-44d2-9cdf-c6e8fe9134ff req-9e4a9cd5-afe6-4e61-a617-53cc9b7bf87c service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Neutron deleted interface 795878af-3950-4253-83f2-7656b6ce8fb0; detaching it from the instance and deleting it from the info cache
Dec 06 12:44:51 user nova-compute[75247]: DEBUG nova.network.neutron [req-bf5a0079-dae4-44d2-9cdf-c6e8fe9134ff req-9e4a9cd5-afe6-4e61-a617-53cc9b7bf87c service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:44:51 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Took 0.73 seconds to deallocate network for instance.
Dec 06 12:44:51 user nova-compute[75247]: DEBUG nova.compute.manager [req-bf5a0079-dae4-44d2-9cdf-c6e8fe9134ff req-9e4a9cd5-afe6-4e61-a617-53cc9b7bf87c service nova] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Detach interface failed, port_id=795878af-3950-4253-83f2-7656b6ce8fb0, reason: Instance ed721541-3a94-496f-8b9d-88c74ac83ef7 could not be found. {{(pid=75247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 12:44:51 user nova-compute[75247]: DEBUG nova.compute.manager [req-c51865f9-58dd-485a-bcde-f3d769072b74 req-4cb6b350-aac2-4d37-b8c4-19b9fddd238a service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received event network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:44:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c51865f9-58dd-485a-bcde-f3d769072b74 req-4cb6b350-aac2-4d37-b8c4-19b9fddd238a service nova] Acquiring lock "4531bf11-b948-4d57-bf55-f33563815e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c51865f9-58dd-485a-bcde-f3d769072b74 req-4cb6b350-aac2-4d37-b8c4-19b9fddd238a service nova] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c51865f9-58dd-485a-bcde-f3d769072b74 req-4cb6b350-aac2-4d37-b8c4-19b9fddd238a service nova] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:51 user nova-compute[75247]: DEBUG nova.compute.manager [req-c51865f9-58dd-485a-bcde-f3d769072b74 req-4cb6b350-aac2-4d37-b8c4-19b9fddd238a service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] No waiting events found dispatching network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:44:51 user nova-compute[75247]: WARNING nova.compute.manager [req-c51865f9-58dd-485a-bcde-f3d769072b74 req-4cb6b350-aac2-4d37-b8c4-19b9fddd238a service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received unexpected event network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 for instance with vm_state active and task_state resize_finish.
Dec 06 12:44:51 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:44:51 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Instance running successfully.
Dec 06 12:44:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Failed to set time: agent not configured {{(pid=75247) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Dec 06 12:44:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f2a891b6-2747-4040-aed5-885b420528e6 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] finish_migration finished successfully. {{(pid=75247) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11772}}
Dec 06 12:44:51 user nova-compute[75247]: INFO nova.compute.manager [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Took 0.89 seconds to detach 1 volumes for instance.
Dec 06 12:44:51 user nova-compute[75247]: DEBUG nova.compute.manager [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] [instance: ed721541-3a94-496f-8b9d-88c74ac83ef7] Deleting volume: f5d30437-2abd-41f4-9626-a1ce202bacb0 {{(pid=75247) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 06 12:44:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:44:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:44:52 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:44:52 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:44:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.620s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:52 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Deleted allocations for instance ed721541-3a94-496f-8b9d-88c74ac83ef7
Dec 06 12:44:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-020e2cf7-bbf8-4224-850b-34664833086d tempest-ServerActionsV293TestJSON-888686040 tempest-ServerActionsV293TestJSON-888686040-project-member] Lock "ed721541-3a94-496f-8b9d-88c74ac83ef7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.722s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:44:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:44:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:45:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:45:02 user nova-compute[75247]: DEBUG nova.compute.manager [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:45:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:45:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:45:02 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:45:02 user nova-compute[75247]: INFO nova.compute.claims [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Claim successful on node user
Dec 06 12:45:03 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG nova.compute.manager [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG nova.compute.manager [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG nova.network.neutron [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:45:03 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:45:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG nova.compute.manager [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:45:03 user nova-compute[75247]: INFO nova.virt.block_device [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Booting with volume 38f56b17-8536-40fa-aa9c-33f8aae05d8b at /dev/vda
Dec 06 12:45:03 user nova-compute[75247]: DEBUG nova.policy [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9e5d32fc34046bcbf517062fe52f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95bb1359241ee8d2cf5015640a2b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG os_brick.utils [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfaa18d-f6d3-46e0-90a6-498daf8d8026]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8ed4d5-3646-42ff-9aa3-6f8c3fc2aaef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2cdf6c-6217-4e1c-b369-9f3624afc2dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba604176-7a96-4fbb-a248-bc9e16ca9d41]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:45:03 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:45:03 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f29305-08e8-43c7-bd39-0c6d107280e7]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG os_brick.utils [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:45:03 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Updating existing volume attachment record: cc22283f-932c-4973-98a4-443afe54ee36 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:45:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:04 user nova-compute[75247]: DEBUG nova.network.neutron [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Successfully created port: a079e33d-4b03-49ef-8315-f33edfb30f8f {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:45:05 user nova-compute[75247]: INFO nova.compute.manager [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Rescuing
Dec 06 12:45:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "refresh_cache-3e1b5197-dc38-48a5-b9f9-e053be499433" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:45:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquired lock "refresh_cache-3e1b5197-dc38-48a5-b9f9-e053be499433" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:45:05 user nova-compute[75247]: DEBUG nova.network.neutron [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:45:05 user nova-compute[75247]: DEBUG nova.network.neutron [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Successfully created port: 7b8c474e-894c-43c2-9a4a-0836089a16a1 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:45:06 user nova-compute[75247]: DEBUG nova.network.neutron [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Updating instance_info_cache with network_info: [{"id": "f373c320-8b0c-440d-b825-d7ec2555b89d", "address": "fa:16:3e:3f:8d:92", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf373c320-8b", "ovs_interfaceid": "f373c320-8b0c-440d-b825-d7ec2555b89d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:45:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Releasing lock "refresh_cache-3e1b5197-dc38-48a5-b9f9-e053be499433" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:45:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:06 user nova-compute[75247]: DEBUG nova.network.neutron [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Successfully created port: 267ee847-5894-4c58-8554-e30b91938a6d {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:45:06 user nova-compute[75247]: DEBUG nova.compute.manager [req-b4a532a8-28f9-45f5-bc07-bfae7af8d4c3 req-2fc85a1d-eb50-4476-ba16-f4b322f399d7 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Received event network-vif-unplugged-f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:45:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b4a532a8-28f9-45f5-bc07-bfae7af8d4c3 req-2fc85a1d-eb50-4476-ba16-f4b322f399d7 service nova] Acquiring lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:45:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b4a532a8-28f9-45f5-bc07-bfae7af8d4c3 req-2fc85a1d-eb50-4476-ba16-f4b322f399d7 service nova] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:45:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b4a532a8-28f9-45f5-bc07-bfae7af8d4c3 req-2fc85a1d-eb50-4476-ba16-f4b322f399d7 service nova] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:45:06 user nova-compute[75247]: DEBUG nova.compute.manager [req-b4a532a8-28f9-45f5-bc07-bfae7af8d4c3 req-2fc85a1d-eb50-4476-ba16-f4b322f399d7 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] No waiting events found dispatching network-vif-unplugged-f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:45:06 user nova-compute[75247]: WARNING nova.compute.manager [req-b4a532a8-28f9-45f5-bc07-bfae7af8d4c3 req-2fc85a1d-eb50-4476-ba16-f4b322f399d7 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Received unexpected event network-vif-unplugged-f373c320-8b0c-440d-b825-d7ec2555b89d for instance with vm_state active and task_state rescuing.
Dec 06 12:45:07 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Instance destroyed successfully.
Dec 06 12:45:07 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Attempting a stable device rescue
Dec 06 12:45:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75247) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 06 12:45:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Instance directory exists: not creating {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 06 12:45:07 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Creating image(s)
Dec 06 12:45:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e1b5197-dc38-48a5-b9f9-e053be499433/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:45:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "/opt/stack/data/nova/instances/3e1b5197-dc38-48a5-b9f9-e053be499433/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:45:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "/opt/stack/data/nova/instances/3e1b5197-dc38-48a5-b9f9-e053be499433/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:45:07 user nova-compute[75247]: DEBUG nova.objects.instance [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3e1b5197-dc38-48a5-b9f9-e053be499433 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:45:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "e3f3f9a696008e1d0eaa103372004faea3dc15ac" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:45:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "e3f3f9a696008e1d0eaa103372004faea3dc15ac" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:45:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3f3f9a696008e1d0eaa103372004faea3dc15ac.part --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:08 user nova-compute[75247]: DEBUG nova.network.neutron [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Successfully created port: 097e6f29-41d9-4842-a697-ad3d1a1b0d7c {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:45:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3f3f9a696008e1d0eaa103372004faea3dc15ac.part --force-share --output=json" returned: 0 in 0.234s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:08 user nova-compute[75247]: DEBUG nova.virt.images [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] fa932a37-0bd9-43bf-a0ca-827811809373 was qcow2, converting to raw {{(pid=75247) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 12:45:08 user nova-compute[75247]: DEBUG nova.privsep.utils [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 12:45:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e3f3f9a696008e1d0eaa103372004faea3dc15ac.part /opt/stack/data/nova/instances/_base/e3f3f9a696008e1d0eaa103372004faea3dc15ac.converted {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:08 user nova-compute[75247]: DEBUG nova.compute.manager [req-37d347d8-a37b-4e95-927a-197e77c4bba4 req-a0a3d45f-9529-464f-b940-8bcbfeab111d service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Received event network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:45:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-37d347d8-a37b-4e95-927a-197e77c4bba4 req-a0a3d45f-9529-464f-b940-8bcbfeab111d service nova] Acquiring lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:45:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-37d347d8-a37b-4e95-927a-197e77c4bba4 req-a0a3d45f-9529-464f-b940-8bcbfeab111d service nova] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:45:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-37d347d8-a37b-4e95-927a-197e77c4bba4 req-a0a3d45f-9529-464f-b940-8bcbfeab111d service nova] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:45:08 user nova-compute[75247]: DEBUG nova.compute.manager [req-37d347d8-a37b-4e95-927a-197e77c4bba4 req-a0a3d45f-9529-464f-b940-8bcbfeab111d service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] No waiting events found dispatching network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:45:08 user nova-compute[75247]: WARNING nova.compute.manager [req-37d347d8-a37b-4e95-927a-197e77c4bba4 req-a0a3d45f-9529-464f-b940-8bcbfeab111d service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Received unexpected event network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d for instance with vm_state active and task_state rescuing.
Dec 06 12:45:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e3f3f9a696008e1d0eaa103372004faea3dc15ac.part /opt/stack/data/nova/instances/_base/e3f3f9a696008e1d0eaa103372004faea3dc15ac.converted" returned: 0 in 0.289s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3f3f9a696008e1d0eaa103372004faea3dc15ac.converted --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3f3f9a696008e1d0eaa103372004faea3dc15ac.converted --force-share --output=json" returned: 0 in 0.225s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "e3f3f9a696008e1d0eaa103372004faea3dc15ac" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.170s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "e3f3f9a696008e1d0eaa103372004faea3dc15ac" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "e3f3f9a696008e1d0eaa103372004faea3dc15ac" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3f3f9a696008e1d0eaa103372004faea3dc15ac --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3f3f9a696008e1d0eaa103372004faea3dc15ac --force-share --output=json" returned: 0 in 0.232s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3f3f9a696008e1d0eaa103372004faea3dc15ac,backing_fmt=raw /opt/stack/data/nova/instances/3e1b5197-dc38-48a5-b9f9-e053be499433/disk.rescue {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3f3f9a696008e1d0eaa103372004faea3dc15ac,backing_fmt=raw /opt/stack/data/nova/instances/3e1b5197-dc38-48a5-b9f9-e053be499433/disk.rescue" returned: 0 in 0.062s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "e3f3f9a696008e1d0eaa103372004faea3dc15ac" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.objects.instance [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lazy-loading 'migration_context' on Instance uuid 3e1b5197-dc38-48a5-b9f9-e053be499433 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.objects.base [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Object Instance<3e1b5197-dc38-48a5-b9f9-e053be499433> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Start _get_guest_xml network_info=[{"id": "f373c320-8b0c-440d-b825-d7ec2555b89d", "address": "fa:16:3e:3f:8d:92", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "vif_mac": "fa:16:3e:3f:8d:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf373c320-8b", "ovs_interfaceid": "f373c320-8b0c-440d-b825-d7ec2555b89d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fa932a37-0bd9-43bf-a0ca-827811809373', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '5423f4e3-d08c-4756-9443-242bbc6b80e8', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQyuETeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '3e1b5197-dc38-48a5-b9f9-e053be499433', 'attached_at': '', 'detached_at': '', 'volume_id': '15434b10-a21d-4ff5-a7d1-d097cc403518', 'serial': '15434b10-a21d-4ff5-a7d1-d097cc403518'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.objects.instance [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lazy-loading 'resources' on Instance uuid 3e1b5197-dc38-48a5-b9f9-e053be499433 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.objects.base [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Object Instance<3e1b5197-dc38-48a5-b9f9-e053be499433> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.objects.instance [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lazy-loading 'numa_topology' on Instance uuid 3e1b5197-dc38-48a5-b9f9-e053be499433 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.objects.base [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Object Instance<3e1b5197-dc38-48a5-b9f9-e053be499433> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:45:09 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:45:09 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.objects.instance [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3e1b5197-dc38-48a5-b9f9-e053be499433 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.objects.base [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Object Instance<3e1b5197-dc38-48a5-b9f9-e053be499433> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQyuETeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:45:09 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:45:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:45:09 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:45:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:45:09 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:45:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG nova.network.neutron [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Successfully created port: c587e85c-ccd5-4bb9-803c-b08aed3baaeb {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e8c9bb-649e-42eb-b67e-48c2dd09e2a0]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = fQyuETeK\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 06 12:45:09 user nova-compute[75247]: node.name = iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:45:09 user nova-compute[75247]: node.tpgt = -1
Dec 06 12:45:09 user nova-compute[75247]: node.startup = automatic
Dec 06 12:45:09 user nova-compute[75247]: node.leading_login = No
Dec 06 12:45:09 user nova-compute[75247]: iface.iscsi_ifacename = default
Dec 06 12:45:09 user nova-compute[75247]: iface.net_ifacename = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.ipaddress = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.prefix_len = 0
Dec 06 12:45:09 user nova-compute[75247]: iface.hwaddress = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.transport_name = tcp
Dec 06 12:45:09 user nova-compute[75247]: iface.initiatorname = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.state = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.vlan_id = 0
Dec 06 12:45:09 user nova-compute[75247]: iface.vlan_priority = 0
Dec 06 12:45:09 user nova-compute[75247]: iface.vlan_state = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.iface_num = 0
Dec 06 12:45:09 user nova-compute[75247]: iface.mtu = 0
Dec 06 12:45:09 user nova-compute[75247]: iface.port = 0
Dec 06 12:45:09 user nova-compute[75247]: iface.bootproto = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.subnet_mask = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.gateway = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.dhcp_alt_client_id_state = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.dhcp_alt_client_id = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.dhcp_dns = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.dhcp_learn_iqn = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.dhcp_req_vendor_id_state = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.dhcp_vendor_id_state = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.dhcp_vendor_id = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.dhcp_slp_da = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.fragmentation = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.gratuitous_arp = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.incoming_forwarding = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.tos_state = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.tos = 0
Dec 06 12:45:09 user nova-compute[75247]: iface.ttl = 0
Dec 06 12:45:09 user nova-compute[75247]: iface.delayed_ack = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.tcp_nagle = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.tcp_wsf_state = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.tcp_wsf = 0
Dec 06 12:45:09 user nova-compute[75247]: iface.tcp_timer_scale = 0
Dec 06 12:45:09 user nova-compute[75247]: iface.tcp_timestamp = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.redirect = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.def_task_mgmt_timeout = 0
Dec 06 12:45:09 user nova-compute[75247]: iface.header_digest = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.data_digest = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.immediate_data = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.initial_r2t = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.data_seq_inorder = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.data_pdu_inorder = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.erl = 0
Dec 06 12:45:09 user nova-compute[75247]: iface.max_receive_data_len = 0
Dec 06 12:45:09 user nova-compute[75247]: iface.first_burst_len = 0
Dec 06 12:45:09 user nova-compute[75247]: iface.max_outstanding_r2t = 0
Dec 06 12:45:09 user nova-compute[75247]: iface.max_burst_len = 0
Dec 06 12:45:09 user nova-compute[75247]: iface.chap_auth = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.bidi_chap = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.strict_login_compliance = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.discovery_auth = <empty>
Dec 06 12:45:09 user nova-compute[75247]: iface.discovery_logout = <empty>
Dec 06 12:45:09 user nova-compute[75247]: node.discovery_address = <empty>
Dec 06 12:45:09 user nova-compute[75247]: node.discovery_port = 0
Dec 06 12:45:09 user nova-compute[75247]: node.discovery_type = static
Dec 06 12:45:09 user nova-compute[75247]: node.session.initial_cmdsn = 0
Dec 06 12:45:09 user nova-compute[75247]: node.session.initial_login_retry_max = 8
Dec 06 12:45:09 user nova-compute[75247]: node.session.xmit_thread_priority = -20
Dec 06 12:45:09 user nova-compute[75247]: node.session.cmds_max = 128
Dec 06 12:45:09 user nova-compute[75247]: node.session.queue_depth = 32
Dec 06 12:45:09 user nova-compute[75247]: node.session.nr_sessions = 1
Dec 06 12:45:09 user nova-compute[75247]: node.session.auth.authmethod = CHAP
Dec 06 12:45:09 user nova-compute[75247]: node.session.auth.username = fQyuETeK
Dec 06 12:45:09 user nova-compute[75247]: node.session.auth.password = ***
Dec 06 12:45:09 user nova-compute[75247]: node.session.auth.username_in = <empty>
Dec 06 12:45:09 user nova-compute[75247]: node.session.auth.password_in = <empty>
Dec 06 12:45:09 user nova-compute[75247]: node.session.auth.chap_algs = MD5
Dec 06 12:45:09 user nova-compute[75247]: node.session.timeo.replacement_timeout = 120
Dec 06 12:45:09 user nova-compute[75247]: node.session.err_timeo.abort_timeout = 15
Dec 06 12:45:09 user nova-compute[75247]: node.session.err_timeo.lu_reset_timeout = 30
Dec 06 12:45:09 user nova-compute[75247]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 06 12:45:09 user nova-compute[75247]: node.session.err_timeo.host_reset_timeout = 60
Dec 06 12:45:09 user nova-compute[75247]: node.session.iscsi.FastAbort = Yes
Dec 06 12:45:09 user nova-compute[75247]: node.session.iscsi.InitialR2T = No
Dec 06 12:45:09 user nova-compute[75247]: node.session.iscsi.ImmediateData = Yes
Dec 06 12:45:09 user nova-compute[75247]: node.session.iscsi.FirstBurstLength = 262144
Dec 06 12:45:09 user nova-compute[75247]: node.session.iscsi.MaxBurstLength = 16776192
Dec 06 12:45:09 user nova-compute[75247]: node.session.iscsi.DefaultTime2Retain = 0
Dec 06 12:45:09 user nova-compute[75247]: node.session.iscsi.DefaultTime2Wait = 2
Dec 06 12:45:09 user nova-compute[75247]: node.session.iscsi.MaxConnections = 1
Dec 06 12:45:09 user nova-compute[75247]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 06 12:45:09 user nova-compute[75247]: node.session.iscsi.ERL = 0
Dec 06 12:45:09 user nova-compute[75247]: node.session.scan = manual
Dec 06 12:45:09 user nova-compute[75247]: node.session.reopen_max = 0
Dec 06 12:45:09 user nova-compute[75247]: node.conn[0].address = 172.16.0.220
Dec 06 12:45:09 user nova-compute[75247]: node.conn[0].port = 3260
Dec 06 12:45:09 user nova-compute[75247]: node.conn[0].startup = manual
Dec 06 12:45:09 user nova-compute[75247]: node.conn[0].tcp.window_size = 524288
Dec 06 12:45:09 user nova-compute[75247]: node.conn[0].tcp.type_of_service = 0
Dec 06 12:45:09 user nova-compute[75247]: node.conn[0].timeo.logout_timeout = 15
Dec 06 12:45:09 user nova-compute[75247]: node.conn[0].timeo.login_timeout = 15
Dec 06 12:45:09 user nova-compute[75247]: node.conn[0].timeo.auth_timeout = 45
Dec 06 12:45:09 user nova-compute[75247]: node.conn[0].timeo.noop_out_interval = 5
Dec 06 12:45:09 user nova-compute[75247]: node.conn[0].timeo.noop_out_timeout = 5
Dec 06 12:45:09 user nova-compute[75247]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 06 12:45:09 user nova-compute[75247]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 06 12:45:09 user nova-compute[75247]: node.conn[0].iscsi.HeaderDigest = None
Dec 06 12:45:09 user nova-compute[75247]: node.conn[0].iscsi.DataDigest = None
Dec 06 12:45:09 user nova-compute[75247]: node.conn[0].iscsi.IFMarker = No
Dec 06 12:45:09 user nova-compute[75247]: node.conn[0].iscsi.OFMarker = No
Dec 06 12:45:09 user nova-compute[75247]: # END RECORD
Dec 06 12:45:09 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c19f03-2270-41ae-87ef-1d1851c428f4]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[708080c9-7973-4c3f-afaf-9f61b8b5cde3]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:45:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fQyuETeK {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fQyuETeK" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9233c4-3374-46a9-8512-435dc9dca8d6]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fQyuETeK'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[089cef0f-0586-4ce2-a2ed-65e7db24b9b6]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf841c11-c1ef-413a-8edc-eb98acc5f2e6]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:45:10 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:45:10 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:45:10 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:45:10 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:45:10 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:45:10 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:45:10 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:45:10 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.189s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] HCTL ('35', '0', '0', 0) found on session 17 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a394d39-5bfc-465c-b6b8-3811afd774c0]: (4, ('0 0 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Searching for a device in session 17 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQyuETeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.218s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] <== connect_volume: return (220ms) {'type': 'block', 'scsi_wwn': '23538373764336132', 'path': '/dev/sdd'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538373764336132', 'path': '/dev/sdd'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:43:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-36313688',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-36313688',id=14,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:43:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='222da79e3583495d90d5442029996343',ramdisk_id='',reservation_id='r-0exfvqwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:43:40Z,user_data=None,user_id='d0efa55fc4754d96a33d07d52342d8f7',uuid=3e1b5197-dc38-48a5-b9f9-e053be499433,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f373c320-8b0c-440d-b825-d7ec2555b89d", "address": "fa:16:3e:3f:8d:92", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "vif_mac": "fa:16:3e:3f:8d:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf373c320-8b", "ovs_interfaceid": "f373c320-8b0c-440d-b825-d7ec2555b89d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converting VIF {"id": "f373c320-8b0c-440d-b825-d7ec2555b89d", "address": "fa:16:3e:3f:8d:92", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "vif_mac": "fa:16:3e:3f:8d:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf373c320-8b", "ovs_interfaceid": "f373c320-8b0c-440d-b825-d7ec2555b89d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:8d:92,bridge_name='br-int',has_traffic_filtering=True,id=f373c320-8b0c-440d-b825-d7ec2555b89d,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf373c320-8b') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG nova.objects.instance [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e1b5197-dc38-48a5-b9f9-e053be499433 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG nova.objects.base [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Object Instance<3e1b5197-dc38-48a5-b9f9-e053be499433> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:45:10 user nova-compute[75247]:   <uuid>3e1b5197-dc38-48a5-b9f9-e053be499433</uuid>
Dec 06 12:45:10 user nova-compute[75247]:   <name>instance-0000000e</name>
Dec 06 12:45:10 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:45:10 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:45:10 user nova-compute[75247]:   <metadata>
Dec 06 12:45:10 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:45:10 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:45:10 user nova-compute[75247]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-36313688</nova:name>
Dec 06 12:45:10 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:45:09</nova:creationTime>
Dec 06 12:45:10 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:45:10 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:45:10 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:45:10 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:45:10 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:45:10 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:45:10 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:45:10 user nova-compute[75247]:       <nova:owner>
Dec 06 12:45:10 user nova-compute[75247]:         <nova:user uuid="d0efa55fc4754d96a33d07d52342d8f7">tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member</nova:user>
Dec 06 12:45:10 user nova-compute[75247]:         <nova:project uuid="222da79e3583495d90d5442029996343">tempest-ServerBootFromVolumeStableRescueTest-1200643969</nova:project>
Dec 06 12:45:10 user nova-compute[75247]:       </nova:owner>
Dec 06 12:45:10 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:45:10 user nova-compute[75247]:       <nova:ports>
Dec 06 12:45:10 user nova-compute[75247]:         <nova:port uuid="f373c320-8b0c-440d-b825-d7ec2555b89d">
Dec 06 12:45:10 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 06 12:45:10 user nova-compute[75247]:         </nova:port>
Dec 06 12:45:10 user nova-compute[75247]:       </nova:ports>
Dec 06 12:45:10 user nova-compute[75247]:     </nova:instance>
Dec 06 12:45:10 user nova-compute[75247]:   </metadata>
Dec 06 12:45:10 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:45:10 user nova-compute[75247]:     <system>
Dec 06 12:45:10 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:45:10 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:45:10 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:45:10 user nova-compute[75247]:       <entry name="serial">3e1b5197-dc38-48a5-b9f9-e053be499433</entry>
Dec 06 12:45:10 user nova-compute[75247]:       <entry name="uuid">3e1b5197-dc38-48a5-b9f9-e053be499433</entry>
Dec 06 12:45:10 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:45:10 user nova-compute[75247]:     </system>
Dec 06 12:45:10 user nova-compute[75247]:   </sysinfo>
Dec 06 12:45:10 user nova-compute[75247]:   <os>
Dec 06 12:45:10 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:45:10 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:45:10 user nova-compute[75247]:   </os>
Dec 06 12:45:10 user nova-compute[75247]:   <features>
Dec 06 12:45:10 user nova-compute[75247]:     <acpi/>
Dec 06 12:45:10 user nova-compute[75247]:     <apic/>
Dec 06 12:45:10 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:45:10 user nova-compute[75247]:   </features>
Dec 06 12:45:10 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:45:10 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:45:10 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:45:10 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:45:10 user nova-compute[75247]:   </clock>
Dec 06 12:45:10 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:45:10 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:45:10 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:45:10 user nova-compute[75247]:   </cpu>
Dec 06 12:45:10 user nova-compute[75247]:   <devices>
Dec 06 12:45:10 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 12:45:10 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:45:10 user nova-compute[75247]:       <source dev="/dev/sdd"/>
Dec 06 12:45:10 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:45:10 user nova-compute[75247]:       <serial>15434b10-a21d-4ff5-a7d1-d097cc403518</serial>
Dec 06 12:45:10 user nova-compute[75247]:     </disk>
Dec 06 12:45:10 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:45:10 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:45:10 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/3e1b5197-dc38-48a5-b9f9-e053be499433/disk.rescue"/>
Dec 06 12:45:10 user nova-compute[75247]:       <target dev="vdb" bus="virtio"/>
Dec 06 12:45:10 user nova-compute[75247]:       <boot order="1"/>
Dec 06 12:45:10 user nova-compute[75247]:     </disk>
Dec 06 12:45:10 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:45:10 user nova-compute[75247]:       <mac address="fa:16:3e:3f:8d:92"/>
Dec 06 12:45:10 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:45:10 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:45:10 user nova-compute[75247]:       <target dev="tapf373c320-8b"/>
Dec 06 12:45:10 user nova-compute[75247]:     </interface>
Dec 06 12:45:10 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:45:10 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/3e1b5197-dc38-48a5-b9f9-e053be499433/console.log" append="off"/>
Dec 06 12:45:10 user nova-compute[75247]:     </serial>
Dec 06 12:45:10 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:45:10 user nova-compute[75247]:     <video>
Dec 06 12:45:10 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:45:10 user nova-compute[75247]:     </video>
Dec 06 12:45:10 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:45:10 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:45:10 user nova-compute[75247]:     </rng>
Dec 06 12:45:10 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:45:10 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:45:10 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:45:10 user nova-compute[75247]:     </memballoon>
Dec 06 12:45:10 user nova-compute[75247]:   </devices>
Dec 06 12:45:10 user nova-compute[75247]: </domain>
Dec 06 12:45:10 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:45:10 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Instance destroyed successfully.
Dec 06 12:45:10 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] No VIF found with MAC fa:16:3e:3f:8d:92, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG nova.network.neutron [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Successfully updated port: a079e33d-4b03-49ef-8315-f33edfb30f8f {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:45:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:11 user nova-compute[75247]: DEBUG nova.compute.manager [req-dcbae665-b489-41ad-99f6-477610c6eb56 req-18630cc7-7c7b-4085-ac87-0b7b95f64ccb service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-changed-a079e33d-4b03-49ef-8315-f33edfb30f8f {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:45:11 user nova-compute[75247]: DEBUG nova.compute.manager [req-dcbae665-b489-41ad-99f6-477610c6eb56 req-18630cc7-7c7b-4085-ac87-0b7b95f64ccb service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Refreshing instance network info cache due to event network-changed-a079e33d-4b03-49ef-8315-f33edfb30f8f. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:45:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-dcbae665-b489-41ad-99f6-477610c6eb56 req-18630cc7-7c7b-4085-ac87-0b7b95f64ccb service nova] Acquiring lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:45:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-dcbae665-b489-41ad-99f6-477610c6eb56 req-18630cc7-7c7b-4085-ac87-0b7b95f64ccb service nova] Acquired lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:45:11 user nova-compute[75247]: DEBUG nova.network.neutron [req-dcbae665-b489-41ad-99f6-477610c6eb56 req-18630cc7-7c7b-4085-ac87-0b7b95f64ccb service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Refreshing network info cache for port a079e33d-4b03-49ef-8315-f33edfb30f8f {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:45:11 user nova-compute[75247]: DEBUG nova.network.neutron [req-dcbae665-b489-41ad-99f6-477610c6eb56 req-18630cc7-7c7b-4085-ac87-0b7b95f64ccb service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:45:11 user nova-compute[75247]: DEBUG nova.network.neutron [req-dcbae665-b489-41ad-99f6-477610c6eb56 req-18630cc7-7c7b-4085-ac87-0b7b95f64ccb service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:45:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-dcbae665-b489-41ad-99f6-477610c6eb56 req-18630cc7-7c7b-4085-ac87-0b7b95f64ccb service nova] Releasing lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:45:11 user nova-compute[75247]: DEBUG nova.network.neutron [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Successfully updated port: 2d117aa5-7c18-4adb-be72-d785e4905735 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:45:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:12 user nova-compute[75247]: DEBUG nova.network.neutron [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Successfully updated port: 681745af-b6fd-4f84-bc98-43bc601c3759 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:45:12 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:45:12 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:45:12 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 12:45:12 user nova-compute[75247]: DEBUG nova.compute.manager [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-changed-2d117aa5-7c18-4adb-be72-d785e4905735 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:45:12 user nova-compute[75247]: DEBUG nova.compute.manager [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Refreshing instance network info cache due to event network-changed-2d117aa5-7c18-4adb-be72-d785e4905735. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:45:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] Acquiring lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:45:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] Acquired lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:45:13 user nova-compute[75247]: DEBUG nova.network.neutron [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Refreshing network info cache for port 2d117aa5-7c18-4adb-be72-d785e4905735 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:45:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-4531bf11-b948-4d57-bf55-f33563815e26" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:45:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-4531bf11-b948-4d57-bf55-f33563815e26" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:45:13 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 12:45:13 user nova-compute[75247]: DEBUG nova.network.neutron [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:45:13 user nova-compute[75247]: DEBUG nova.network.neutron [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:45:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] Releasing lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:45:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Received event network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:45:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] Acquiring lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:45:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:45:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:45:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] No waiting events found dispatching network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:45:13 user nova-compute[75247]: WARNING nova.compute.manager [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Received unexpected event network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d for instance with vm_state active and task_state rescuing.
Dec 06 12:45:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Received event network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:45:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] Acquiring lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:45:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:45:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:45:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] No waiting events found dispatching network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:45:13 user nova-compute[75247]: WARNING nova.compute.manager [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Received unexpected event network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d for instance with vm_state active and task_state rescuing.
Dec 06 12:45:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-changed-681745af-b6fd-4f84-bc98-43bc601c3759 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:45:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Refreshing instance network info cache due to event network-changed-681745af-b6fd-4f84-bc98-43bc601c3759. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:45:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] Acquiring lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:45:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] Acquired lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:45:13 user nova-compute[75247]: DEBUG nova.network.neutron [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Refreshing network info cache for port 681745af-b6fd-4f84-bc98-43bc601c3759 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:45:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:13 user nova-compute[75247]: DEBUG nova.network.neutron [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:45:14 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Updating instance_info_cache with network_info: [{"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:45:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-4531bf11-b948-4d57-bf55-f33563815e26" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:45:14 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 12:45:14 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:45:14 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:45:14 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:45:14 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:45:14 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:45:14 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:45:14 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 12:45:14 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:45:14 user nova-compute[75247]: DEBUG nova.network.neutron [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:45:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:45:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:45:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:45:14 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 12:45:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-82f6e99e-ad0a-45fd-a45b-3fdab4787f95 req-d63ebb26-7436-4f62-96fa-f2395a06f5a6 service nova] Releasing lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:45:14 user nova-compute[75247]: DEBUG nova.network.neutron [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Successfully updated port: 7b8c474e-894c-43c2-9a4a-0836089a16a1 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:45:14 user nova-compute[75247]: DEBUG nova.compute.manager [None req-3048955a-bddf-4e58-b747-e722b56d26d5 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:45:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:15 user nova-compute[75247]: DEBUG nova.compute.manager [req-891644f9-d187-4d05-bfc4-1bb172795144 req-c239cd28-50c5-47c9-a2e6-14f714787fd7 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-changed-7b8c474e-894c-43c2-9a4a-0836089a16a1 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:45:15 user nova-compute[75247]: DEBUG nova.compute.manager [req-891644f9-d187-4d05-bfc4-1bb172795144 req-c239cd28-50c5-47c9-a2e6-14f714787fd7 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Refreshing instance network info cache due to event network-changed-7b8c474e-894c-43c2-9a4a-0836089a16a1. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:45:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-891644f9-d187-4d05-bfc4-1bb172795144 req-c239cd28-50c5-47c9-a2e6-14f714787fd7 service nova] Acquiring lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:45:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-891644f9-d187-4d05-bfc4-1bb172795144 req-c239cd28-50c5-47c9-a2e6-14f714787fd7 service nova] Acquired lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:45:15 user nova-compute[75247]: DEBUG nova.network.neutron [req-891644f9-d187-4d05-bfc4-1bb172795144 req-c239cd28-50c5-47c9-a2e6-14f714787fd7 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Refreshing network info cache for port 7b8c474e-894c-43c2-9a4a-0836089a16a1 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:45:15 user nova-compute[75247]: DEBUG nova.network.neutron [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Successfully updated port: 267ee847-5894-4c58-8554-e30b91938a6d {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:45:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:45:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:15 user nova-compute[75247]: DEBUG nova.network.neutron [req-891644f9-d187-4d05-bfc4-1bb172795144 req-c239cd28-50c5-47c9-a2e6-14f714787fd7 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:45:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:45:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:16 user nova-compute[75247]: DEBUG nova.network.neutron [req-891644f9-d187-4d05-bfc4-1bb172795144 req-c239cd28-50c5-47c9-a2e6-14f714787fd7 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:45:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-891644f9-d187-4d05-bfc4-1bb172795144 req-c239cd28-50c5-47c9-a2e6-14f714787fd7 service nova] Releasing lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:45:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:45:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:45:16 user nova-compute[75247]: INFO nova.compute.manager [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Detaching volume f8aa1a77-9f7a-4984-bf5e-2a6d45b35496
Dec 06 12:45:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:16 user nova-compute[75247]: DEBUG nova.network.neutron [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Successfully updated port: 097e6f29-41d9-4842-a697-ad3d1a1b0d7c {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:45:16 user nova-compute[75247]: INFO nova.virt.block_device [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Attempting to driver detach volume f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 from mountpoint /dev/vdb
Dec 06 12:45:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Attempting to detach device vdb from instance ec9eea5d-dc9a-4a65-881a-a89538e3a593 from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 12:45:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:45:16 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:45:16 user nova-compute[75247]:   <source dev="/dev/sdf"/>
Dec 06 12:45:16 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:45:16 user nova-compute[75247]:   <serial>f8aa1a77-9f7a-4984-bf5e-2a6d45b35496</serial>
Dec 06 12:45:16 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:45:16 user nova-compute[75247]: </disk>
Dec 06 12:45:16 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:45:16 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Successfully detached device vdb from instance ec9eea5d-dc9a-4a65-881a-a89538e3a593 from the persistent domain config.
Dec 06 12:45:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ec9eea5d-dc9a-4a65-881a-a89538e3a593 from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 12:45:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:45:16 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:45:16 user nova-compute[75247]:   <source dev="/dev/sdf"/>
Dec 06 12:45:16 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:45:16 user nova-compute[75247]:   <serial>f8aa1a77-9f7a-4984-bf5e-2a6d45b35496</serial>
Dec 06 12:45:16 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:45:16 user nova-compute[75247]: </disk>
Dec 06 12:45:16 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:45:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:45:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:17 user nova-compute[75247]: DEBUG nova.compute.manager [req-e172b27b-04ff-44cb-b474-b744217b70a8 req-8642e7ff-e5c7-43aa-b5fa-dcfb0b36a15a service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-changed-267ee847-5894-4c58-8554-e30b91938a6d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:45:17 user nova-compute[75247]: DEBUG nova.compute.manager [req-e172b27b-04ff-44cb-b474-b744217b70a8 req-8642e7ff-e5c7-43aa-b5fa-dcfb0b36a15a service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Refreshing instance network info cache due to event network-changed-267ee847-5894-4c58-8554-e30b91938a6d. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:45:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e172b27b-04ff-44cb-b474-b744217b70a8 req-8642e7ff-e5c7-43aa-b5fa-dcfb0b36a15a service nova] Acquiring lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:45:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e172b27b-04ff-44cb-b474-b744217b70a8 req-8642e7ff-e5c7-43aa-b5fa-dcfb0b36a15a service nova] Acquired lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:45:17 user nova-compute[75247]: DEBUG nova.network.neutron [req-e172b27b-04ff-44cb-b474-b744217b70a8 req-8642e7ff-e5c7-43aa-b5fa-dcfb0b36a15a service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Refreshing network info cache for port 267ee847-5894-4c58-8554-e30b91938a6d {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:45:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:17 user nova-compute[75247]: DEBUG nova.network.neutron [req-e172b27b-04ff-44cb-b474-b744217b70a8 req-8642e7ff-e5c7-43aa-b5fa-dcfb0b36a15a service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:45:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ec9eea5d-dc9a-4a65-881a-a89538e3a593 {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 12:45:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk --force-share --output=json" returned: 0 in 0.322s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:45:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e1b5197-dc38-48a5-b9f9-e053be499433/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:17 user nova-compute[75247]: DEBUG nova.network.neutron [req-e172b27b-04ff-44cb-b474-b744217b70a8 req-8642e7ff-e5c7-43aa-b5fa-dcfb0b36a15a service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:45:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e172b27b-04ff-44cb-b474-b744217b70a8 req-8642e7ff-e5c7-43aa-b5fa-dcfb0b36a15a service nova] Releasing lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:45:17 user nova-compute[75247]: DEBUG nova.compute.manager [req-e172b27b-04ff-44cb-b474-b744217b70a8 req-8642e7ff-e5c7-43aa-b5fa-dcfb0b36a15a service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-changed-097e6f29-41d9-4842-a697-ad3d1a1b0d7c {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:45:17 user nova-compute[75247]: DEBUG nova.compute.manager [req-e172b27b-04ff-44cb-b474-b744217b70a8 req-8642e7ff-e5c7-43aa-b5fa-dcfb0b36a15a service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Refreshing instance network info cache due to event network-changed-097e6f29-41d9-4842-a697-ad3d1a1b0d7c. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:45:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e172b27b-04ff-44cb-b474-b744217b70a8 req-8642e7ff-e5c7-43aa-b5fa-dcfb0b36a15a service nova] Acquiring lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:45:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e172b27b-04ff-44cb-b474-b744217b70a8 req-8642e7ff-e5c7-43aa-b5fa-dcfb0b36a15a service nova] Acquired lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:45:17 user nova-compute[75247]: DEBUG nova.network.neutron [req-e172b27b-04ff-44cb-b474-b744217b70a8 req-8642e7ff-e5c7-43aa-b5fa-dcfb0b36a15a service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Refreshing network info cache for port 097e6f29-41d9-4842-a697-ad3d1a1b0d7c {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:45:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e1b5197-dc38-48a5-b9f9-e053be499433/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e1b5197-dc38-48a5-b9f9-e053be499433/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:17 user nova-compute[75247]: DEBUG nova.network.neutron [req-e172b27b-04ff-44cb-b474-b744217b70a8 req-8642e7ff-e5c7-43aa-b5fa-dcfb0b36a15a service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:45:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e1b5197-dc38-48a5-b9f9-e053be499433/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:18 user nova-compute[75247]: DEBUG nova.network.neutron [req-e172b27b-04ff-44cb-b474-b744217b70a8 req-8642e7ff-e5c7-43aa-b5fa-dcfb0b36a15a service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:45:18 user nova-compute[75247]: DEBUG nova.network.neutron [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Successfully updated port: c587e85c-ccd5-4bb9-803c-b08aed3baaeb {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:45:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e172b27b-04ff-44cb-b474-b744217b70a8 req-8642e7ff-e5c7-43aa-b5fa-dcfb0b36a15a service nova] Releasing lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:45:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Acquiring lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:45:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Acquired lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:45:18 user nova-compute[75247]: DEBUG nova.network.neutron [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:45:18 user nova-compute[75247]: DEBUG nova.network.neutron [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:45:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:18 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:45:18 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:45:18 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=7779MB free_disk=25.268390655517578GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 12:45:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:45:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:45:19 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Applying migration context for instance 4531bf11-b948-4d57-bf55-f33563815e26 as it has an incoming, in-progress migration ebd7dca9-1b0a-4f79-971b-48b7913fd325. Migration status is finished {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 06 12:45:19 user nova-compute[75247]: INFO nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Updating resource usage from migration ebd7dca9-1b0a-4f79-971b-48b7913fd325
Dec 06 12:45:19 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 70c4664e-ae7a-47de-bba7-18300391d209 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:45:19 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 782289e2-91cd-4aee-9a08-eadfb2a5965b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:45:19 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:45:19 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance ec9eea5d-dc9a-4a65-881a-a89538e3a593 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:45:19 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 3e1b5197-dc38-48a5-b9f9-e053be499433 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:45:19 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 0a86fe94-933a-4e0d-8a65-4834c3d3e40b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:45:19 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:45:19 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Migration ebd7dca9-1b0a-4f79-971b-48b7913fd325 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1712}}
Dec 06 12:45:19 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 4531bf11-b948-4d57-bf55-f33563815e26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:45:19 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:45:19 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 12:45:19 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 12:45:19 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:45:19 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:45:19 user nova-compute[75247]: DEBUG nova.compute.manager [req-5cd4c055-5cb6-449e-baa4-a25d3439beb5 req-f39777bf-7af4-44d6-8939-c4b8b5120044 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-changed-c587e85c-ccd5-4bb9-803c-b08aed3baaeb {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:45:19 user nova-compute[75247]: DEBUG nova.compute.manager [req-5cd4c055-5cb6-449e-baa4-a25d3439beb5 req-f39777bf-7af4-44d6-8939-c4b8b5120044 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Refreshing instance network info cache due to event network-changed-c587e85c-ccd5-4bb9-803c-b08aed3baaeb. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:45:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5cd4c055-5cb6-449e-baa4-a25d3439beb5 req-f39777bf-7af4-44d6-8939-c4b8b5120044 service nova] Acquiring lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:45:19 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 12:45:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.531s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:45:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:20 user nova-compute[75247]: DEBUG nova.network.neutron [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Updating instance_info_cache with network_info: [{"id": "a079e33d-4b03-49ef-8315-f33edfb30f8f", "address": "fa:16:3e:32:bb:08", "network": {"id": "488711cb-aa26-477a-832a-6a499b8b7c62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-923230583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa079e33d-4b", "ovs_interfaceid": "a079e33d-4b03-49ef-8315-f33edfb30f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d117aa5-7c18-4adb-be72-d785e4905735", "address": "fa:16:3e:b3:6f:7c", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d117aa5-7c", "ovs_interfaceid": "2d117aa5-7c18-4adb-be72-d785e4905735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "681745af-b6fd-4f84-bc98-43bc601c3759", "address": "fa:16:3e:83:ce:7b", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681745af-b6", "ovs_interfaceid": "681745af-b6fd-4f84-bc98-43bc601c3759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b8c474e-894c-43c2-9a4a-0836089a16a1", "address": "fa:16:3e:09:e2:1a", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8c474e-89", "ovs_interfaceid": "7b8c474e-894c-43c2-9a4a-0836089a16a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "267ee847-5894-4c58-8554-e30b91938a6d", "address": "fa:16:3e:72:58:06", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267ee847-58", "ovs_interfaceid": "267ee847-5894-4c58-8554-e30b91938a6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "097e6f29-41d9-4842-a697-ad3d1a1b0d7c", "address": "fa:16:3e:fd:ac:f5", "network": {"id": "7321830d-5ca0-4292-9e4b-c1e160a2b612", "bridge": "br-int", "label": "tempest-device-tagging-net2-5103445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097e6f29-41", "ovs_interfaceid": "097e6f29-41d9-4842-a697-ad3d1a1b0d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c587e85c-ccd5-4bb9-803c-b08aed3baaeb", "address": "fa:16:3e:f9:0b:6e", "network": {"id": "7321830d-5ca0-4292-9e4b-c1e160a2b612", "bridge": "br-int", "label": "tempest-device-tagging-net2-5103445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc587e85c-cc", "ovs_interfaceid": "c587e85c-ccd5-4bb9-803c-b08aed3baaeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:45:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Releasing lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:45:20 user nova-compute[75247]: DEBUG nova.compute.manager [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Instance network_info: |[{"id": "a079e33d-4b03-49ef-8315-f33edfb30f8f", "address": "fa:16:3e:32:bb:08", "network": {"id": "488711cb-aa26-477a-832a-6a499b8b7c62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-923230583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa079e33d-4b", "ovs_interfaceid": "a079e33d-4b03-49ef-8315-f33edfb30f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d117aa5-7c18-4adb-be72-d785e4905735", "address": "fa:16:3e:b3:6f:7c", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d117aa5-7c", "ovs_interfaceid": "2d117aa5-7c18-4adb-be72-d785e4905735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "681745af-b6fd-4f84-bc98-43bc601c3759", "address": "fa:16:3e:83:ce:7b", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681745af-b6", "ovs_interfaceid": "681745af-b6fd-4f84-bc98-43bc601c3759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b8c474e-894c-43c2-9a4a-0836089a16a1", "address": "fa:16:3e:09:e2:1a", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8c474e-89", "ovs_interfaceid": "7b8c474e-894c-43c2-9a4a-0836089a16a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "267ee847-5894-4c58-8554-e30b91938a6d", "address": "fa:16:3e:72:58:06", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267ee847-58", "ovs_interfaceid": "267ee847-5894-4c58-8554-e30b91938a6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "097e6f29-41d9-4842-a697-ad3d1a1b0d7c", "address": "fa:16:3e:fd:ac:f5", "network": {"id": "7321830d-5ca0-4292-9e4b-c1e160a2b612", "bridge": "br-int", "label": "tempest-device-tagging-net2-5103445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097e6f29-41", "ovs_interfaceid": "097e6f29-41d9-4842-a697-ad3d1a1b0d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c587e85c-ccd5-4bb9-803c-b08aed3baaeb", "address": "fa:16:3e:f9:0b:6e", "network": {"id": "7321830d-5ca0-4292-9e4b-c1e160a2b612", "bridge": "br-int", "label": "tempest-device-tagging-net2-5103445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc587e85c-cc", "ovs_interfaceid": "c587e85c-ccd5-4bb9-803c-b08aed3baaeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:45:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5cd4c055-5cb6-449e-baa4-a25d3439beb5 req-f39777bf-7af4-44d6-8939-c4b8b5120044 service nova] Acquired lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:45:20 user nova-compute[75247]: DEBUG nova.network.neutron [req-5cd4c055-5cb6-449e-baa4-a25d3439beb5 req-f39777bf-7af4-44d6-8939-c4b8b5120044 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Refreshing network info cache for port c587e85c-ccd5-4bb9-803c-b08aed3baaeb {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:45:21 user nova-compute[75247]: DEBUG nova.network.neutron [req-5cd4c055-5cb6-449e-baa4-a25d3439beb5 req-f39777bf-7af4-44d6-8939-c4b8b5120044 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Updated VIF entry in instance network info cache for port c587e85c-ccd5-4bb9-803c-b08aed3baaeb. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:45:21 user nova-compute[75247]: DEBUG nova.network.neutron [req-5cd4c055-5cb6-449e-baa4-a25d3439beb5 req-f39777bf-7af4-44d6-8939-c4b8b5120044 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Updating instance_info_cache with network_info: [{"id": "a079e33d-4b03-49ef-8315-f33edfb30f8f", "address": "fa:16:3e:32:bb:08", "network": {"id": "488711cb-aa26-477a-832a-6a499b8b7c62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-923230583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa079e33d-4b", "ovs_interfaceid": "a079e33d-4b03-49ef-8315-f33edfb30f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d117aa5-7c18-4adb-be72-d785e4905735", "address": "fa:16:3e:b3:6f:7c", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d117aa5-7c", "ovs_interfaceid": "2d117aa5-7c18-4adb-be72-d785e4905735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "681745af-b6fd-4f84-bc98-43bc601c3759", "address": "fa:16:3e:83:ce:7b", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681745af-b6", "ovs_interfaceid": "681745af-b6fd-4f84-bc98-43bc601c3759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b8c474e-894c-43c2-9a4a-0836089a16a1", "address": "fa:16:3e:09:e2:1a", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8c474e-89", "ovs_interfaceid": "7b8c474e-894c-43c2-9a4a-0836089a16a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "267ee847-5894-4c58-8554-e30b91938a6d", "address": "fa:16:3e:72:58:06", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267ee847-58", "ovs_interfaceid": "267ee847-5894-4c58-8554-e30b91938a6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "097e6f29-41d9-4842-a697-ad3d1a1b0d7c", "address": "fa:16:3e:fd:ac:f5", "network": {"id": "7321830d-5ca0-4292-9e4b-c1e160a2b612", "bridge": "br-int", "label": "tempest-device-tagging-net2-5103445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097e6f29-41", "ovs_interfaceid": "097e6f29-41d9-4842-a697-ad3d1a1b0d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c587e85c-ccd5-4bb9-803c-b08aed3baaeb", "address": "fa:16:3e:f9:0b:6e", "network": {"id": "7321830d-5ca0-4292-9e4b-c1e160a2b612", "bridge": "br-int", "label": "tempest-device-tagging-net2-5103445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc587e85c-cc", "ovs_interfaceid": "c587e85c-ccd5-4bb9-803c-b08aed3baaeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:45:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5cd4c055-5cb6-449e-baa4-a25d3439beb5 req-f39777bf-7af4-44d6-8939-c4b8b5120044 service nova] Releasing lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:45:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:24 user nova-compute[75247]: INFO nova.virt.block_device [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Booting with volume 7af14201-81e7-40cd-b799-f09628defcfd at /dev/vdb
Dec 06 12:45:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:24 user nova-compute[75247]: DEBUG os_brick.utils [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:45:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:24 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[456bfa91-3596-4589-bb30-f84cfe2ab00e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:24 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9828e928-e022-44ca-8d21-535bb9089877]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:24 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[72be584a-bb28-48b8-9d38-2d813a7d3162]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:24 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d284803c-75df-4e83-86d3-01f344866e33]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:45:24 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:45:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:45:24 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:45:24 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd0fa26-cb60-4f47-8a60-4bc1f76cea14]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:24 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:45:24 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:45:24 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:45:24 user nova-compute[75247]: DEBUG os_brick.utils [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:45:24 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Updating existing volume attachment record: 2448ae1e-767c-4dff-a705-08f5f412ac61 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:45:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:36 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:37 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ec9eea5d-dc9a-4a65-881a-a89538e3a593 is timed out.
Dec 06 12:45:37 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Successfully detached device vdb from instance ec9eea5d-dc9a-4a65-881a-a89538e3a593 from the live domain config.
Dec 06 12:45:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScqRAIom', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:45:37 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:45:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[da786778-e5da-4a10-adfc-ce08690c0951]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:45:37 user nova-compute[75247]: No targets found.
Dec 06 12:45:37 user nova-compute[75247]: iSNS:
Dec 06 12:45:37 user nova-compute[75247]: No targets found.
Dec 06 12:45:37 user nova-compute[75247]: STATIC:
Dec 06 12:45:37 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496
Dec 06 12:45:37 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:45:37 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:45:37 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:45:37 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:45:37 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:45:37 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db
Dec 06 12:45:37 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:45:37 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:45:37 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482
Dec 06 12:45:37 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:45:37 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:45:37 user nova-compute[75247]: FIRMWARE:
Dec 06 12:45:37 user nova-compute[75247]: No targets found.
Dec 06 12:45:37 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:45:37 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:45:37 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.052s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4033451-dd0d-4d48-9031-baa8ae2ccbf5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15bd64e-10e5-4c5d-a622-3ad16e579b5d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:45:37 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:45:37 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:45:37 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:45:37 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:45:37 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:45:37 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:45:37 user nova-compute[75247]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 (non-flash)
Dec 06 12:45:37 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd730190ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496'): ({'sdf'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Removing single pathed devices sdf {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5856ad0b-502c-434c-b747-4c7fc79d6518]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0e130a-319b-4062-87fd-0e05e38388b6]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Flushing IO for device /dev/sdf {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c55f00-cba8-4fb9-85c8-73161b2cf5c8]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e480a213-a56e-477d-abd9-9d714a50776b]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] SCSI volumes sdf have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[91285aeb-1516-4012-89c4-f179e3de5975]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[62746691-1758-41f1-a317-c9bdb70849bc]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496, portal: 172.16.0.220,3260]
Dec 06 12:45:37 user nova-compute[75247]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496, portal: 172.16.0.220,3260] successful.
Dec 06 12:45:37 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8aa1a77-9f7a-4984-bf5e-2a6d45b35496 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[131e4b60-0068-476a-881d-0618fdf14d6a]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] <== disconnect_volume: return (385ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:45:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:45:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:38 user nova-compute[75247]: DEBUG nova.objects.instance [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lazy-loading 'flavor' on Instance uuid ec9eea5d-dc9a-4a65-881a-a89538e3a593 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:45:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3f76d627-e48c-4515-8560-574f75981c88 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.230s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:45:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:44 user nova-compute[75247]: INFO nova.virt.block_device [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Booting with volume 097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 at /dev/vdc
Dec 06 12:45:44 user nova-compute[75247]: DEBUG os_brick.utils [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:45:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:44 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[78eb158f-3090-4489-87e8-7cbc0d41cbba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:44 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8a2bbb-afce-4285-b0c9-5e649f665ab2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:44 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb126ff-04b3-488c-b2ad-422cfe839db4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:44 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[379aa3e0-ccad-435b-bc8f-b258772ab1eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:45:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:45:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:45:44 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:45:44 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d05d212-c13e-41a2-a020-d8b609b3cdc7]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:45:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:45:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:45:44 user nova-compute[75247]: DEBUG os_brick.utils [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:45:44 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Updating existing volume attachment record: f3145bb0-53cb-454f-93d0-9c853310fa7d {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:45:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Acquiring lock "8c5711ad-a295-4b5d-8baf-50921601f26e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:45:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Lock "8c5711ad-a295-4b5d-8baf-50921601f26e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:45:48 user nova-compute[75247]: DEBUG nova.compute.manager [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:45:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:45:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:45:48 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:45:48 user nova-compute[75247]: INFO nova.compute.claims [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Claim successful on node user
Dec 06 12:45:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:48 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:45:48 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:45:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.527s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:45:48 user nova-compute[75247]: DEBUG nova.compute.manager [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:45:48 user nova-compute[75247]: DEBUG nova.compute.manager [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:45:48 user nova-compute[75247]: DEBUG nova.network.neutron [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:45:48 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:45:48 user nova-compute[75247]: DEBUG nova.compute.manager [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:45:48 user nova-compute[75247]: DEBUG nova.policy [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e073e98dd1a470c98ab45c0efbd7f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d1676de49240649e41129c3906a43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:45:48 user nova-compute[75247]: DEBUG nova.compute.manager [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:45:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:45:48 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Creating image(s)
Dec 06 12:45:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c5711ad-a295-4b5d-8baf-50921601f26e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:45:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Lock "/opt/stack/data/nova/instances/8c5711ad-a295-4b5d-8baf-50921601f26e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:45:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Lock "/opt/stack/data/nova/instances/8c5711ad-a295-4b5d-8baf-50921601f26e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:45:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.210s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:45:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:45:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.200s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/8c5711ad-a295-4b5d-8baf-50921601f26e/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/8c5711ad-a295-4b5d-8baf-50921601f26e/disk 1073741824" returned: 0 in 0.060s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:45:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.182s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:49 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c5711ad-a295-4b5d-8baf-50921601f26e/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:45:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5711ad-a295-4b5d-8baf-50921601f26e/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5711ad-a295-4b5d-8baf-50921601f26e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:49 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Cannot resize image /opt/stack/data/nova/instances/8c5711ad-a295-4b5d-8baf-50921601f26e/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:45:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:45:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Ensure instance console log exists: /opt/stack/data/nova/instances/8c5711ad-a295-4b5d-8baf-50921601f26e/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:45:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:45:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:45:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:45:49 user nova-compute[75247]: DEBUG nova.network.neutron [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Successfully created port: b890e9e6-11b1-4990-a35b-5b20b9b6a14c {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.network.neutron [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Successfully updated port: b890e9e6-11b1-4990-a35b-5b20b9b6a14c {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Acquiring lock "refresh_cache-8c5711ad-a295-4b5d-8baf-50921601f26e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Acquired lock "refresh_cache-8c5711ad-a295-4b5d-8baf-50921601f26e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.network.neutron [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.compute.manager [req-a0f8e822-d953-4a86-8711-57bceeadc2a0 req-f7993a8c-2e5f-4ad2-8048-5957dd8276cf service nova] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Received event network-changed-b890e9e6-11b1-4990-a35b-5b20b9b6a14c {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.compute.manager [req-a0f8e822-d953-4a86-8711-57bceeadc2a0 req-f7993a8c-2e5f-4ad2-8048-5957dd8276cf service nova] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Refreshing instance network info cache due to event network-changed-b890e9e6-11b1-4990-a35b-5b20b9b6a14c. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a0f8e822-d953-4a86-8711-57bceeadc2a0 req-f7993a8c-2e5f-4ad2-8048-5957dd8276cf service nova] Acquiring lock "refresh_cache-8c5711ad-a295-4b5d-8baf-50921601f26e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.network.neutron [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.network.neutron [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Updating instance_info_cache with network_info: [{"id": "b890e9e6-11b1-4990-a35b-5b20b9b6a14c", "address": "fa:16:3e:d9:30:31", "network": {"id": "b4fa0a00-9932-4aee-b21e-7faeee984d57", "bridge": "br-int", "label": "tempest-VolumesActionsTest-14311074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86d1676de49240649e41129c3906a43c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb890e9e6-11", "ovs_interfaceid": "b890e9e6-11b1-4990-a35b-5b20b9b6a14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Releasing lock "refresh_cache-8c5711ad-a295-4b5d-8baf-50921601f26e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.compute.manager [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Instance network_info: |[{"id": "b890e9e6-11b1-4990-a35b-5b20b9b6a14c", "address": "fa:16:3e:d9:30:31", "network": {"id": "b4fa0a00-9932-4aee-b21e-7faeee984d57", "bridge": "br-int", "label": "tempest-VolumesActionsTest-14311074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86d1676de49240649e41129c3906a43c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb890e9e6-11", "ovs_interfaceid": "b890e9e6-11b1-4990-a35b-5b20b9b6a14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a0f8e822-d953-4a86-8711-57bceeadc2a0 req-f7993a8c-2e5f-4ad2-8048-5957dd8276cf service nova] Acquired lock "refresh_cache-8c5711ad-a295-4b5d-8baf-50921601f26e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.network.neutron [req-a0f8e822-d953-4a86-8711-57bceeadc2a0 req-f7993a8c-2e5f-4ad2-8048-5957dd8276cf service nova] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Refreshing network info cache for port b890e9e6-11b1-4990-a35b-5b20b9b6a14c {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Start _get_guest_xml network_info=[{"id": "b890e9e6-11b1-4990-a35b-5b20b9b6a14c", "address": "fa:16:3e:d9:30:31", "network": {"id": "b4fa0a00-9932-4aee-b21e-7faeee984d57", "bridge": "br-int", "label": "tempest-VolumesActionsTest-14311074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86d1676de49240649e41129c3906a43c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb890e9e6-11", "ovs_interfaceid": "b890e9e6-11b1-4990-a35b-5b20b9b6a14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:45:51 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:45:51 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:45:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1583061069',display_name='tempest-VolumesActionsTest-instance-1583061069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1583061069',id=18,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86d1676de49240649e41129c3906a43c',ramdisk_id='',reservation_id='r-25k1zm23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1885079958',owner_user_name='tempest-VolumesActionsTest-1885079958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:45:49Z,user_data=None,user_id='1e073e98dd1a470c98ab45c0efbd7f48',uuid=8c5711ad-a295-4b5d-8baf-50921601f26e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b890e9e6-11b1-4990-a35b-5b20b9b6a14c", "address": "fa:16:3e:d9:30:31", "network": {"id": "b4fa0a00-9932-4aee-b21e-7faeee984d57", "bridge": "br-int", "label": "tempest-VolumesActionsTest-14311074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86d1676de49240649e41129c3906a43c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb890e9e6-11", "ovs_interfaceid": "b890e9e6-11b1-4990-a35b-5b20b9b6a14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Converting VIF {"id": "b890e9e6-11b1-4990-a35b-5b20b9b6a14c", "address": "fa:16:3e:d9:30:31", "network": {"id": "b4fa0a00-9932-4aee-b21e-7faeee984d57", "bridge": "br-int", "label": "tempest-VolumesActionsTest-14311074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86d1676de49240649e41129c3906a43c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb890e9e6-11", "ovs_interfaceid": "b890e9e6-11b1-4990-a35b-5b20b9b6a14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:30:31,bridge_name='br-int',has_traffic_filtering=True,id=b890e9e6-11b1-4990-a35b-5b20b9b6a14c,network=Network(b4fa0a00-9932-4aee-b21e-7faeee984d57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb890e9e6-11') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.objects.instance [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c5711ad-a295-4b5d-8baf-50921601f26e {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:45:51 user nova-compute[75247]:   <uuid>8c5711ad-a295-4b5d-8baf-50921601f26e</uuid>
Dec 06 12:45:51 user nova-compute[75247]:   <name>instance-00000012</name>
Dec 06 12:45:51 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:45:51 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:45:51 user nova-compute[75247]:   <metadata>
Dec 06 12:45:51 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:45:51 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:45:51 user nova-compute[75247]:       <nova:name>tempest-VolumesActionsTest-instance-1583061069</nova:name>
Dec 06 12:45:51 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:45:51</nova:creationTime>
Dec 06 12:45:51 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:45:51 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:45:51 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:45:51 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:45:51 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:45:51 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:45:51 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:45:51 user nova-compute[75247]:       <nova:owner>
Dec 06 12:45:51 user nova-compute[75247]:         <nova:user uuid="1e073e98dd1a470c98ab45c0efbd7f48">tempest-VolumesActionsTest-1885079958-project-member</nova:user>
Dec 06 12:45:51 user nova-compute[75247]:         <nova:project uuid="86d1676de49240649e41129c3906a43c">tempest-VolumesActionsTest-1885079958</nova:project>
Dec 06 12:45:51 user nova-compute[75247]:       </nova:owner>
Dec 06 12:45:51 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:45:51 user nova-compute[75247]:       <nova:ports>
Dec 06 12:45:51 user nova-compute[75247]:         <nova:port uuid="b890e9e6-11b1-4990-a35b-5b20b9b6a14c">
Dec 06 12:45:51 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 06 12:45:51 user nova-compute[75247]:         </nova:port>
Dec 06 12:45:51 user nova-compute[75247]:       </nova:ports>
Dec 06 12:45:51 user nova-compute[75247]:     </nova:instance>
Dec 06 12:45:51 user nova-compute[75247]:   </metadata>
Dec 06 12:45:51 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:45:51 user nova-compute[75247]:     <system>
Dec 06 12:45:51 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:45:51 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:45:51 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:45:51 user nova-compute[75247]:       <entry name="serial">8c5711ad-a295-4b5d-8baf-50921601f26e</entry>
Dec 06 12:45:51 user nova-compute[75247]:       <entry name="uuid">8c5711ad-a295-4b5d-8baf-50921601f26e</entry>
Dec 06 12:45:51 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:45:51 user nova-compute[75247]:     </system>
Dec 06 12:45:51 user nova-compute[75247]:   </sysinfo>
Dec 06 12:45:51 user nova-compute[75247]:   <os>
Dec 06 12:45:51 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:45:51 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:45:51 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:45:51 user nova-compute[75247]:   </os>
Dec 06 12:45:51 user nova-compute[75247]:   <features>
Dec 06 12:45:51 user nova-compute[75247]:     <acpi/>
Dec 06 12:45:51 user nova-compute[75247]:     <apic/>
Dec 06 12:45:51 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:45:51 user nova-compute[75247]:   </features>
Dec 06 12:45:51 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:45:51 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:45:51 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:45:51 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:45:51 user nova-compute[75247]:   </clock>
Dec 06 12:45:51 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:45:51 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:45:51 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:45:51 user nova-compute[75247]:   </cpu>
Dec 06 12:45:51 user nova-compute[75247]:   <devices>
Dec 06 12:45:51 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:45:51 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:45:51 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/8c5711ad-a295-4b5d-8baf-50921601f26e/disk"/>
Dec 06 12:45:51 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:45:51 user nova-compute[75247]:     </disk>
Dec 06 12:45:51 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:45:51 user nova-compute[75247]:       <mac address="fa:16:3e:d9:30:31"/>
Dec 06 12:45:51 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:45:51 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:45:51 user nova-compute[75247]:       <target dev="tapb890e9e6-11"/>
Dec 06 12:45:51 user nova-compute[75247]:     </interface>
Dec 06 12:45:51 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:45:51 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/8c5711ad-a295-4b5d-8baf-50921601f26e/console.log" append="off"/>
Dec 06 12:45:51 user nova-compute[75247]:     </serial>
Dec 06 12:45:51 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:45:51 user nova-compute[75247]:     <video>
Dec 06 12:45:51 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:45:51 user nova-compute[75247]:     </video>
Dec 06 12:45:51 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:45:51 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:45:51 user nova-compute[75247]:     </rng>
Dec 06 12:45:51 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:45:51 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:45:51 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:45:51 user nova-compute[75247]:     </memballoon>
Dec 06 12:45:51 user nova-compute[75247]:   </devices>
Dec 06 12:45:51 user nova-compute[75247]: </domain>
Dec 06 12:45:51 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:45:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1583061069',display_name='tempest-VolumesActionsTest-instance-1583061069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1583061069',id=18,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86d1676de49240649e41129c3906a43c',ramdisk_id='',reservation_id='r-25k1zm23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1885079958',owner_user_name='tempest-VolumesActionsTest-1885079958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:45:49Z,user_data=None,user_id='1e073e98dd1a470c98ab45c0efbd7f48',uuid=8c5711ad-a295-4b5d-8baf-50921601f26e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b890e9e6-11b1-4990-a35b-5b20b9b6a14c", "address": "fa:16:3e:d9:30:31", "network": {"id": "b4fa0a00-9932-4aee-b21e-7faeee984d57", "bridge": "br-int", "label": "tempest-VolumesActionsTest-14311074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86d1676de49240649e41129c3906a43c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb890e9e6-11", "ovs_interfaceid": "b890e9e6-11b1-4990-a35b-5b20b9b6a14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Converting VIF {"id": "b890e9e6-11b1-4990-a35b-5b20b9b6a14c", "address": "fa:16:3e:d9:30:31", "network": {"id": "b4fa0a00-9932-4aee-b21e-7faeee984d57", "bridge": "br-int", "label": "tempest-VolumesActionsTest-14311074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86d1676de49240649e41129c3906a43c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb890e9e6-11", "ovs_interfaceid": "b890e9e6-11b1-4990-a35b-5b20b9b6a14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:30:31,bridge_name='br-int',has_traffic_filtering=True,id=b890e9e6-11b1-4990-a35b-5b20b9b6a14c,network=Network(b4fa0a00-9932-4aee-b21e-7faeee984d57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb890e9e6-11') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG os_vif [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:30:31,bridge_name='br-int',has_traffic_filtering=True,id=b890e9e6-11b1-4990-a35b-5b20b9b6a14c,network=Network(b4fa0a00-9932-4aee-b21e-7faeee984d57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb890e9e6-11') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b02a32f6-b2ec-59cb-87b8-6d192af3517f', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb890e9e6-11, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb890e9e6-11, col_values=(('qos', UUID('eebd6be0-0cb2-4a11-921f-f5df27b030dc')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb890e9e6-11, col_values=(('external_ids', {'iface-id': 'b890e9e6-11b1-4990-a35b-5b20b9b6a14c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:30:31', 'vm-uuid': '8c5711ad-a295-4b5d-8baf-50921601f26e'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:45:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:45:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:52 user nova-compute[75247]: INFO os_vif [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:30:31,bridge_name='br-int',has_traffic_filtering=True,id=b890e9e6-11b1-4990-a35b-5b20b9b6a14c,network=Network(b4fa0a00-9932-4aee-b21e-7faeee984d57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb890e9e6-11')
Dec 06 12:45:52 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:45:52 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] No VIF found with MAC fa:16:3e:d9:30:31, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:45:52 user nova-compute[75247]: DEBUG nova.network.neutron [req-a0f8e822-d953-4a86-8711-57bceeadc2a0 req-f7993a8c-2e5f-4ad2-8048-5957dd8276cf service nova] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Updated VIF entry in instance network info cache for port b890e9e6-11b1-4990-a35b-5b20b9b6a14c. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:45:52 user nova-compute[75247]: DEBUG nova.network.neutron [req-a0f8e822-d953-4a86-8711-57bceeadc2a0 req-f7993a8c-2e5f-4ad2-8048-5957dd8276cf service nova] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Updating instance_info_cache with network_info: [{"id": "b890e9e6-11b1-4990-a35b-5b20b9b6a14c", "address": "fa:16:3e:d9:30:31", "network": {"id": "b4fa0a00-9932-4aee-b21e-7faeee984d57", "bridge": "br-int", "label": "tempest-VolumesActionsTest-14311074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86d1676de49240649e41129c3906a43c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb890e9e6-11", "ovs_interfaceid": "b890e9e6-11b1-4990-a35b-5b20b9b6a14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:45:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a0f8e822-d953-4a86-8711-57bceeadc2a0 req-f7993a8c-2e5f-4ad2-8048-5957dd8276cf service nova] Releasing lock "refresh_cache-8c5711ad-a295-4b5d-8baf-50921601f26e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:45:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:53 user nova-compute[75247]: DEBUG nova.compute.manager [req-4e70a09a-9cba-475d-baae-f2e3110df5b9 req-dce7c8bf-9e15-4c64-b640-054515d72edb service nova] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Received event network-vif-plugged-b890e9e6-11b1-4990-a35b-5b20b9b6a14c {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:45:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4e70a09a-9cba-475d-baae-f2e3110df5b9 req-dce7c8bf-9e15-4c64-b640-054515d72edb service nova] Acquiring lock "8c5711ad-a295-4b5d-8baf-50921601f26e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:45:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4e70a09a-9cba-475d-baae-f2e3110df5b9 req-dce7c8bf-9e15-4c64-b640-054515d72edb service nova] Lock "8c5711ad-a295-4b5d-8baf-50921601f26e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:45:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4e70a09a-9cba-475d-baae-f2e3110df5b9 req-dce7c8bf-9e15-4c64-b640-054515d72edb service nova] Lock "8c5711ad-a295-4b5d-8baf-50921601f26e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:45:53 user nova-compute[75247]: DEBUG nova.compute.manager [req-4e70a09a-9cba-475d-baae-f2e3110df5b9 req-dce7c8bf-9e15-4c64-b640-054515d72edb service nova] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] No waiting events found dispatching network-vif-plugged-b890e9e6-11b1-4990-a35b-5b20b9b6a14c {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:45:53 user nova-compute[75247]: WARNING nova.compute.manager [req-4e70a09a-9cba-475d-baae-f2e3110df5b9 req-dce7c8bf-9e15-4c64-b640-054515d72edb service nova] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Received unexpected event network-vif-plugged-b890e9e6-11b1-4990-a35b-5b20b9b6a14c for instance with vm_state building and task_state spawning.
Dec 06 12:45:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:55 user nova-compute[75247]: DEBUG nova.compute.manager [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:45:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:45:55 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Instance spawned successfully.
Dec 06 12:45:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:45:55 user nova-compute[75247]: DEBUG nova.compute.manager [req-d723b2d7-bec5-461d-b013-1579eaf47611 req-3d5fdc58-da5e-4f39-9b13-928c5ec20357 service nova] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Received event network-vif-plugged-b890e9e6-11b1-4990-a35b-5b20b9b6a14c {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:45:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d723b2d7-bec5-461d-b013-1579eaf47611 req-3d5fdc58-da5e-4f39-9b13-928c5ec20357 service nova] Acquiring lock "8c5711ad-a295-4b5d-8baf-50921601f26e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:45:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d723b2d7-bec5-461d-b013-1579eaf47611 req-3d5fdc58-da5e-4f39-9b13-928c5ec20357 service nova] Lock "8c5711ad-a295-4b5d-8baf-50921601f26e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:45:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d723b2d7-bec5-461d-b013-1579eaf47611 req-3d5fdc58-da5e-4f39-9b13-928c5ec20357 service nova] Lock "8c5711ad-a295-4b5d-8baf-50921601f26e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:45:55 user nova-compute[75247]: DEBUG nova.compute.manager [req-d723b2d7-bec5-461d-b013-1579eaf47611 req-3d5fdc58-da5e-4f39-9b13-928c5ec20357 service nova] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] No waiting events found dispatching network-vif-plugged-b890e9e6-11b1-4990-a35b-5b20b9b6a14c {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:45:55 user nova-compute[75247]: WARNING nova.compute.manager [req-d723b2d7-bec5-461d-b013-1579eaf47611 req-3d5fdc58-da5e-4f39-9b13-928c5ec20357 service nova] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Received unexpected event network-vif-plugged-b890e9e6-11b1-4990-a35b-5b20b9b6a14c for instance with vm_state building and task_state spawning.
Dec 06 12:45:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:45:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:45:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:45:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:45:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:45:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:45:55 user nova-compute[75247]: INFO nova.compute.manager [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Took 6.91 seconds to spawn the instance on the hypervisor.
Dec 06 12:45:55 user nova-compute[75247]: DEBUG nova.compute.manager [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:45:55 user nova-compute[75247]: INFO nova.compute.manager [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Took 7.83 seconds to build instance.
Dec 06 12:45:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-301ad368-52a6-46e2-a091-e31d52d012b0 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Lock "8c5711ad-a295-4b5d-8baf-50921601f26e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.952s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:45:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG nova.objects.instance [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lazy-loading 'flavor' on Instance uuid 0a86fe94-933a-4e0d-8a65-4834c3d3e40b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:45:58 user nova-compute[75247]: INFO nova.compute.manager [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Attaching volume b3c81dcf-076d-4330-aecd-a47fd48c4d92 to /dev/vdb
Dec 06 12:45:58 user nova-compute[75247]: DEBUG os_brick.utils [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[059c7f1e-1057-4c82-9b88-72875af3f028]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d8c06e-f70b-4d27-9c2e-c8bbc821604e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca8e935-ef37-4bba-bda4-a721dbdaa7c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4059a444-79c0-4124-91d7-db5cb0e0b9b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:45:58 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:45:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b364c60c-64ac-49e5-b900-e48f7bf4dd9e]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG os_brick.utils [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Updating existing volume attachment record: 73b716d1-c2b6-412a-b0df-3b4a7d3d44a7 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:45:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:45:59 user nova-compute[75247]: DEBUG nova.compute.manager [req-cc180aaa-20cd-49de-a471-b458aa6f2ccc req-f150c011-8fc7-4865-8565-a942a6a5e310 service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Received event network-changed-434efb9d-06e4-413b-b470-4952e114c298 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:45:59 user nova-compute[75247]: DEBUG nova.compute.manager [req-cc180aaa-20cd-49de-a471-b458aa6f2ccc req-f150c011-8fc7-4865-8565-a942a6a5e310 service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Refreshing instance network info cache due to event network-changed-434efb9d-06e4-413b-b470-4952e114c298. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:45:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-cc180aaa-20cd-49de-a471-b458aa6f2ccc req-f150c011-8fc7-4865-8565-a942a6a5e310 service nova] Acquiring lock "refresh_cache-cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:45:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-cc180aaa-20cd-49de-a471-b458aa6f2ccc req-f150c011-8fc7-4865-8565-a942a6a5e310 service nova] Acquired lock "refresh_cache-cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:45:59 user nova-compute[75247]: DEBUG nova.network.neutron [req-cc180aaa-20cd-49de-a471-b458aa6f2ccc req-f150c011-8fc7-4865-8565-a942a6a5e310 service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Refreshing network info cache for port 434efb9d-06e4-413b-b470-4952e114c298 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:45:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Acquiring lock "db837c7a-c52d-469b-abf7-cea107454c60" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:45:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "db837c7a-c52d-469b-abf7-cea107454c60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:00 user nova-compute[75247]: DEBUG nova.compute.manager [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:46:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:00 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:46:00 user nova-compute[75247]: INFO nova.compute.claims [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Claim successful on node user
Dec 06 12:46:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:00 user nova-compute[75247]: DEBUG nova.objects.instance [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lazy-loading 'flavor' on Instance uuid cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:46:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.110s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:00 user nova-compute[75247]: DEBUG nova.network.neutron [req-cc180aaa-20cd-49de-a471-b458aa6f2ccc req-f150c011-8fc7-4865-8565-a942a6a5e310 service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Updated VIF entry in instance network info cache for port 434efb9d-06e4-413b-b470-4952e114c298. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:46:00 user nova-compute[75247]: DEBUG nova.network.neutron [req-cc180aaa-20cd-49de-a471-b458aa6f2ccc req-f150c011-8fc7-4865-8565-a942a6a5e310 service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Updating instance_info_cache with network_info: [{"id": "434efb9d-06e4-413b-b470-4952e114c298", "address": "fa:16:3e:b5:b1:be", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434efb9d-06", "ovs_interfaceid": "434efb9d-06e4-413b-b470-4952e114c298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:46:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-cc180aaa-20cd-49de-a471-b458aa6f2ccc req-f150c011-8fc7-4865-8565-a942a6a5e310 service nova] Releasing lock "refresh_cache-cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:46:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:00 user nova-compute[75247]: INFO nova.compute.manager [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Attaching volume 4933a54b-1240-4fda-8beb-b2d5cb8ed579 to /dev/vdb
Dec 06 12:46:00 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:46:00 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:46:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.734s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:00 user nova-compute[75247]: DEBUG nova.compute.manager [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:46:00 user nova-compute[75247]: DEBUG nova.compute.manager [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:46:00 user nova-compute[75247]: DEBUG nova.network.neutron [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:46:00 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:46:01 user nova-compute[75247]: DEBUG nova.compute.manager [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG nova.policy [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4741ba4fd4f48d9a91b5c9d31b7a3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8f578ae9d44706b68eaac234ae6d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG os_brick.utils [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2c4699-7098-45e3-bded-4a440dc7120b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8203859f-d944-4267-a607-588ee91f9b9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG nova.compute.manager [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:46:01 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Creating image(s)
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Acquiring lock "/opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "/opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "/opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c2e5c1-5630-43cb-8f43-c3a2ae25b2d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4648278-0a6d-47bb-83eb-41f8182d7495]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:46:01 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77f436c-f949-4240-9d7a-217a69063ed8]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG os_brick.utils [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] <== get_connector_properties: return (197ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Updating existing volume attachment record: 8ad5e112-8ac6-4717-ae87-02c72c2ddbe2 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.208s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.194s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk 1073741824" returned: 0 in 0.070s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG nova.network.neutron [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Successfully created port: 861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.205s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:46:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:02 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Cannot resize image /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:46:02 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:46:02 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Ensure instance console log exists: /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:46:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.network.neutron [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Successfully updated port: 861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Acquiring lock "refresh_cache-db837c7a-c52d-469b-abf7-cea107454c60" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Acquired lock "refresh_cache-db837c7a-c52d-469b-abf7-cea107454c60" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.network.neutron [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-3cb1bd7f-7c41-4e90-83e4-ea473cf3fa6f req-ab3b83ea-9bc0-45c2-b05f-125ae15e46bf service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received event network-changed-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-3cb1bd7f-7c41-4e90-83e4-ea473cf3fa6f req-ab3b83ea-9bc0-45c2-b05f-125ae15e46bf service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Refreshing instance network info cache due to event network-changed-861bfd56-2888-46b4-b583-08526d05bcd6. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3cb1bd7f-7c41-4e90-83e4-ea473cf3fa6f req-ab3b83ea-9bc0-45c2-b05f-125ae15e46bf service nova] Acquiring lock "refresh_cache-db837c7a-c52d-469b-abf7-cea107454c60" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.network.neutron [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.network.neutron [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Updating instance_info_cache with network_info: [{"id": "861bfd56-2888-46b4-b583-08526d05bcd6", "address": "fa:16:3e:eb:bc:82", "network": {"id": "52a97bc9-88b7-430a-80c8-3d6210441943", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1761062078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8f578ae9d44706b68eaac234ae6d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861bfd56-28", "ovs_interfaceid": "861bfd56-2888-46b4-b583-08526d05bcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Releasing lock "refresh_cache-db837c7a-c52d-469b-abf7-cea107454c60" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.compute.manager [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Instance network_info: |[{"id": "861bfd56-2888-46b4-b583-08526d05bcd6", "address": "fa:16:3e:eb:bc:82", "network": {"id": "52a97bc9-88b7-430a-80c8-3d6210441943", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1761062078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8f578ae9d44706b68eaac234ae6d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861bfd56-28", "ovs_interfaceid": "861bfd56-2888-46b4-b583-08526d05bcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3cb1bd7f-7c41-4e90-83e4-ea473cf3fa6f req-ab3b83ea-9bc0-45c2-b05f-125ae15e46bf service nova] Acquired lock "refresh_cache-db837c7a-c52d-469b-abf7-cea107454c60" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.network.neutron [req-3cb1bd7f-7c41-4e90-83e4-ea473cf3fa6f req-ab3b83ea-9bc0-45c2-b05f-125ae15e46bf service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Refreshing network info cache for port 861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Start _get_guest_xml network_info=[{"id": "861bfd56-2888-46b4-b583-08526d05bcd6", "address": "fa:16:3e:eb:bc:82", "network": {"id": "52a97bc9-88b7-430a-80c8-3d6210441943", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1761062078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8f578ae9d44706b68eaac234ae6d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861bfd56-28", "ovs_interfaceid": "861bfd56-2888-46b4-b583-08526d05bcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:46:03 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:46:03 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:45:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1896743252',display_name='tempest-ServerStableDeviceRescueTest-server-1896743252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1896743252',id=19,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvhU73cJfUZBM75WAXDtUdapcw/hxet4znGmOMjhn8KYsa3efoegt+QlsaxBfHHhjJbHGSMnEJuDsqMQgNWlux0I/2LXEwJscpwT1hYARyfH0pcXijK2MYWQok7t1Mf2Q==',key_name='tempest-keypair-203231955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e8f578ae9d44706b68eaac234ae6d65',ramdisk_id='',reservation_id='r-1s4hdg20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-374729134',owner_user_name='tempest-ServerStableDeviceRescueTest-374729134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:46:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4741ba4fd4f48d9a91b5c9d31b7a3ac',uuid=db837c7a-c52d-469b-abf7-cea107454c60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "861bfd56-2888-46b4-b583-08526d05bcd6", "address": "fa:16:3e:eb:bc:82", "network": {"id": "52a97bc9-88b7-430a-80c8-3d6210441943", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1761062078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8f578ae9d44706b68eaac234ae6d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861bfd56-28", "ovs_interfaceid": "861bfd56-2888-46b4-b583-08526d05bcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Converting VIF {"id": "861bfd56-2888-46b4-b583-08526d05bcd6", "address": "fa:16:3e:eb:bc:82", "network": {"id": "52a97bc9-88b7-430a-80c8-3d6210441943", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1761062078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8f578ae9d44706b68eaac234ae6d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861bfd56-28", "ovs_interfaceid": "861bfd56-2888-46b4-b583-08526d05bcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:bc:82,bridge_name='br-int',has_traffic_filtering=True,id=861bfd56-2888-46b4-b583-08526d05bcd6,network=Network(52a97bc9-88b7-430a-80c8-3d6210441943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap861bfd56-28') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.objects.instance [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lazy-loading 'pci_devices' on Instance uuid db837c7a-c52d-469b-abf7-cea107454c60 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:46:03 user nova-compute[75247]:   <uuid>db837c7a-c52d-469b-abf7-cea107454c60</uuid>
Dec 06 12:46:03 user nova-compute[75247]:   <name>instance-00000013</name>
Dec 06 12:46:03 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:46:03 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:46:03 user nova-compute[75247]:   <metadata>
Dec 06 12:46:03 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:46:03 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:46:03 user nova-compute[75247]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1896743252</nova:name>
Dec 06 12:46:03 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:46:03</nova:creationTime>
Dec 06 12:46:03 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:46:03 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:46:03 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:46:03 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:46:03 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:46:03 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:46:03 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:46:03 user nova-compute[75247]:       <nova:owner>
Dec 06 12:46:03 user nova-compute[75247]:         <nova:user uuid="c4741ba4fd4f48d9a91b5c9d31b7a3ac">tempest-ServerStableDeviceRescueTest-374729134-project-member</nova:user>
Dec 06 12:46:03 user nova-compute[75247]:         <nova:project uuid="3e8f578ae9d44706b68eaac234ae6d65">tempest-ServerStableDeviceRescueTest-374729134</nova:project>
Dec 06 12:46:03 user nova-compute[75247]:       </nova:owner>
Dec 06 12:46:03 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:46:03 user nova-compute[75247]:       <nova:ports>
Dec 06 12:46:03 user nova-compute[75247]:         <nova:port uuid="861bfd56-2888-46b4-b583-08526d05bcd6">
Dec 06 12:46:03 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 06 12:46:03 user nova-compute[75247]:         </nova:port>
Dec 06 12:46:03 user nova-compute[75247]:       </nova:ports>
Dec 06 12:46:03 user nova-compute[75247]:     </nova:instance>
Dec 06 12:46:03 user nova-compute[75247]:   </metadata>
Dec 06 12:46:03 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:46:03 user nova-compute[75247]:     <system>
Dec 06 12:46:03 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:46:03 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:46:03 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:46:03 user nova-compute[75247]:       <entry name="serial">db837c7a-c52d-469b-abf7-cea107454c60</entry>
Dec 06 12:46:03 user nova-compute[75247]:       <entry name="uuid">db837c7a-c52d-469b-abf7-cea107454c60</entry>
Dec 06 12:46:03 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:46:03 user nova-compute[75247]:     </system>
Dec 06 12:46:03 user nova-compute[75247]:   </sysinfo>
Dec 06 12:46:03 user nova-compute[75247]:   <os>
Dec 06 12:46:03 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:46:03 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:46:03 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:46:03 user nova-compute[75247]:   </os>
Dec 06 12:46:03 user nova-compute[75247]:   <features>
Dec 06 12:46:03 user nova-compute[75247]:     <acpi/>
Dec 06 12:46:03 user nova-compute[75247]:     <apic/>
Dec 06 12:46:03 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:46:03 user nova-compute[75247]:   </features>
Dec 06 12:46:03 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:46:03 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:46:03 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:46:03 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:46:03 user nova-compute[75247]:   </clock>
Dec 06 12:46:03 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:46:03 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:46:03 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:46:03 user nova-compute[75247]:   </cpu>
Dec 06 12:46:03 user nova-compute[75247]:   <devices>
Dec 06 12:46:03 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:46:03 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:46:03 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk"/>
Dec 06 12:46:03 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:46:03 user nova-compute[75247]:     </disk>
Dec 06 12:46:03 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:46:03 user nova-compute[75247]:       <mac address="fa:16:3e:eb:bc:82"/>
Dec 06 12:46:03 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:46:03 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:46:03 user nova-compute[75247]:       <target dev="tap861bfd56-28"/>
Dec 06 12:46:03 user nova-compute[75247]:     </interface>
Dec 06 12:46:03 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:46:03 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/console.log" append="off"/>
Dec 06 12:46:03 user nova-compute[75247]:     </serial>
Dec 06 12:46:03 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:46:03 user nova-compute[75247]:     <video>
Dec 06 12:46:03 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:46:03 user nova-compute[75247]:     </video>
Dec 06 12:46:03 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:46:03 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:46:03 user nova-compute[75247]:     </rng>
Dec 06 12:46:03 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:46:03 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:46:03 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:46:03 user nova-compute[75247]:     </memballoon>
Dec 06 12:46:03 user nova-compute[75247]:   </devices>
Dec 06 12:46:03 user nova-compute[75247]: </domain>
Dec 06 12:46:03 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:45:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1896743252',display_name='tempest-ServerStableDeviceRescueTest-server-1896743252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1896743252',id=19,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvhU73cJfUZBM75WAXDtUdapcw/hxet4znGmOMjhn8KYsa3efoegt+QlsaxBfHHhjJbHGSMnEJuDsqMQgNWlux0I/2LXEwJscpwT1hYARyfH0pcXijK2MYWQok7t1Mf2Q==',key_name='tempest-keypair-203231955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e8f578ae9d44706b68eaac234ae6d65',ramdisk_id='',reservation_id='r-1s4hdg20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-374729134',owner_user_name='tempest-ServerStableDeviceRescueTest-374729134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:46:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4741ba4fd4f48d9a91b5c9d31b7a3ac',uuid=db837c7a-c52d-469b-abf7-cea107454c60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "861bfd56-2888-46b4-b583-08526d05bcd6", "address": "fa:16:3e:eb:bc:82", "network": {"id": "52a97bc9-88b7-430a-80c8-3d6210441943", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1761062078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8f578ae9d44706b68eaac234ae6d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861bfd56-28", "ovs_interfaceid": "861bfd56-2888-46b4-b583-08526d05bcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Converting VIF {"id": "861bfd56-2888-46b4-b583-08526d05bcd6", "address": "fa:16:3e:eb:bc:82", "network": {"id": "52a97bc9-88b7-430a-80c8-3d6210441943", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1761062078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8f578ae9d44706b68eaac234ae6d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861bfd56-28", "ovs_interfaceid": "861bfd56-2888-46b4-b583-08526d05bcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:bc:82,bridge_name='br-int',has_traffic_filtering=True,id=861bfd56-2888-46b4-b583-08526d05bcd6,network=Network(52a97bc9-88b7-430a-80c8-3d6210441943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap861bfd56-28') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG os_vif [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:bc:82,bridge_name='br-int',has_traffic_filtering=True,id=861bfd56-2888-46b4-b583-08526d05bcd6,network=Network(52a97bc9-88b7-430a-80c8-3d6210441943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap861bfd56-28') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25152f71-7034-5689-9e98-8268e42bf50d', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap861bfd56-28, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap861bfd56-28, col_values=(('qos', UUID('5e7a2497-f77f-48e2-b078-caa7cbc382e7')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap861bfd56-28, col_values=(('external_ids', {'iface-id': '861bfd56-2888-46b4-b583-08526d05bcd6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:bc:82', 'vm-uuid': 'db837c7a-c52d-469b-abf7-cea107454c60'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:03 user nova-compute[75247]: INFO os_vif [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:bc:82,bridge_name='br-int',has_traffic_filtering=True,id=861bfd56-2888-46b4-b583-08526d05bcd6,network=Network(52a97bc9-88b7-430a-80c8-3d6210441943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap861bfd56-28')
Dec 06 12:46:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:46:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] No VIF found with MAC fa:16:3e:eb:bc:82, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:46:04 user nova-compute[75247]: DEBUG nova.network.neutron [req-3cb1bd7f-7c41-4e90-83e4-ea473cf3fa6f req-ab3b83ea-9bc0-45c2-b05f-125ae15e46bf service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Updated VIF entry in instance network info cache for port 861bfd56-2888-46b4-b583-08526d05bcd6. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:46:04 user nova-compute[75247]: DEBUG nova.network.neutron [req-3cb1bd7f-7c41-4e90-83e4-ea473cf3fa6f req-ab3b83ea-9bc0-45c2-b05f-125ae15e46bf service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Updating instance_info_cache with network_info: [{"id": "861bfd56-2888-46b4-b583-08526d05bcd6", "address": "fa:16:3e:eb:bc:82", "network": {"id": "52a97bc9-88b7-430a-80c8-3d6210441943", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1761062078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8f578ae9d44706b68eaac234ae6d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861bfd56-28", "ovs_interfaceid": "861bfd56-2888-46b4-b583-08526d05bcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:46:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3cb1bd7f-7c41-4e90-83e4-ea473cf3fa6f req-ab3b83ea-9bc0-45c2-b05f-125ae15e46bf service nova] Releasing lock "refresh_cache-db837c7a-c52d-469b-abf7-cea107454c60" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:46:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Acquiring lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:05 user nova-compute[75247]: DEBUG nova.compute.manager [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:46:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:05 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:46:05 user nova-compute[75247]: INFO nova.compute.claims [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Claim successful on node user
Dec 06 12:46:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:05 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:46:05 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:46:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.751s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:05 user nova-compute[75247]: DEBUG nova.compute.manager [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:46:05 user nova-compute[75247]: DEBUG nova.compute.manager [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:46:05 user nova-compute[75247]: DEBUG nova.network.neutron [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:46:05 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.compute.manager [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.compute.manager [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:46:06 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Creating image(s)
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Did not create local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Ensure instance console log exists: /opt/stack/data/nova/instances/7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Start _get_guest_xml network_info=[{"id": "a079e33d-4b03-49ef-8315-f33edfb30f8f", "address": "fa:16:3e:32:bb:08", "network": {"id": "488711cb-aa26-477a-832a-6a499b8b7c62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-923230583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa079e33d-4b", "ovs_interfaceid": "a079e33d-4b03-49ef-8315-f33edfb30f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d117aa5-7c18-4adb-be72-d785e4905735", "address": "fa:16:3e:b3:6f:7c", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d117aa5-7c", "ovs_interfaceid": "2d117aa5-7c18-4adb-be72-d785e4905735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "681745af-b6fd-4f84-bc98-43bc601c3759", "address": "fa:16:3e:83:ce:7b", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681745af-b6", "ovs_interfaceid": "681745af-b6fd-4f84-bc98-43bc601c3759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b8c474e-894c-43c2-9a4a-0836089a16a1", "address": "fa:16:3e:09:e2:1a", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8c474e-89", "ovs_interfaceid": "7b8c474e-894c-43c2-9a4a-0836089a16a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "267ee847-5894-4c58-8554-e30b91938a6d", "address": "fa:16:3e:72:58:06", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267ee847-58", "ovs_interfaceid": "267ee847-5894-4c58-8554-e30b91938a6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "097e6f29-41d9-4842-a697-ad3d1a1b0d7c", "address": "fa:16:3e:fd:ac:f5", "network": {"id": "7321830d-5ca0-4292-9e4b-c1e160a2b612", "bridge": "br-int", "label": "tempest-device-tagging-net2-5103445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097e6f29-41", "ovs_interfaceid": "097e6f29-41d9-4842-a697-ad3d1a1b0d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c587e85c-ccd5-4bb9-803c-b08aed3baaeb", "address": "fa:16:3e:f9:0b:6e", "network": {"id": "7321830d-5ca0-4292-9e4b-c1e160a2b612", "bridge": "br-int", "label": "tempest-device-tagging-net2-5103445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc587e85c-cc", "ovs_interfaceid": "c587e85c-ccd5-4bb9-803c-b08aed3baaeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'cc22283f-932c-4973-98a4-443afe54ee36', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tWryFSfa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b', 'attached_at': '', 'detached_at': '', 'volume_id': '38f56b17-8536-40fa-aa9c-33f8aae05d8b', 'serial': '38f56b17-8536-40fa-aa9c-33f8aae05d8b'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None}, {'boot_index': 1, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '2448ae1e-767c-4dff-a705-08f5f412ac61', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JAXQZEqg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b', 'attached_at': '', 'detached_at': '', 'volume_id': '7af14201-81e7-40cd-b799-f09628defcfd', 'serial': '7af14201-81e7-40cd-b799-f09628defcfd'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None}, {'boot_index': 2, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'f3145bb0-53cb-454f-93d0-9c853310fa7d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bWcOxIoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b', 'attached_at': '', 'detached_at': '', 'volume_id': '097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1', 'serial': '097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1'}, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:46:06 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:46:06 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tWryFSfa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:46:06 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:46:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:46:06 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:46:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:46:06 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.policy [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf32752c9f2d404b8ee4819e72e1b516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4efbc08c0354cb28d4d62be836f5e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a4c4c8-2efe-4c8a-98ba-dc007e5d0e7c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:46:06 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e229b57f-71d1-4b40-b1a2-a0324a97d9a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b] added
Dec 06 12:46:06 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[617ad8ef-57a3-478d-a2e4-186f048ae00b]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.compute.manager [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:46:06 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Creating image(s)
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "/opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "/opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.035s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.055s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a349a86-beeb-4f09-a30e-ea8a6f2cbf1d]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tWryFSfa {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tWryFSfa" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8561f8c4-8a28-4e85-a003-e74c54e6cc1a]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tWryFSfa'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9798a4-12f9-4d57-aeec-af63da7cb510]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1a81c2-4e2f-4409-8f9a-fada8613bf06]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:06 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:06 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:06 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:06 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:06 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:06 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1a0f1f-f94b-437b-a9b3-f867e593a35c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b, portal: 172.16.0.220,3260]
Dec 06 12:46:06 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b, portal: 172.16.0.220,3260] successful.
Dec 06 12:46:06 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.202s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f0bacf-fc6f-40ad-b6d8-babf86b9b095]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[936836bd-c26d-40fa-819d-689574aa4bf9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:06 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:06 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:06 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:06 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:06 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:06 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:06 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:06 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.520s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36527fa-e761-431b-973c-928218175a08]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tWryFSfa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.253s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk 1073741824" returned: 0 in 0.085s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.346s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.compute.manager [req-d4f0cdb5-a2fa-45ac-bec6-d23524909f8d req-a662cb23-1217-42a7-90ba-0c4b66d90ae9 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received event network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d4f0cdb5-a2fa-45ac-bec6-d23524909f8d req-a662cb23-1217-42a7-90ba-0c4b66d90ae9 service nova] Acquiring lock "db837c7a-c52d-469b-abf7-cea107454c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d4f0cdb5-a2fa-45ac-bec6-d23524909f8d req-a662cb23-1217-42a7-90ba-0c4b66d90ae9 service nova] Lock "db837c7a-c52d-469b-abf7-cea107454c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d4f0cdb5-a2fa-45ac-bec6-d23524909f8d req-a662cb23-1217-42a7-90ba-0c4b66d90ae9 service nova] Lock "db837c7a-c52d-469b-abf7-cea107454c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.compute.manager [req-d4f0cdb5-a2fa-45ac-bec6-d23524909f8d req-a662cb23-1217-42a7-90ba-0c4b66d90ae9 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] No waiting events found dispatching network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:06 user nova-compute[75247]: WARNING nova.compute.manager [req-d4f0cdb5-a2fa-45ac-bec6-d23524909f8d req-a662cb23-1217-42a7-90ba-0c4b66d90ae9 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received unexpected event network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 for instance with vm_state building and task_state spawning.
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:46:06 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75247) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG nova.network.neutron [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Successfully created port: 02bb5689-5d75-4967-b307-862ab2c1fb7f {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:07 user nova-compute[75247]: INFO nova.compute.manager [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Terminating instance
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.282s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG nova.compute.manager [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Cannot resize image /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Ensure instance console log exists: /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.572s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] <== connect_volume: return (1574ms) {'type': 'block', 'scsi_wwn': '23934663837646530', 'path': '/dev/sdc'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934663837646530', 'path': '/dev/sdc'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JAXQZEqg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:46:07 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:46:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:46:07 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:46:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:46:07 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b9da88-e30a-4b46-9bc9-fbc632237327]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:46:07 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3ab8bf-6ee1-4bb1-9c03-e802a3a4180b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd] added
Dec 06 12:46:07 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c043e8e4-7e69-4b30-affe-df3dbc553aa6]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ebdf3b-08f9-4274-9162-16520291b87f]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JAXQZEqg {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JAXQZEqg" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac47ee0-3e2e-4409-b7bc-63ac3014c205]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JAXQZEqg'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG nova.network.neutron [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Successfully updated port: 02bb5689-5d75-4967-b307-862ab2c1fb7f {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Acquiring lock "refresh_cache-ea75ba22-b4af-4454-93ed-cdfdc76a895b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Acquired lock "refresh_cache-ea75ba22-b4af-4454-93ed-cdfdc76a895b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG nova.network.neutron [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c08b0b-4b25-4f45-b800-e59ad87a9492]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG nova.compute.manager [req-c29a3a21-3f3c-4397-84d1-537be7a5e7f0 req-3ee9f5bc-ba1e-43b4-a5da-3e447eba0fa5 service nova] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Received event network-changed-02bb5689-5d75-4967-b307-862ab2c1fb7f {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG nova.compute.manager [req-c29a3a21-3f3c-4397-84d1-537be7a5e7f0 req-3ee9f5bc-ba1e-43b4-a5da-3e447eba0fa5 service nova] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Refreshing instance network info cache due to event network-changed-02bb5689-5d75-4967-b307-862ab2c1fb7f. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c29a3a21-3f3c-4397-84d1-537be7a5e7f0 req-3ee9f5bc-ba1e-43b4-a5da-3e447eba0fa5 service nova] Acquiring lock "refresh_cache-ea75ba22-b4af-4454-93ed-cdfdc76a895b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:46:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d722d56-0d22-4189-8136-5c3eeca22ec7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:08 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:08 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:08 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:08 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:08 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:08 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:08 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:08 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Cleaning up deleted instances {{(pid=75247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] There are 0 instances to clean {{(pid=75247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.network.neutron [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ecc533-523d-433a-b198-92e8670f2743]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd, portal: 172.16.0.220,3260]
Dec 06 12:46:08 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd, portal: 172.16.0.220,3260] successful.
Dec 06 12:46:08 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:08 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Instance destroyed successfully.
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.objects.instance [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lazy-loading 'resources' on Instance uuid ec9eea5d-dc9a-4a65-881a-a89538e3a593 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-740815625',display_name='tempest-AttachVolumeNegativeTest-server-740815625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-740815625',id=6,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmfPng4L5JeOOZpBaUR9V4No179LblAI1enFVcrX82Z+xYTXjk9B+MXKBdY+s63uqbwtVFdjzeWq/zLouKdnDMgMYSROfjndGihLxxoWODJShYjImIOS3rgXN37DY7lxg==',key_name='tempest-keypair-609900860',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:40:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a6b077946334f1c8fd16d091a7738e1',ramdisk_id='',reservation_id='r-4nvivrlo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2136789566',owner_user_name='tempest-AttachVolumeNegativeTest-2136789566-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:40:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d7becd4d5734bc2b652e6f37492eb5e',uuid=ec9eea5d-dc9a-4a65-881a-a89538e3a593,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a205065f-e23d-46b2-9f34-f77ff2b3ebb1", "address": "fa:16:3e:6b:3a:c0", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa205065f-e2", "ovs_interfaceid": "a205065f-e23d-46b2-9f34-f77ff2b3ebb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Converting VIF {"id": "a205065f-e23d-46b2-9f34-f77ff2b3ebb1", "address": "fa:16:3e:6b:3a:c0", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa205065f-e2", "ovs_interfaceid": "a205065f-e23d-46b2-9f34-f77ff2b3ebb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:3a:c0,bridge_name='br-int',has_traffic_filtering=True,id=a205065f-e23d-46b2-9f34-f77ff2b3ebb1,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa205065f-e2') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG os_vif [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:3a:c0,bridge_name='br-int',has_traffic_filtering=True,id=a205065f-e23d-46b2-9f34-f77ff2b3ebb1,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa205065f-e2') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4050cae2-94ad-4a9f-b0e9-1d16d9834170]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa205065f-e2, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c4b6eaea-229f-4cfd-abe4-fb70b9448eeb) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:08 user nova-compute[75247]: INFO os_vif [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:3a:c0,bridge_name='br-int',has_traffic_filtering=True,id=a205065f-e23d-46b2-9f34-f77ff2b3ebb1,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa205065f-e2')
Dec 06 12:46:08 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Deleting instance files /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593_del
Dec 06 12:46:08 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Deletion of /opt/stack/data/nova/instances/ec9eea5d-dc9a-4a65-881a-a89538e3a593_del complete
Dec 06 12:46:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[53038b36-6912-4e75-bdf2-f90f06a155cb]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:08 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:08 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:08 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:08 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:08 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:08 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:08 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:08 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:08 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:08 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.454s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] HCTL ('37', '-', '-', 0) found on session 22 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b4cd9a-eef5-4b24-af07-ed9eabba989d]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JAXQZEqg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:46:08 user nova-compute[75247]: INFO nova.compute.manager [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Took 1.09 seconds to destroy the instance on the hypervisor.
Dec 06 12:46:08 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.network.neutron [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Updating instance_info_cache with network_info: [{"id": "02bb5689-5d75-4967-b307-862ab2c1fb7f", "address": "fa:16:3e:88:36:c4", "network": {"id": "783b08eb-3a13-4dea-a30d-94ce21434b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-358384266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4efbc08c0354cb28d4d62be836f5e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02bb5689-5d", "ovs_interfaceid": "02bb5689-5d75-4967-b307-862ab2c1fb7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Releasing lock "refresh_cache-ea75ba22-b4af-4454-93ed-cdfdc76a895b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Instance network_info: |[{"id": "02bb5689-5d75-4967-b307-862ab2c1fb7f", "address": "fa:16:3e:88:36:c4", "network": {"id": "783b08eb-3a13-4dea-a30d-94ce21434b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-358384266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4efbc08c0354cb28d4d62be836f5e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02bb5689-5d", "ovs_interfaceid": "02bb5689-5d75-4967-b307-862ab2c1fb7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c29a3a21-3f3c-4397-84d1-537be7a5e7f0 req-3ee9f5bc-ba1e-43b4-a5da-3e447eba0fa5 service nova] Acquired lock "refresh_cache-ea75ba22-b4af-4454-93ed-cdfdc76a895b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.network.neutron [req-c29a3a21-3f3c-4397-84d1-537be7a5e7f0 req-3ee9f5bc-ba1e-43b4-a5da-3e447eba0fa5 service nova] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Refreshing network info cache for port 02bb5689-5d75-4967-b307-862ab2c1fb7f {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Start _get_guest_xml network_info=[{"id": "02bb5689-5d75-4967-b307-862ab2c1fb7f", "address": "fa:16:3e:88:36:c4", "network": {"id": "783b08eb-3a13-4dea-a30d-94ce21434b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-358384266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4efbc08c0354cb28d4d62be836f5e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02bb5689-5d", "ovs_interfaceid": "02bb5689-5d75-4967-b307-862ab2c1fb7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:46:08 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:46:08 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:46:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:46:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-665748525',display_name='tempest-VolumesAdminNegativeTest-server-665748525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-665748525',id=20,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQQA+7DSE6583wGnYk/k+1nlvhK4j6yyf7h2HkFbkNbbbCHQs3yFehOjpWcuNMBDHfEJUTWmEoHhm2gOuo3td2hzkIcdmiszifBHS0DZt1HBIGxkWLxjawHtdFSJeAqDQ==',key_name='tempest-keypair-668190557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4efbc08c0354cb28d4d62be836f5e6f',ramdisk_id='',reservation_id='r-h07wrpwu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2088368587',owner_user_name='tempest-VolumesAdminNegativeTest-2088368587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:46:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf32752c9f2d404b8ee4819e72e1b516',uuid=ea75ba22-b4af-4454-93ed-cdfdc76a895b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02bb5689-5d75-4967-b307-862ab2c1fb7f", "address": "fa:16:3e:88:36:c4", "network": {"id": "783b08eb-3a13-4dea-a30d-94ce21434b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-358384266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4efbc08c0354cb28d4d62be836f5e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02bb5689-5d", "ovs_interfaceid": "02bb5689-5d75-4967-b307-862ab2c1fb7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Converting VIF {"id": "02bb5689-5d75-4967-b307-862ab2c1fb7f", "address": "fa:16:3e:88:36:c4", "network": {"id": "783b08eb-3a13-4dea-a30d-94ce21434b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-358384266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4efbc08c0354cb28d4d62be836f5e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02bb5689-5d", "ovs_interfaceid": "02bb5689-5d75-4967-b307-862ab2c1fb7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:36:c4,bridge_name='br-int',has_traffic_filtering=True,id=02bb5689-5d75-4967-b307-862ab2c1fb7f,network=Network(783b08eb-3a13-4dea-a30d-94ce21434b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02bb5689-5d') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.objects.instance [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lazy-loading 'pci_devices' on Instance uuid ea75ba22-b4af-4454-93ed-cdfdc76a895b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:46:08 user nova-compute[75247]:   <uuid>ea75ba22-b4af-4454-93ed-cdfdc76a895b</uuid>
Dec 06 12:46:08 user nova-compute[75247]:   <name>instance-00000014</name>
Dec 06 12:46:08 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:46:08 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:46:08 user nova-compute[75247]:   <metadata>
Dec 06 12:46:08 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:46:08 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:46:08 user nova-compute[75247]:       <nova:name>tempest-VolumesAdminNegativeTest-server-665748525</nova:name>
Dec 06 12:46:08 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:46:08</nova:creationTime>
Dec 06 12:46:08 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:46:08 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:46:08 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:46:08 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:46:08 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:46:08 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:46:08 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:46:08 user nova-compute[75247]:       <nova:owner>
Dec 06 12:46:08 user nova-compute[75247]:         <nova:user uuid="bf32752c9f2d404b8ee4819e72e1b516">tempest-VolumesAdminNegativeTest-2088368587-project-member</nova:user>
Dec 06 12:46:08 user nova-compute[75247]:         <nova:project uuid="e4efbc08c0354cb28d4d62be836f5e6f">tempest-VolumesAdminNegativeTest-2088368587</nova:project>
Dec 06 12:46:08 user nova-compute[75247]:       </nova:owner>
Dec 06 12:46:08 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:46:08 user nova-compute[75247]:       <nova:ports>
Dec 06 12:46:08 user nova-compute[75247]:         <nova:port uuid="02bb5689-5d75-4967-b307-862ab2c1fb7f">
Dec 06 12:46:08 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 06 12:46:08 user nova-compute[75247]:         </nova:port>
Dec 06 12:46:08 user nova-compute[75247]:       </nova:ports>
Dec 06 12:46:08 user nova-compute[75247]:     </nova:instance>
Dec 06 12:46:08 user nova-compute[75247]:   </metadata>
Dec 06 12:46:08 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:46:08 user nova-compute[75247]:     <system>
Dec 06 12:46:08 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:46:08 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:46:08 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:46:08 user nova-compute[75247]:       <entry name="serial">ea75ba22-b4af-4454-93ed-cdfdc76a895b</entry>
Dec 06 12:46:08 user nova-compute[75247]:       <entry name="uuid">ea75ba22-b4af-4454-93ed-cdfdc76a895b</entry>
Dec 06 12:46:08 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:46:08 user nova-compute[75247]:     </system>
Dec 06 12:46:08 user nova-compute[75247]:   </sysinfo>
Dec 06 12:46:08 user nova-compute[75247]:   <os>
Dec 06 12:46:08 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:46:08 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:46:08 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:46:08 user nova-compute[75247]:   </os>
Dec 06 12:46:08 user nova-compute[75247]:   <features>
Dec 06 12:46:08 user nova-compute[75247]:     <acpi/>
Dec 06 12:46:08 user nova-compute[75247]:     <apic/>
Dec 06 12:46:08 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:46:08 user nova-compute[75247]:   </features>
Dec 06 12:46:08 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:46:08 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:46:08 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:46:08 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:46:08 user nova-compute[75247]:   </clock>
Dec 06 12:46:08 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:46:08 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:46:08 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:46:08 user nova-compute[75247]:   </cpu>
Dec 06 12:46:08 user nova-compute[75247]:   <devices>
Dec 06 12:46:08 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:46:08 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:46:08 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk"/>
Dec 06 12:46:08 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:46:08 user nova-compute[75247]:     </disk>
Dec 06 12:46:08 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:46:08 user nova-compute[75247]:       <mac address="fa:16:3e:88:36:c4"/>
Dec 06 12:46:08 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:46:08 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:46:08 user nova-compute[75247]:       <target dev="tap02bb5689-5d"/>
Dec 06 12:46:08 user nova-compute[75247]:     </interface>
Dec 06 12:46:08 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:46:08 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/console.log" append="off"/>
Dec 06 12:46:08 user nova-compute[75247]:     </serial>
Dec 06 12:46:08 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:46:08 user nova-compute[75247]:     <video>
Dec 06 12:46:08 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:46:08 user nova-compute[75247]:     </video>
Dec 06 12:46:08 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:46:08 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:46:08 user nova-compute[75247]:     </rng>
Dec 06 12:46:08 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:46:08 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:46:08 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:46:08 user nova-compute[75247]:     </memballoon>
Dec 06 12:46:08 user nova-compute[75247]:   </devices>
Dec 06 12:46:08 user nova-compute[75247]: </domain>
Dec 06 12:46:08 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:46:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-665748525',display_name='tempest-VolumesAdminNegativeTest-server-665748525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-665748525',id=20,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQQA+7DSE6583wGnYk/k+1nlvhK4j6yyf7h2HkFbkNbbbCHQs3yFehOjpWcuNMBDHfEJUTWmEoHhm2gOuo3td2hzkIcdmiszifBHS0DZt1HBIGxkWLxjawHtdFSJeAqDQ==',key_name='tempest-keypair-668190557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4efbc08c0354cb28d4d62be836f5e6f',ramdisk_id='',reservation_id='r-h07wrpwu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2088368587',owner_user_name='tempest-VolumesAdminNegativeTest-2088368587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:46:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf32752c9f2d404b8ee4819e72e1b516',uuid=ea75ba22-b4af-4454-93ed-cdfdc76a895b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02bb5689-5d75-4967-b307-862ab2c1fb7f", "address": "fa:16:3e:88:36:c4", "network": {"id": "783b08eb-3a13-4dea-a30d-94ce21434b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-358384266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4efbc08c0354cb28d4d62be836f5e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02bb5689-5d", "ovs_interfaceid": "02bb5689-5d75-4967-b307-862ab2c1fb7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Converting VIF {"id": "02bb5689-5d75-4967-b307-862ab2c1fb7f", "address": "fa:16:3e:88:36:c4", "network": {"id": "783b08eb-3a13-4dea-a30d-94ce21434b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-358384266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4efbc08c0354cb28d4d62be836f5e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02bb5689-5d", "ovs_interfaceid": "02bb5689-5d75-4967-b307-862ab2c1fb7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:36:c4,bridge_name='br-int',has_traffic_filtering=True,id=02bb5689-5d75-4967-b307-862ab2c1fb7f,network=Network(783b08eb-3a13-4dea-a30d-94ce21434b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02bb5689-5d') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG os_vif [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:36:c4,bridge_name='br-int',has_traffic_filtering=True,id=02bb5689-5d75-4967-b307-862ab2c1fb7f,network=Network(783b08eb-3a13-4dea-a30d-94ce21434b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02bb5689-5d') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f343202-b17c-51e2-94eb-7e8b217fd869', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02bb5689-5d, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap02bb5689-5d, col_values=(('qos', UUID('3269f323-969e-4d3f-aa44-65d76e44dab6')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap02bb5689-5d, col_values=(('external_ids', {'iface-id': '02bb5689-5d75-4967-b307-862ab2c1fb7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:36:c4', 'vm-uuid': 'ea75ba22-b4af-4454-93ed-cdfdc76a895b'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:08 user nova-compute[75247]: INFO os_vif [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:36:c4,bridge_name='br-int',has_traffic_filtering=True,id=02bb5689-5d75-4967-b307-862ab2c1fb7f,network=Network(783b08eb-3a13-4dea-a30d-94ce21434b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02bb5689-5d')
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:46:08 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Instance spawned successfully.
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:46:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Skipping network cache update for instance because it is being deleted. {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG nova.compute.manager [req-07b2f684-cd7d-41cf-807e-a52b0a2b9eb7 req-e8e4cea6-ea7b-4b79-8e5b-bd15836ba403 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received event network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-07b2f684-cd7d-41cf-807e-a52b0a2b9eb7 req-e8e4cea6-ea7b-4b79-8e5b-bd15836ba403 service nova] Acquiring lock "db837c7a-c52d-469b-abf7-cea107454c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-07b2f684-cd7d-41cf-807e-a52b0a2b9eb7 req-e8e4cea6-ea7b-4b79-8e5b-bd15836ba403 service nova] Lock "db837c7a-c52d-469b-abf7-cea107454c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-07b2f684-cd7d-41cf-807e-a52b0a2b9eb7 req-e8e4cea6-ea7b-4b79-8e5b-bd15836ba403 service nova] Lock "db837c7a-c52d-469b-abf7-cea107454c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG nova.compute.manager [req-07b2f684-cd7d-41cf-807e-a52b0a2b9eb7 req-e8e4cea6-ea7b-4b79-8e5b-bd15836ba403 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] No waiting events found dispatching network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:09 user nova-compute[75247]: WARNING nova.compute.manager [req-07b2f684-cd7d-41cf-807e-a52b0a2b9eb7 req-e8e4cea6-ea7b-4b79-8e5b-bd15836ba403 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received unexpected event network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 for instance with vm_state building and task_state spawning.
Dec 06 12:46:09 user nova-compute[75247]: DEBUG nova.compute.manager [req-07b2f684-cd7d-41cf-807e-a52b0a2b9eb7 req-e8e4cea6-ea7b-4b79-8e5b-bd15836ba403 service nova] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Received event network-vif-unplugged-a205065f-e23d-46b2-9f34-f77ff2b3ebb1 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-07b2f684-cd7d-41cf-807e-a52b0a2b9eb7 req-e8e4cea6-ea7b-4b79-8e5b-bd15836ba403 service nova] Acquiring lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-07b2f684-cd7d-41cf-807e-a52b0a2b9eb7 req-e8e4cea6-ea7b-4b79-8e5b-bd15836ba403 service nova] Lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-07b2f684-cd7d-41cf-807e-a52b0a2b9eb7 req-e8e4cea6-ea7b-4b79-8e5b-bd15836ba403 service nova] Lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG nova.compute.manager [req-07b2f684-cd7d-41cf-807e-a52b0a2b9eb7 req-e8e4cea6-ea7b-4b79-8e5b-bd15836ba403 service nova] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] No waiting events found dispatching network-vif-unplugged-a205065f-e23d-46b2-9f34-f77ff2b3ebb1 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG nova.compute.manager [req-07b2f684-cd7d-41cf-807e-a52b0a2b9eb7 req-e8e4cea6-ea7b-4b79-8e5b-bd15836ba403 service nova] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Received event network-vif-unplugged-a205065f-e23d-46b2-9f34-f77ff2b3ebb1 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG nova.compute.manager [req-07b2f684-cd7d-41cf-807e-a52b0a2b9eb7 req-e8e4cea6-ea7b-4b79-8e5b-bd15836ba403 service nova] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Received event network-vif-plugged-a205065f-e23d-46b2-9f34-f77ff2b3ebb1 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-07b2f684-cd7d-41cf-807e-a52b0a2b9eb7 req-e8e4cea6-ea7b-4b79-8e5b-bd15836ba403 service nova] Acquiring lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-07b2f684-cd7d-41cf-807e-a52b0a2b9eb7 req-e8e4cea6-ea7b-4b79-8e5b-bd15836ba403 service nova] Lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-07b2f684-cd7d-41cf-807e-a52b0a2b9eb7 req-e8e4cea6-ea7b-4b79-8e5b-bd15836ba403 service nova] Lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG nova.compute.manager [req-07b2f684-cd7d-41cf-807e-a52b0a2b9eb7 req-e8e4cea6-ea7b-4b79-8e5b-bd15836ba403 service nova] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] No waiting events found dispatching network-vif-plugged-a205065f-e23d-46b2-9f34-f77ff2b3ebb1 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:09 user nova-compute[75247]: WARNING nova.compute.manager [req-07b2f684-cd7d-41cf-807e-a52b0a2b9eb7 req-e8e4cea6-ea7b-4b79-8e5b-bd15836ba403 service nova] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Received unexpected event network-vif-plugged-a205065f-e23d-46b2-9f34-f77ff2b3ebb1 for instance with vm_state active and task_state deleting.
Dec 06 12:46:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] No VIF found with MAC fa:16:3e:88:36:c4, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:46:09 user nova-compute[75247]: INFO nova.compute.manager [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Took 7.98 seconds to spawn the instance on the hypervisor.
Dec 06 12:46:09 user nova-compute[75247]: DEBUG nova.compute.manager [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Didn't find any instances for network info cache update. {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.508s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] <== connect_volume: return (1511ms) {'type': 'block', 'scsi_wwn': '23064323633333765', 'path': '/dev/sdf'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064323633333765', 'path': '/dev/sdf'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bWcOxIoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:46:09 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:46:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:46:09 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:46:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:46:09 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 -p 172.16.0.220:3260" returned: 21 in 0.034s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0380d2e-3808-4693-9866-084d89fb2790]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:46:09 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:09 user nova-compute[75247]: INFO nova.compute.manager [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Took 9.31 seconds to build instance.
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e513fc-fc0b-409e-8593-d3d0568a9e62]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1] added
Dec 06 12:46:09 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-795cddd9-2e4a-4ddb-a1eb-e6112397b8b1 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "db837c7a-c52d-469b-abf7-cea107454c60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.473s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7965be-e350-46bb-9189-3c97e8619e1d]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e654c33-fac3-49fa-9c80-4feaf15507e1]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bWcOxIoP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bWcOxIoP" returned: 0 in 0.029s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[be908799-ca49-4d29-b318-5e26b447c24e]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bWcOxIoP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c72071e-eff5-426b-8b12-1a6b420376d8]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0ad4e4-d64f-4f9d-b9e0-21e26796d6e9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:09 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:09 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:09 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:09 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:09 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:09 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:09 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:09 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:09 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:09 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 -p 172.16.0.220:3260 --login" returned: 0 in 0.117s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29b818d-c124-47f0-9188-503d37feb3ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1, portal: 172.16.0.220,3260]
Dec 06 12:46:09 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1, portal: 172.16.0.220,3260] successful.
Dec 06 12:46:09 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb03891-6004-4956-a714-3e283b197c75]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c279f553-fd6e-40f4-994d-6f8ded4dc978]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:09 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:09 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:09 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:09 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:09 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:09 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:09 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:09 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:09 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:09 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:09 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:09 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.479s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] HCTL ('38', '-', '-', 0) found on session 23 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c068c596-e6c5-49c1-a23b-3cce4a9d1a5d]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Searching for a device in session 23 and hctl ['38', '*', '*', 0] yield: None {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG nova.network.neutron [req-c29a3a21-3f3c-4397-84d1-537be7a5e7f0 req-3ee9f5bc-ba1e-43b4-a5da-3e447eba0fa5 service nova] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Updated VIF entry in instance network info cache for port 02bb5689-5d75-4967-b307-862ab2c1fb7f. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG nova.network.neutron [req-c29a3a21-3f3c-4397-84d1-537be7a5e7f0 req-3ee9f5bc-ba1e-43b4-a5da-3e447eba0fa5 service nova] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Updating instance_info_cache with network_info: [{"id": "02bb5689-5d75-4967-b307-862ab2c1fb7f", "address": "fa:16:3e:88:36:c4", "network": {"id": "783b08eb-3a13-4dea-a30d-94ce21434b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-358384266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4efbc08c0354cb28d4d62be836f5e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02bb5689-5d", "ovs_interfaceid": "02bb5689-5d75-4967-b307-862ab2c1fb7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:09 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c29a3a21-3f3c-4397-84d1-537be7a5e7f0 req-3ee9f5bc-ba1e-43b4-a5da-3e447eba0fa5 service nova] Releasing lock "refresh_cache-ea75ba22-b4af-4454-93ed-cdfdc76a895b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:46:10 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Took 1.96 seconds to deallocate network for instance.
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-765249a4-898b-4d60-bcf8-4de0e7dcf228 req-922b81fc-9b09-4396-aeba-232097b32071 service nova] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Received event network-vif-deleted-a205065f-e23d-46b2-9f34-f77ff2b3ebb1 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:10 user nova-compute[75247]: INFO nova.compute.manager [req-765249a4-898b-4d60-bcf8-4de0e7dcf228 req-922b81fc-9b09-4396-aeba-232097b32071 service nova] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Neutron deleted interface a205065f-e23d-46b2-9f34-f77ff2b3ebb1; detaching it from the instance and deleting it from the info cache
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.network.neutron [req-765249a4-898b-4d60-bcf8-4de0e7dcf228 req-922b81fc-9b09-4396-aeba-232097b32071 service nova] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-765249a4-898b-4d60-bcf8-4de0e7dcf228 req-922b81fc-9b09-4396-aeba-232097b32071 service nova] [instance: ec9eea5d-dc9a-4a65-881a-a89538e3a593] Detach interface failed, port_id=a205065f-e23d-46b2-9f34-f77ff2b3ebb1, reason: Instance ec9eea5d-dc9a-4a65-881a-a89538e3a593 could not be found. {{(pid=75247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Refreshing inventories for resource provider d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Updating ProviderTree inventory for provider d326b140-3450-4409-964c-9eafc6cc025d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Updating inventory in ProviderTree for provider d326b140-3450-4409-964c-9eafc6cc025d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Refreshing aggregate associations for resource provider d326b140-3450-4409-964c-9eafc6cc025d, aggregates: None {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Searching for a device in session 23 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bWcOxIoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.525s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] <== connect_volume: return (1527ms) {'type': 'block', 'scsi_wwn': '23139366234633339', 'path': '/dev/sdg'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139366234633339', 'path': '/dev/sdg'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286975828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-286975828',id=17,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2B8SHWnL5XT3DWY3gquaeb2zxCHvGF8t4a4ubj3jQmPtq9XBRNZCZWWoSYLM9FvzsvWTog0uix/tXd4joK1Eq8bokONhA/MCcUOpQ0086wGcwdflAWagcdXNUdya2xZw==',key_name='tempest-keypair-684324006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66b95bb1359241ee8d2cf5015640a2b8',ramdisk_id='',reservation_id='r-6ft38hg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1989495369',owner_user_name='tempest-TaggedBootDevicesTest_v242-1989495369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:45:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9e5d32fc34046bcbf517062fe52f1a8',uuid=7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a079e33d-4b03-49ef-8315-f33edfb30f8f", "address": "fa:16:3e:32:bb:08", "network": {"id": "488711cb-aa26-477a-832a-6a499b8b7c62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-923230583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa079e33d-4b", "ovs_interfaceid": "a079e33d-4b03-49ef-8315-f33edfb30f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converting VIF {"id": "a079e33d-4b03-49ef-8315-f33edfb30f8f", "address": "fa:16:3e:32:bb:08", "network": {"id": "488711cb-aa26-477a-832a-6a499b8b7c62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-923230583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa079e33d-4b", "ovs_interfaceid": "a079e33d-4b03-49ef-8315-f33edfb30f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:bb:08,bridge_name='br-int',has_traffic_filtering=True,id=a079e33d-4b03-49ef-8315-f33edfb30f8f,network=Network(488711cb-aa26-477a-832a-6a499b8b7c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa079e33d-4b') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286975828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-286975828',id=17,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2B8SHWnL5XT3DWY3gquaeb2zxCHvGF8t4a4ubj3jQmPtq9XBRNZCZWWoSYLM9FvzsvWTog0uix/tXd4joK1Eq8bokONhA/MCcUOpQ0086wGcwdflAWagcdXNUdya2xZw==',key_name='tempest-keypair-684324006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66b95bb1359241ee8d2cf5015640a2b8',ramdisk_id='',reservation_id='r-6ft38hg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1989495369',owner_user_name='tempest-TaggedBootDevicesTest_v242-1989495369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:45:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9e5d32fc34046bcbf517062fe52f1a8',uuid=7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d117aa5-7c18-4adb-be72-d785e4905735", "address": "fa:16:3e:b3:6f:7c", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d117aa5-7c", "ovs_interfaceid": "2d117aa5-7c18-4adb-be72-d785e4905735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converting VIF {"id": "2d117aa5-7c18-4adb-be72-d785e4905735", "address": "fa:16:3e:b3:6f:7c", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d117aa5-7c", "ovs_interfaceid": "2d117aa5-7c18-4adb-be72-d785e4905735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:6f:7c,bridge_name='br-int',has_traffic_filtering=True,id=2d117aa5-7c18-4adb-be72-d785e4905735,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2d117aa5-7c') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286975828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-286975828',id=17,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2B8SHWnL5XT3DWY3gquaeb2zxCHvGF8t4a4ubj3jQmPtq9XBRNZCZWWoSYLM9FvzsvWTog0uix/tXd4joK1Eq8bokONhA/MCcUOpQ0086wGcwdflAWagcdXNUdya2xZw==',key_name='tempest-keypair-684324006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66b95bb1359241ee8d2cf5015640a2b8',ramdisk_id='',reservation_id='r-6ft38hg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1989495369',owner_user_name='tempest-TaggedBootDevicesTest_v242-1989495369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:45:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9e5d32fc34046bcbf517062fe52f1a8',uuid=7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "681745af-b6fd-4f84-bc98-43bc601c3759", "address": "fa:16:3e:83:ce:7b", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681745af-b6", "ovs_interfaceid": "681745af-b6fd-4f84-bc98-43bc601c3759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converting VIF {"id": "681745af-b6fd-4f84-bc98-43bc601c3759", "address": "fa:16:3e:83:ce:7b", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681745af-b6", "ovs_interfaceid": "681745af-b6fd-4f84-bc98-43bc601c3759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:ce:7b,bridge_name='br-int',has_traffic_filtering=True,id=681745af-b6fd-4f84-bc98-43bc601c3759,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap681745af-b6') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286975828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-286975828',id=17,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2B8SHWnL5XT3DWY3gquaeb2zxCHvGF8t4a4ubj3jQmPtq9XBRNZCZWWoSYLM9FvzsvWTog0uix/tXd4joK1Eq8bokONhA/MCcUOpQ0086wGcwdflAWagcdXNUdya2xZw==',key_name='tempest-keypair-684324006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66b95bb1359241ee8d2cf5015640a2b8',ramdisk_id='',reservation_id='r-6ft38hg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1989495369',owner_user_name='tempest-TaggedBootDevicesTest_v242-1989495369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:45:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9e5d32fc34046bcbf517062fe52f1a8',uuid=7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b8c474e-894c-43c2-9a4a-0836089a16a1", "address": "fa:16:3e:09:e2:1a", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8c474e-89", "ovs_interfaceid": "7b8c474e-894c-43c2-9a4a-0836089a16a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converting VIF {"id": "7b8c474e-894c-43c2-9a4a-0836089a16a1", "address": "fa:16:3e:09:e2:1a", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8c474e-89", "ovs_interfaceid": "7b8c474e-894c-43c2-9a4a-0836089a16a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:e2:1a,bridge_name='br-int',has_traffic_filtering=True,id=7b8c474e-894c-43c2-9a4a-0836089a16a1,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b8c474e-89') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286975828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-286975828',id=17,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2B8SHWnL5XT3DWY3gquaeb2zxCHvGF8t4a4ubj3jQmPtq9XBRNZCZWWoSYLM9FvzsvWTog0uix/tXd4joK1Eq8bokONhA/MCcUOpQ0086wGcwdflAWagcdXNUdya2xZw==',key_name='tempest-keypair-684324006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66b95bb1359241ee8d2cf5015640a2b8',ramdisk_id='',reservation_id='r-6ft38hg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1989495369',owner_user_name='tempest-TaggedBootDevicesTest_v242-1989495369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:45:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9e5d32fc34046bcbf517062fe52f1a8',uuid=7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "267ee847-5894-4c58-8554-e30b91938a6d", "address": "fa:16:3e:72:58:06", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267ee847-58", "ovs_interfaceid": "267ee847-5894-4c58-8554-e30b91938a6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converting VIF {"id": "267ee847-5894-4c58-8554-e30b91938a6d", "address": "fa:16:3e:72:58:06", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267ee847-58", "ovs_interfaceid": "267ee847-5894-4c58-8554-e30b91938a6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:58:06,bridge_name='br-int',has_traffic_filtering=True,id=267ee847-5894-4c58-8554-e30b91938a6d,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267ee847-58') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286975828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-286975828',id=17,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2B8SHWnL5XT3DWY3gquaeb2zxCHvGF8t4a4ubj3jQmPtq9XBRNZCZWWoSYLM9FvzsvWTog0uix/tXd4joK1Eq8bokONhA/MCcUOpQ0086wGcwdflAWagcdXNUdya2xZw==',key_name='tempest-keypair-684324006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66b95bb1359241ee8d2cf5015640a2b8',ramdisk_id='',reservation_id='r-6ft38hg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1989495369',owner_user_name='tempest-TaggedBootDevicesTest_v242-1989495369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:45:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9e5d32fc34046bcbf517062fe52f1a8',uuid=7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "097e6f29-41d9-4842-a697-ad3d1a1b0d7c", "address": "fa:16:3e:fd:ac:f5", "network": {"id": "7321830d-5ca0-4292-9e4b-c1e160a2b612", "bridge": "br-int", "label": "tempest-device-tagging-net2-5103445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097e6f29-41", "ovs_interfaceid": "097e6f29-41d9-4842-a697-ad3d1a1b0d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converting VIF {"id": "097e6f29-41d9-4842-a697-ad3d1a1b0d7c", "address": "fa:16:3e:fd:ac:f5", "network": {"id": "7321830d-5ca0-4292-9e4b-c1e160a2b612", "bridge": "br-int", "label": "tempest-device-tagging-net2-5103445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097e6f29-41", "ovs_interfaceid": "097e6f29-41d9-4842-a697-ad3d1a1b0d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:ac:f5,bridge_name='br-int',has_traffic_filtering=True,id=097e6f29-41d9-4842-a697-ad3d1a1b0d7c,network=Network(7321830d-5ca0-4292-9e4b-c1e160a2b612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap097e6f29-41') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286975828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-286975828',id=17,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2B8SHWnL5XT3DWY3gquaeb2zxCHvGF8t4a4ubj3jQmPtq9XBRNZCZWWoSYLM9FvzsvWTog0uix/tXd4joK1Eq8bokONhA/MCcUOpQ0086wGcwdflAWagcdXNUdya2xZw==',key_name='tempest-keypair-684324006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66b95bb1359241ee8d2cf5015640a2b8',ramdisk_id='',reservation_id='r-6ft38hg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1989495369',owner_user_name='tempest-TaggedBootDevicesTest_v242-1989495369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:45:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9e5d32fc34046bcbf517062fe52f1a8',uuid=7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c587e85c-ccd5-4bb9-803c-b08aed3baaeb", "address": "fa:16:3e:f9:0b:6e", "network": {"id": "7321830d-5ca0-4292-9e4b-c1e160a2b612", "bridge": "br-int", "label": "tempest-device-tagging-net2-5103445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc587e85c-cc", "ovs_interfaceid": "c587e85c-ccd5-4bb9-803c-b08aed3baaeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converting VIF {"id": "c587e85c-ccd5-4bb9-803c-b08aed3baaeb", "address": "fa:16:3e:f9:0b:6e", "network": {"id": "7321830d-5ca0-4292-9e4b-c1e160a2b612", "bridge": "br-int", "label": "tempest-device-tagging-net2-5103445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc587e85c-cc", "ovs_interfaceid": "c587e85c-ccd5-4bb9-803c-b08aed3baaeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:0b:6e,bridge_name='br-int',has_traffic_filtering=True,id=c587e85c-ccd5-4bb9-803c-b08aed3baaeb,network=Network(7321830d-5ca0-4292-9e4b-c1e160a2b612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc587e85c-cc') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.objects.instance [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lazy-loading 'pci_devices' on Instance uuid 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Refreshing trait associations for resource provider d326b140-3450-4409-964c-9eafc6cc025d, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 12:46:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:46:11 user nova-compute[75247]:   <uuid>7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b</uuid>
Dec 06 12:46:11 user nova-compute[75247]:   <name>instance-00000011</name>
Dec 06 12:46:11 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:46:11 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:46:11 user nova-compute[75247]:   <metadata>
Dec 06 12:46:11 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:46:11 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:46:11 user nova-compute[75247]:       <nova:name>tempest-device-tagging-server-286975828</nova:name>
Dec 06 12:46:11 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:46:06</nova:creationTime>
Dec 06 12:46:11 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:46:11 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:46:11 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:46:11 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:46:11 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:46:11 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:46:11 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:46:11 user nova-compute[75247]:       <nova:owner>
Dec 06 12:46:11 user nova-compute[75247]:         <nova:user uuid="f9e5d32fc34046bcbf517062fe52f1a8">tempest-TaggedBootDevicesTest_v242-1989495369-project-member</nova:user>
Dec 06 12:46:11 user nova-compute[75247]:         <nova:project uuid="66b95bb1359241ee8d2cf5015640a2b8">tempest-TaggedBootDevicesTest_v242-1989495369</nova:project>
Dec 06 12:46:11 user nova-compute[75247]:       </nova:owner>
Dec 06 12:46:11 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:46:11 user nova-compute[75247]:       <nova:ports>
Dec 06 12:46:11 user nova-compute[75247]:         <nova:port uuid="a079e33d-4b03-49ef-8315-f33edfb30f8f">
Dec 06 12:46:11 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 06 12:46:11 user nova-compute[75247]:         </nova:port>
Dec 06 12:46:11 user nova-compute[75247]:         <nova:port uuid="2d117aa5-7c18-4adb-be72-d785e4905735">
Dec 06 12:46:11 user nova-compute[75247]:           <nova:ip type="fixed" address="10.1.1.22" ipVersion="4"/>
Dec 06 12:46:11 user nova-compute[75247]:         </nova:port>
Dec 06 12:46:11 user nova-compute[75247]:         <nova:port uuid="681745af-b6fd-4f84-bc98-43bc601c3759">
Dec 06 12:46:11 user nova-compute[75247]:           <nova:ip type="fixed" address="10.1.1.83" ipVersion="4"/>
Dec 06 12:46:11 user nova-compute[75247]:         </nova:port>
Dec 06 12:46:11 user nova-compute[75247]:         <nova:port uuid="7b8c474e-894c-43c2-9a4a-0836089a16a1">
Dec 06 12:46:11 user nova-compute[75247]:           <nova:ip type="fixed" address="10.1.1.204" ipVersion="4"/>
Dec 06 12:46:11 user nova-compute[75247]:         </nova:port>
Dec 06 12:46:11 user nova-compute[75247]:         <nova:port uuid="267ee847-5894-4c58-8554-e30b91938a6d">
Dec 06 12:46:11 user nova-compute[75247]:           <nova:ip type="fixed" address="10.1.1.107" ipVersion="4"/>
Dec 06 12:46:11 user nova-compute[75247]:         </nova:port>
Dec 06 12:46:11 user nova-compute[75247]:         <nova:port uuid="097e6f29-41d9-4842-a697-ad3d1a1b0d7c">
Dec 06 12:46:11 user nova-compute[75247]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Dec 06 12:46:11 user nova-compute[75247]:         </nova:port>
Dec 06 12:46:11 user nova-compute[75247]:         <nova:port uuid="c587e85c-ccd5-4bb9-803c-b08aed3baaeb">
Dec 06 12:46:11 user nova-compute[75247]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Dec 06 12:46:11 user nova-compute[75247]:         </nova:port>
Dec 06 12:46:11 user nova-compute[75247]:       </nova:ports>
Dec 06 12:46:11 user nova-compute[75247]:     </nova:instance>
Dec 06 12:46:11 user nova-compute[75247]:   </metadata>
Dec 06 12:46:11 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:46:11 user nova-compute[75247]:     <system>
Dec 06 12:46:11 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:46:11 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:46:11 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:46:11 user nova-compute[75247]:       <entry name="serial">7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b</entry>
Dec 06 12:46:11 user nova-compute[75247]:       <entry name="uuid">7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b</entry>
Dec 06 12:46:11 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:46:11 user nova-compute[75247]:     </system>
Dec 06 12:46:11 user nova-compute[75247]:   </sysinfo>
Dec 06 12:46:11 user nova-compute[75247]:   <os>
Dec 06 12:46:11 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:46:11 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:46:11 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:46:11 user nova-compute[75247]:   </os>
Dec 06 12:46:11 user nova-compute[75247]:   <features>
Dec 06 12:46:11 user nova-compute[75247]:     <acpi/>
Dec 06 12:46:11 user nova-compute[75247]:     <apic/>
Dec 06 12:46:11 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:46:11 user nova-compute[75247]:   </features>
Dec 06 12:46:11 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:46:11 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:46:11 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:46:11 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:46:11 user nova-compute[75247]:   </clock>
Dec 06 12:46:11 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:46:11 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:46:11 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:46:11 user nova-compute[75247]:   </cpu>
Dec 06 12:46:11 user nova-compute[75247]:   <devices>
Dec 06 12:46:11 user nova-compute[75247]:     <disk type="file" device="cdrom">
Dec 06 12:46:11 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none"/>
Dec 06 12:46:11 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b/disk.config"/>
Dec 06 12:46:11 user nova-compute[75247]:       <target dev="hda" bus="ide"/>
Dec 06 12:46:11 user nova-compute[75247]:     </disk>
Dec 06 12:46:11 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 12:46:11 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:46:11 user nova-compute[75247]:       <source dev="/dev/sdc"/>
Dec 06 12:46:11 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:46:11 user nova-compute[75247]:       <serial>38f56b17-8536-40fa-aa9c-33f8aae05d8b</serial>
Dec 06 12:46:11 user nova-compute[75247]:     </disk>
Dec 06 12:46:11 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 12:46:11 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:46:11 user nova-compute[75247]:       <source dev="/dev/sdf"/>
Dec 06 12:46:11 user nova-compute[75247]:       <target dev="vdb" bus="virtio"/>
Dec 06 12:46:11 user nova-compute[75247]:       <serial>7af14201-81e7-40cd-b799-f09628defcfd</serial>
Dec 06 12:46:11 user nova-compute[75247]:     </disk>
Dec 06 12:46:11 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 12:46:11 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:46:11 user nova-compute[75247]:       <source dev="/dev/sdg"/>
Dec 06 12:46:11 user nova-compute[75247]:       <target dev="vdc" bus="virtio"/>
Dec 06 12:46:11 user nova-compute[75247]:       <serial>097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1</serial>
Dec 06 12:46:11 user nova-compute[75247]:     </disk>
Dec 06 12:46:11 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:46:11 user nova-compute[75247]:       <mac address="fa:16:3e:32:bb:08"/>
Dec 06 12:46:11 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:46:11 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:46:11 user nova-compute[75247]:       <target dev="tapa079e33d-4b"/>
Dec 06 12:46:11 user nova-compute[75247]:     </interface>
Dec 06 12:46:11 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:46:11 user nova-compute[75247]:       <mac address="fa:16:3e:b3:6f:7c"/>
Dec 06 12:46:11 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:46:11 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:46:11 user nova-compute[75247]:       <target dev="tap2d117aa5-7c"/>
Dec 06 12:46:11 user nova-compute[75247]:     </interface>
Dec 06 12:46:11 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:46:11 user nova-compute[75247]:       <mac address="fa:16:3e:83:ce:7b"/>
Dec 06 12:46:11 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:46:11 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:46:11 user nova-compute[75247]:       <target dev="tap681745af-b6"/>
Dec 06 12:46:11 user nova-compute[75247]:     </interface>
Dec 06 12:46:11 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:46:11 user nova-compute[75247]:       <mac address="fa:16:3e:09:e2:1a"/>
Dec 06 12:46:11 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:46:11 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:46:11 user nova-compute[75247]:       <target dev="tap7b8c474e-89"/>
Dec 06 12:46:11 user nova-compute[75247]:     </interface>
Dec 06 12:46:11 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:46:11 user nova-compute[75247]:       <mac address="fa:16:3e:72:58:06"/>
Dec 06 12:46:11 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:46:11 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:46:11 user nova-compute[75247]:       <target dev="tap267ee847-58"/>
Dec 06 12:46:11 user nova-compute[75247]:     </interface>
Dec 06 12:46:11 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:46:11 user nova-compute[75247]:       <mac address="fa:16:3e:fd:ac:f5"/>
Dec 06 12:46:11 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:46:11 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:46:11 user nova-compute[75247]:       <target dev="tap097e6f29-41"/>
Dec 06 12:46:11 user nova-compute[75247]:     </interface>
Dec 06 12:46:11 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:46:11 user nova-compute[75247]:       <mac address="fa:16:3e:f9:0b:6e"/>
Dec 06 12:46:11 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:46:11 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:46:11 user nova-compute[75247]:       <target dev="tapc587e85c-cc"/>
Dec 06 12:46:11 user nova-compute[75247]:     </interface>
Dec 06 12:46:11 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:46:11 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b/console.log" append="off"/>
Dec 06 12:46:11 user nova-compute[75247]:     </serial>
Dec 06 12:46:11 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:46:11 user nova-compute[75247]:     <video>
Dec 06 12:46:11 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:46:11 user nova-compute[75247]:     </video>
Dec 06 12:46:11 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:46:11 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:46:11 user nova-compute[75247]:     </rng>
Dec 06 12:46:11 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:46:11 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:46:11 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:46:11 user nova-compute[75247]:     </memballoon>
Dec 06 12:46:11 user nova-compute[75247]:   </devices>
Dec 06 12:46:11 user nova-compute[75247]: </domain>
Dec 06 12:46:11 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286975828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-286975828',id=17,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2B8SHWnL5XT3DWY3gquaeb2zxCHvGF8t4a4ubj3jQmPtq9XBRNZCZWWoSYLM9FvzsvWTog0uix/tXd4joK1Eq8bokONhA/MCcUOpQ0086wGcwdflAWagcdXNUdya2xZw==',key_name='tempest-keypair-684324006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66b95bb1359241ee8d2cf5015640a2b8',ramdisk_id='',reservation_id='r-6ft38hg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1989495369',owner_user_name='tempest-TaggedBootDevicesTest_v242-1989495369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:45:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9e5d32fc34046bcbf517062fe52f1a8',uuid=7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a079e33d-4b03-49ef-8315-f33edfb30f8f", "address": "fa:16:3e:32:bb:08", "network": {"id": "488711cb-aa26-477a-832a-6a499b8b7c62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-923230583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa079e33d-4b", "ovs_interfaceid": "a079e33d-4b03-49ef-8315-f33edfb30f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converting VIF {"id": "a079e33d-4b03-49ef-8315-f33edfb30f8f", "address": "fa:16:3e:32:bb:08", "network": {"id": "488711cb-aa26-477a-832a-6a499b8b7c62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-923230583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa079e33d-4b", "ovs_interfaceid": "a079e33d-4b03-49ef-8315-f33edfb30f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:bb:08,bridge_name='br-int',has_traffic_filtering=True,id=a079e33d-4b03-49ef-8315-f33edfb30f8f,network=Network(488711cb-aa26-477a-832a-6a499b8b7c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa079e33d-4b') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG os_vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:bb:08,bridge_name='br-int',has_traffic_filtering=True,id=a079e33d-4b03-49ef-8315-f33edfb30f8f,network=Network(488711cb-aa26-477a-832a-6a499b8b7c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa079e33d-4b') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd03a72d0-09db-5e80-aece-fd174e3e9412', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa079e33d-4b, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa079e33d-4b, col_values=(('qos', UUID('e9e7c527-10e5-4e61-9938-deea3a467fcb')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa079e33d-4b, col_values=(('external_ids', {'iface-id': 'a079e33d-4b03-49ef-8315-f33edfb30f8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:bb:08', 'vm-uuid': '7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:11 user nova-compute[75247]: INFO os_vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:bb:08,bridge_name='br-int',has_traffic_filtering=True,id=a079e33d-4b03-49ef-8315-f33edfb30f8f,network=Network(488711cb-aa26-477a-832a-6a499b8b7c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa079e33d-4b')
Dec 06 12:46:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286975828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-286975828',id=17,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2B8SHWnL5XT3DWY3gquaeb2zxCHvGF8t4a4ubj3jQmPtq9XBRNZCZWWoSYLM9FvzsvWTog0uix/tXd4joK1Eq8bokONhA/MCcUOpQ0086wGcwdflAWagcdXNUdya2xZw==',key_name='tempest-keypair-684324006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66b95bb1359241ee8d2cf5015640a2b8',ramdisk_id='',reservation_id='r-6ft38hg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1989495369',owner_user_name='tempest-TaggedBootDevicesTest_v242-1989495369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:45:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9e5d32fc34046bcbf517062fe52f1a8',uuid=7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d117aa5-7c18-4adb-be72-d785e4905735", "address": "fa:16:3e:b3:6f:7c", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d117aa5-7c", "ovs_interfaceid": "2d117aa5-7c18-4adb-be72-d785e4905735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converting VIF {"id": "2d117aa5-7c18-4adb-be72-d785e4905735", "address": "fa:16:3e:b3:6f:7c", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d117aa5-7c", "ovs_interfaceid": "2d117aa5-7c18-4adb-be72-d785e4905735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:6f:7c,bridge_name='br-int',has_traffic_filtering=True,id=2d117aa5-7c18-4adb-be72-d785e4905735,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2d117aa5-7c') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG os_vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:6f:7c,bridge_name='br-int',has_traffic_filtering=True,id=2d117aa5-7c18-4adb-be72-d785e4905735,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2d117aa5-7c') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '104d7249-7ca1-504a-9d02-ed1dfe9e0dd9', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d117aa5-7c, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d117aa5-7c, col_values=(('qos', UUID('c17b0d1d-ceb8-4351-a875-6a0f025ce4e6')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d117aa5-7c, col_values=(('external_ids', {'iface-id': '2d117aa5-7c18-4adb-be72-d785e4905735', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:6f:7c', 'vm-uuid': '7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: INFO os_vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:6f:7c,bridge_name='br-int',has_traffic_filtering=True,id=2d117aa5-7c18-4adb-be72-d785e4905735,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2d117aa5-7c')
Dec 06 12:46:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286975828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-286975828',id=17,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2B8SHWnL5XT3DWY3gquaeb2zxCHvGF8t4a4ubj3jQmPtq9XBRNZCZWWoSYLM9FvzsvWTog0uix/tXd4joK1Eq8bokONhA/MCcUOpQ0086wGcwdflAWagcdXNUdya2xZw==',key_name='tempest-keypair-684324006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66b95bb1359241ee8d2cf5015640a2b8',ramdisk_id='',reservation_id='r-6ft38hg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1989495369',owner_user_name='tempest-TaggedBootDevicesTest_v242-1989495369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:45:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9e5d32fc34046bcbf517062fe52f1a8',uuid=7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "681745af-b6fd-4f84-bc98-43bc601c3759", "address": "fa:16:3e:83:ce:7b", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681745af-b6", "ovs_interfaceid": "681745af-b6fd-4f84-bc98-43bc601c3759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converting VIF {"id": "681745af-b6fd-4f84-bc98-43bc601c3759", "address": "fa:16:3e:83:ce:7b", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681745af-b6", "ovs_interfaceid": "681745af-b6fd-4f84-bc98-43bc601c3759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:ce:7b,bridge_name='br-int',has_traffic_filtering=True,id=681745af-b6fd-4f84-bc98-43bc601c3759,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap681745af-b6') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG os_vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:ce:7b,bridge_name='br-int',has_traffic_filtering=True,id=681745af-b6fd-4f84-bc98-43bc601c3759,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap681745af-b6') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dcf42ba6-0c27-5028-ab67-c078dcffb0bb', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap681745af-b6, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap681745af-b6, col_values=(('qos', UUID('5401c72d-3470-4b76-8426-dedbd64d8920')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap681745af-b6, col_values=(('external_ids', {'iface-id': '681745af-b6fd-4f84-bc98-43bc601c3759', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:ce:7b', 'vm-uuid': '7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: INFO os_vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:ce:7b,bridge_name='br-int',has_traffic_filtering=True,id=681745af-b6fd-4f84-bc98-43bc601c3759,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap681745af-b6')
Dec 06 12:46:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286975828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-286975828',id=17,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2B8SHWnL5XT3DWY3gquaeb2zxCHvGF8t4a4ubj3jQmPtq9XBRNZCZWWoSYLM9FvzsvWTog0uix/tXd4joK1Eq8bokONhA/MCcUOpQ0086wGcwdflAWagcdXNUdya2xZw==',key_name='tempest-keypair-684324006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66b95bb1359241ee8d2cf5015640a2b8',ramdisk_id='',reservation_id='r-6ft38hg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1989495369',owner_user_name='tempest-TaggedBootDevicesTest_v242-1989495369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:45:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9e5d32fc34046bcbf517062fe52f1a8',uuid=7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b8c474e-894c-43c2-9a4a-0836089a16a1", "address": "fa:16:3e:09:e2:1a", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8c474e-89", "ovs_interfaceid": "7b8c474e-894c-43c2-9a4a-0836089a16a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converting VIF {"id": "7b8c474e-894c-43c2-9a4a-0836089a16a1", "address": "fa:16:3e:09:e2:1a", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8c474e-89", "ovs_interfaceid": "7b8c474e-894c-43c2-9a4a-0836089a16a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:e2:1a,bridge_name='br-int',has_traffic_filtering=True,id=7b8c474e-894c-43c2-9a4a-0836089a16a1,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b8c474e-89') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG os_vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:e2:1a,bridge_name='br-int',has_traffic_filtering=True,id=7b8c474e-894c-43c2-9a4a-0836089a16a1,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b8c474e-89') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae145b20-b10a-5d2f-8bbb-4c4c65d895b6', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b8c474e-89, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b8c474e-89, col_values=(('qos', UUID('01165c50-7a9e-4a18-bc95-53d22327ea7d')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b8c474e-89, col_values=(('external_ids', {'iface-id': '7b8c474e-894c-43c2-9a4a-0836089a16a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:e2:1a', 'vm-uuid': '7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: INFO os_vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:e2:1a,bridge_name='br-int',has_traffic_filtering=True,id=7b8c474e-894c-43c2-9a4a-0836089a16a1,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b8c474e-89')
Dec 06 12:46:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286975828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-286975828',id=17,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2B8SHWnL5XT3DWY3gquaeb2zxCHvGF8t4a4ubj3jQmPtq9XBRNZCZWWoSYLM9FvzsvWTog0uix/tXd4joK1Eq8bokONhA/MCcUOpQ0086wGcwdflAWagcdXNUdya2xZw==',key_name='tempest-keypair-684324006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66b95bb1359241ee8d2cf5015640a2b8',ramdisk_id='',reservation_id='r-6ft38hg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1989495369',owner_user_name='tempest-TaggedBootDevicesTest_v242-1989495369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:45:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9e5d32fc34046bcbf517062fe52f1a8',uuid=7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "267ee847-5894-4c58-8554-e30b91938a6d", "address": "fa:16:3e:72:58:06", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267ee847-58", "ovs_interfaceid": "267ee847-5894-4c58-8554-e30b91938a6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converting VIF {"id": "267ee847-5894-4c58-8554-e30b91938a6d", "address": "fa:16:3e:72:58:06", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267ee847-58", "ovs_interfaceid": "267ee847-5894-4c58-8554-e30b91938a6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:58:06,bridge_name='br-int',has_traffic_filtering=True,id=267ee847-5894-4c58-8554-e30b91938a6d,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267ee847-58') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG os_vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:58:06,bridge_name='br-int',has_traffic_filtering=True,id=267ee847-5894-4c58-8554-e30b91938a6d,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267ee847-58') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b04540c-7802-51e9-bad0-ee3bb6fd21ec', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG nova.compute.manager [req-00e4820f-29e1-4924-bba4-9d4ca1526c61 req-bdfef259-1e3a-451b-b1a8-e65585fc1e68 service nova] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Received event network-vif-plugged-02bb5689-5d75-4967-b307-862ab2c1fb7f {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-00e4820f-29e1-4924-bba4-9d4ca1526c61 req-bdfef259-1e3a-451b-b1a8-e65585fc1e68 service nova] Acquiring lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-00e4820f-29e1-4924-bba4-9d4ca1526c61 req-bdfef259-1e3a-451b-b1a8-e65585fc1e68 service nova] Lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-00e4820f-29e1-4924-bba4-9d4ca1526c61 req-bdfef259-1e3a-451b-b1a8-e65585fc1e68 service nova] Lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG nova.compute.manager [req-00e4820f-29e1-4924-bba4-9d4ca1526c61 req-bdfef259-1e3a-451b-b1a8-e65585fc1e68 service nova] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] No waiting events found dispatching network-vif-plugged-02bb5689-5d75-4967-b307-862ab2c1fb7f {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:11 user nova-compute[75247]: WARNING nova.compute.manager [req-00e4820f-29e1-4924-bba4-9d4ca1526c61 req-bdfef259-1e3a-451b-b1a8-e65585fc1e68 service nova] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Received unexpected event network-vif-plugged-02bb5689-5d75-4967-b307-862ab2c1fb7f for instance with vm_state building and task_state spawning.
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap267ee847-58, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap267ee847-58, col_values=(('qos', UUID('da53358b-a9d1-4f7c-b779-dd0c2db094db')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap267ee847-58, col_values=(('external_ids', {'iface-id': '267ee847-5894-4c58-8554-e30b91938a6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:58:06', 'vm-uuid': '7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: INFO os_vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:58:06,bridge_name='br-int',has_traffic_filtering=True,id=267ee847-5894-4c58-8554-e30b91938a6d,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267ee847-58')
Dec 06 12:46:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286975828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-286975828',id=17,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2B8SHWnL5XT3DWY3gquaeb2zxCHvGF8t4a4ubj3jQmPtq9XBRNZCZWWoSYLM9FvzsvWTog0uix/tXd4joK1Eq8bokONhA/MCcUOpQ0086wGcwdflAWagcdXNUdya2xZw==',key_name='tempest-keypair-684324006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66b95bb1359241ee8d2cf5015640a2b8',ramdisk_id='',reservation_id='r-6ft38hg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1989495369',owner_user_name='tempest-TaggedBootDevicesTest_v242-1989495369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:45:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9e5d32fc34046bcbf517062fe52f1a8',uuid=7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "097e6f29-41d9-4842-a697-ad3d1a1b0d7c", "address": "fa:16:3e:fd:ac:f5", "network": {"id": "7321830d-5ca0-4292-9e4b-c1e160a2b612", "bridge": "br-int", "label": "tempest-device-tagging-net2-5103445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097e6f29-41", "ovs_interfaceid": "097e6f29-41d9-4842-a697-ad3d1a1b0d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converting VIF {"id": "097e6f29-41d9-4842-a697-ad3d1a1b0d7c", "address": "fa:16:3e:fd:ac:f5", "network": {"id": "7321830d-5ca0-4292-9e4b-c1e160a2b612", "bridge": "br-int", "label": "tempest-device-tagging-net2-5103445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097e6f29-41", "ovs_interfaceid": "097e6f29-41d9-4842-a697-ad3d1a1b0d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:ac:f5,bridge_name='br-int',has_traffic_filtering=True,id=097e6f29-41d9-4842-a697-ad3d1a1b0d7c,network=Network(7321830d-5ca0-4292-9e4b-c1e160a2b612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap097e6f29-41') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG os_vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:ac:f5,bridge_name='br-int',has_traffic_filtering=True,id=097e6f29-41d9-4842-a697-ad3d1a1b0d7c,network=Network(7321830d-5ca0-4292-9e4b-c1e160a2b612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap097e6f29-41') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76540c56-f3ba-53c9-b054-515d30dc0af3', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.489s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap097e6f29-41, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap097e6f29-41, col_values=(('qos', UUID('3dac9d23-cb9d-4135-806d-b30736479bdd')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap097e6f29-41, col_values=(('external_ids', {'iface-id': '097e6f29-41d9-4842-a697-ad3d1a1b0d7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:ac:f5', 'vm-uuid': '7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:11 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Deleted allocations for instance ec9eea5d-dc9a-4a65-881a-a89538e3a593
Dec 06 12:46:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:12 user nova-compute[75247]: INFO os_vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:ac:f5,bridge_name='br-int',has_traffic_filtering=True,id=097e6f29-41d9-4842-a697-ad3d1a1b0d7c,network=Network(7321830d-5ca0-4292-9e4b-c1e160a2b612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap097e6f29-41')
Dec 06 12:46:12 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286975828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-286975828',id=17,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2B8SHWnL5XT3DWY3gquaeb2zxCHvGF8t4a4ubj3jQmPtq9XBRNZCZWWoSYLM9FvzsvWTog0uix/tXd4joK1Eq8bokONhA/MCcUOpQ0086wGcwdflAWagcdXNUdya2xZw==',key_name='tempest-keypair-684324006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66b95bb1359241ee8d2cf5015640a2b8',ramdisk_id='',reservation_id='r-6ft38hg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1989495369',owner_user_name='tempest-TaggedBootDevicesTest_v242-1989495369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:45:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9e5d32fc34046bcbf517062fe52f1a8',uuid=7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c587e85c-ccd5-4bb9-803c-b08aed3baaeb", "address": "fa:16:3e:f9:0b:6e", "network": {"id": "7321830d-5ca0-4292-9e4b-c1e160a2b612", "bridge": "br-int", "label": "tempest-device-tagging-net2-5103445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc587e85c-cc", "ovs_interfaceid": "c587e85c-ccd5-4bb9-803c-b08aed3baaeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converting VIF {"id": "c587e85c-ccd5-4bb9-803c-b08aed3baaeb", "address": "fa:16:3e:f9:0b:6e", "network": {"id": "7321830d-5ca0-4292-9e4b-c1e160a2b612", "bridge": "br-int", "label": "tempest-device-tagging-net2-5103445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc587e85c-cc", "ovs_interfaceid": "c587e85c-ccd5-4bb9-803c-b08aed3baaeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:0b:6e,bridge_name='br-int',has_traffic_filtering=True,id=c587e85c-ccd5-4bb9-803c-b08aed3baaeb,network=Network(7321830d-5ca0-4292-9e4b-c1e160a2b612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc587e85c-cc') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG os_vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:0b:6e,bridge_name='br-int',has_traffic_filtering=True,id=c587e85c-ccd5-4bb9-803c-b08aed3baaeb,network=Network(7321830d-5ca0-4292-9e4b-c1e160a2b612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc587e85c-cc') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cccd4bbf-78e3-5cfe-9612-edce9b043f36', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-86f27a8e-84a7-4913-9649-b0b8b64df305 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "ec9eea5d-dc9a-4a65-881a-a89538e3a593" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.011s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc587e85c-cc, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc587e85c-cc, col_values=(('qos', UUID('9c100405-dd2d-41c3-bb04-6d55a3799a6d')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc587e85c-cc, col_values=(('external_ids', {'iface-id': 'c587e85c-ccd5-4bb9-803c-b08aed3baaeb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:0b:6e', 'vm-uuid': '7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBzldZOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:46:12 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:46:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:46:12 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:46:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:46:12 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98ef44e-86c8-450c-8a8c-3cb8e8df2b7e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:46:12 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f18de8-5273-4705-a55b-24291b5d804b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92] added
Dec 06 12:46:12 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:12 user nova-compute[75247]: INFO os_vif [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:0b:6e,bridge_name='br-int',has_traffic_filtering=True,id=c587e85c-ccd5-4bb9-803c-b08aed3baaeb,network=Network(7321830d-5ca0-4292-9e4b-c1e160a2b612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc587e85c-cc')
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f8b554-d061-420c-a3ee-1bc8a9e012e8]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[843c54c3-cae8-412a-b512-39b32a9d40a8]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yBzldZOa {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yBzldZOa" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7aa362-5326-4297-bb3a-e22d45a05d58]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yBzldZOa'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab047302-18a9-447a-b9bd-7a219095fc86]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] No BDM found with device name hda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] No VIF found with MAC fa:16:3e:32:bb:08, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] No VIF found with MAC fa:16:3e:72:58:06, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:46:12 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Using config drive
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd1e1da-69c2-4b6c-a8ad-d6de4ab05b7e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:12 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:12 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:12 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:12 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:12 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:12 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:12 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:12 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:12 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:12 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:12 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:12 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --login" returned: 0 in 0.110s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c984da-db0d-413f-8818-6cd5bea93326]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92, portal: 172.16.0.220,3260]
Dec 06 12:46:12 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92, portal: 172.16.0.220,3260] successful.
Dec 06 12:46:12 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f9c543-8624-46cf-a85b-3558dce50710]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f926d6-72cd-464b-8cad-fe51aef7aea0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:12 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:12 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:12 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:12 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:12 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:12 user nova-compute[75247]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:46:12 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:12 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:12 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:12 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:12 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:12 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:12 user nova-compute[75247]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:46:12 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.526s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] HCTL ('39', '-', '-', 0) found on session 24 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca234ef5-114b-4bfc-86aa-5900987da3ea]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Searching for a device in session 24 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBzldZOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:46:12 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Creating config drive at /opt/stack/data/nova/instances/7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b/disk.config
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3i3ja7p7 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:12 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3i3ja7p7" returned: 0 in 0.118s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-60f1455e-674f-47b1-b0b5-90552c123153 req-bda2dcf1-4dc8-494e-aff2-3ca7f4e12dbb service nova] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Received event network-vif-plugged-02bb5689-5d75-4967-b307-862ab2c1fb7f {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-60f1455e-674f-47b1-b0b5-90552c123153 req-bda2dcf1-4dc8-494e-aff2-3ca7f4e12dbb service nova] Acquiring lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-60f1455e-674f-47b1-b0b5-90552c123153 req-bda2dcf1-4dc8-494e-aff2-3ca7f4e12dbb service nova] Lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-60f1455e-674f-47b1-b0b5-90552c123153 req-bda2dcf1-4dc8-494e-aff2-3ca7f4e12dbb service nova] Lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-60f1455e-674f-47b1-b0b5-90552c123153 req-bda2dcf1-4dc8-494e-aff2-3ca7f4e12dbb service nova] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] No waiting events found dispatching network-vif-plugged-02bb5689-5d75-4967-b307-862ab2c1fb7f {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:13 user nova-compute[75247]: WARNING nova.compute.manager [req-60f1455e-674f-47b1-b0b5-90552c123153 req-bda2dcf1-4dc8-494e-aff2-3ca7f4e12dbb service nova] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Received unexpected event network-vif-plugged-02bb5689-5d75-4967-b307-862ab2c1fb7f for instance with vm_state building and task_state spawning.
Dec 06 12:46:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "97d1f646-bc64-40e2-9418-c89a87473640" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "97d1f646-bc64-40e2-9418-c89a87473640" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG nova.compute.manager [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.575s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] <== connect_volume: return (1577ms) {'type': 'block', 'scsi_wwn': '26234343462396263', 'path': '/dev/sdh'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234343462396263', 'path': '/dev/sdh'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:46:13 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Instance spawned successfully.
Dec 06 12:46:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG nova.objects.instance [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lazy-loading 'flavor' on Instance uuid 0a86fe94-933a-4e0d-8a65-4834c3d3e40b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:46:14 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 12:46:14 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:46:14 user nova-compute[75247]:   <source dev="/dev/sdh"/>
Dec 06 12:46:14 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:46:14 user nova-compute[75247]:   <serial>b3c81dcf-076d-4330-aecd-a47fd48c4d92</serial>
Dec 06 12:46:14 user nova-compute[75247]: </disk>
Dec 06 12:46:14 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 12:46:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.006s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:14 user nova-compute[75247]: INFO nova.compute.manager [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Took 7.85 seconds to spawn the instance on the hypervisor.
Dec 06 12:46:14 user nova-compute[75247]: DEBUG nova.compute.manager [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:46:14 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:46:14 user nova-compute[75247]: INFO nova.compute.claims [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Claim successful on node user
Dec 06 12:46:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:14 user nova-compute[75247]: INFO nova.compute.manager [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Took 9.26 seconds to build instance.
Dec 06 12:46:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-549c3fc4-9286-4f7f-aa61-0a8281159eb5 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.380s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5711ad-a295-4b5d-8baf-50921601f26e/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:14 user nova-compute[75247]: DEBUG nova.network.neutron [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Port 348d8e54-a814-4893-8636-de9e795794a2 binding to destination host user is already ACTIVE {{(pid=75247) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Dec 06 12:46:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "refresh_cache-4531bf11-b948-4d57-bf55-f33563815e26" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:46:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquired lock "refresh_cache-4531bf11-b948-4d57-bf55-f33563815e26" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:46:14 user nova-compute[75247]: DEBUG nova.network.neutron [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:46:14 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:46:14 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:46:14 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] No VIF found with MAC fa:16:3e:a7:11:06, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:46:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5711ad-a295-4b5d-8baf-50921601f26e/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5711ad-a295-4b5d-8baf-50921601f26e/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5711ad-a295-4b5d-8baf-50921601f26e/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d7b34d1f-9773-490c-be3e-3950ab0002ca tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.584s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sfnVXxkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:46:15 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:46:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:46:15 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:46:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:46:15 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260" returned: 21 in 0.056s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a75d95b-4280-4dfe-8d85-3302e2aae2a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:46:15 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.263s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG nova.network.neutron [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Updating instance_info_cache with network_info: [{"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38862a6-690c-401e-87ba-867623619199]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579] added
Dec 06 12:46:15 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.041s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8449034-43c3-43a0-85f2-206ffd653500]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Releasing lock "refresh_cache-4531bf11-b948-4d57-bf55-f33563815e26" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG nova.network.neutron [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Creating tmpfile /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/tmphvc9m23n to verify with other compute node that the instance is on the same shared storage. {{(pid=75247) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9630}}
Dec 06 12:46:15 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.051s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac2dece-83c8-4912-abfe-0f18ee2d1dc2]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sfnVXxkD {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG nova.policy [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '35d1ce8c369941aab5effd18633a73b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58ba64f48e946098b72d7061d354ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sfnVXxkD" returned: 0 in 0.031s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a931d5-2c62-46c7-a1c3-42b9ce27a663]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sfnVXxkD'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5225da-cfaf-41dd-84a3-479fdfa76609]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e1b5197-dc38-48a5-b9f9-e053be499433/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.061s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe1a7d5-a5bc-4d43-9ce6-7f13d3b32901]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:15 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:15 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:15 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:15 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:15 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:15 user nova-compute[75247]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:46:15 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:15 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:15 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:15 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:15 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:15 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:15 user nova-compute[75247]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:46:15 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:46:15 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Creating image(s)
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "/opt/stack/data/nova/instances/97d1f646-bc64-40e2-9418-c89a87473640/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "/opt/stack/data/nova/instances/97d1f646-bc64-40e2-9418-c89a87473640/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "/opt/stack/data/nova/instances/97d1f646-bc64-40e2-9418-c89a87473640/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --login" returned: 0 in 0.251s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f47fef-0d61-4cbd-a2b6-990630aa2b8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579, portal: 172.16.0.220,3260]
Dec 06 12:46:16 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579, portal: 172.16.0.220,3260] successful.
Dec 06 12:46:16 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG nova.compute.manager [req-7e3d44b4-0f92-4952-98e2-9458f8d1aed2 req-f27b6496-8b8e-4291-b1e0-179b6ddc4f96 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-plugged-a079e33d-4b03-49ef-8315-f33edfb30f8f {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7e3d44b4-0f92-4952-98e2-9458f8d1aed2 req-f27b6496-8b8e-4291-b1e0-179b6ddc4f96 service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7e3d44b4-0f92-4952-98e2-9458f8d1aed2 req-f27b6496-8b8e-4291-b1e0-179b6ddc4f96 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7e3d44b4-0f92-4952-98e2-9458f8d1aed2 req-f27b6496-8b8e-4291-b1e0-179b6ddc4f96 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG nova.compute.manager [req-7e3d44b4-0f92-4952-98e2-9458f8d1aed2 req-f27b6496-8b8e-4291-b1e0-179b6ddc4f96 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-plugged-a079e33d-4b03-49ef-8315-f33edfb30f8f {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:16 user nova-compute[75247]: WARNING nova.compute.manager [req-7e3d44b4-0f92-4952-98e2-9458f8d1aed2 req-f27b6496-8b8e-4291-b1e0-179b6ddc4f96 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received unexpected event network-vif-plugged-a079e33d-4b03-49ef-8315-f33edfb30f8f for instance with vm_state building and task_state spawning.
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e1b5197-dc38-48a5-b9f9-e053be499433/disk.rescue --force-share --output=json" returned: 0 in 0.382s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e1b5197-dc38-48a5-b9f9-e053be499433/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac15474-4a9c-4dc6-a32d-c2bfe699600f]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.068s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27c57db-6748-44ac-bd86-17505ae526fb]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG nova.compute.manager [req-82f855fd-1fbc-4d62-be4a-cdb10744e156 req-3b682af7-e522-4824-b789-f4f240fdf5f0 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-plugged-2d117aa5-7c18-4adb-be72-d785e4905735 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-82f855fd-1fbc-4d62-be4a-cdb10744e156 req-3b682af7-e522-4824-b789-f4f240fdf5f0 service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-82f855fd-1fbc-4d62-be4a-cdb10744e156 req-3b682af7-e522-4824-b789-f4f240fdf5f0 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-82f855fd-1fbc-4d62-be4a-cdb10744e156 req-3b682af7-e522-4824-b789-f4f240fdf5f0 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG nova.compute.manager [req-82f855fd-1fbc-4d62-be4a-cdb10744e156 req-3b682af7-e522-4824-b789-f4f240fdf5f0 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-plugged-2d117aa5-7c18-4adb-be72-d785e4905735 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:16 user nova-compute[75247]: WARNING nova.compute.manager [req-82f855fd-1fbc-4d62-be4a-cdb10744e156 req-3b682af7-e522-4824-b789-f4f240fdf5f0 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received unexpected event network-vif-plugged-2d117aa5-7c18-4adb-be72-d785e4905735 for instance with vm_state building and task_state spawning.
Dec 06 12:46:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:16 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:16 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:16 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:16 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:16 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:16 user nova-compute[75247]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:46:16 user nova-compute[75247]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:46:16 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:16 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:16 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:16 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:16 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:16 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:16 user nova-compute[75247]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:46:16 user nova-compute[75247]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:46:16 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.979s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] HCTL ('40', '-', '-', 0) found on session 25 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.334s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef67cf24-b221-416f-8e1d-8f294a7de8be]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Searching for a device in session 25 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sfnVXxkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:16 user nova-compute[75247]: INFO nova.compute.manager [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Detaching volume cc33ee51-434a-4506-8266-17b7b706f482
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e1b5197-dc38-48a5-b9f9-e053be499433/disk.rescue --force-share --output=json" returned: 0 in 0.366s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:16 user nova-compute[75247]: INFO nova.virt.block_device [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Attempting to driver detach volume cc33ee51-434a-4506-8266-17b7b706f482 from mountpoint /dev/vdb
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.398s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/97d1f646-bc64-40e2-9418-c89a87473640/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG nova.compute.manager [req-b5e3f31c-640f-42a8-a938-bd4436bd7ba5 req-5fa1116a-a855-4ea2-a062-18ac1264e939 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-plugged-7b8c474e-894c-43c2-9a4a-0836089a16a1 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b5e3f31c-640f-42a8-a938-bd4436bd7ba5 req-5fa1116a-a855-4ea2-a062-18ac1264e939 service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b5e3f31c-640f-42a8-a938-bd4436bd7ba5 req-5fa1116a-a855-4ea2-a062-18ac1264e939 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b5e3f31c-640f-42a8-a938-bd4436bd7ba5 req-5fa1116a-a855-4ea2-a062-18ac1264e939 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG nova.compute.manager [req-b5e3f31c-640f-42a8-a938-bd4436bd7ba5 req-5fa1116a-a855-4ea2-a062-18ac1264e939 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-plugged-7b8c474e-894c-43c2-9a4a-0836089a16a1 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:16 user nova-compute[75247]: WARNING nova.compute.manager [req-b5e3f31c-640f-42a8-a938-bd4436bd7ba5 req-5fa1116a-a855-4ea2-a062-18ac1264e939 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received unexpected event network-vif-plugged-7b8c474e-894c-43c2-9a4a-0836089a16a1 for instance with vm_state building and task_state spawning.
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/97d1f646-bc64-40e2-9418-c89a87473640/disk 1073741824" returned: 0 in 0.096s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.498s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Attempting to detach device vdb from instance a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:46:16 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:46:16 user nova-compute[75247]:   <source dev="/dev/sde"/>
Dec 06 12:46:16 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:46:16 user nova-compute[75247]:   <serial>cc33ee51-434a-4506-8266-17b7b706f482</serial>
Dec 06 12:46:16 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 06 12:46:16 user nova-compute[75247]: </disk>
Dec 06 12:46:16 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk --force-share --output=json" returned: 0 in 0.335s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:16 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Successfully detached device vdb from instance a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a from the persistent domain config.
Dec 06 12:46:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:46:16 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:46:16 user nova-compute[75247]:   <source dev="/dev/sde"/>
Dec 06 12:46:16 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:46:16 user nova-compute[75247]:   <serial>cc33ee51-434a-4506-8266-17b7b706f482</serial>
Dec 06 12:46:16 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 06 12:46:16 user nova-compute[75247]: </disk>
Dec 06 12:46:16 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.269s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97d1f646-bc64-40e2-9418-c89a87473640/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:46:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97d1f646-bc64-40e2-9418-c89a87473640/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:17 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Instance destroyed successfully.
Dec 06 12:46:17 user nova-compute[75247]: DEBUG nova.objects.instance [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lazy-loading 'resources' on Instance uuid 4531bf11-b948-4d57-bf55-f33563815e26 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk --force-share --output=json" returned: 0 in 0.400s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1307258181',display_name='tempest-ServerActionsTestOtherB-server-1307258181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1307258181',id=5,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXd4LdKL4pG7XKtcC6TX8wMNmPTD7z6hx6EQTzh/vLbbeocUHdpJ42qGTjwVyD4AThWLqebjjgjZMtQsvJgysEhbuskpjq8ZyizdS/bi/KghYHYkKPwpNCJccaNThNvgg==',key_name='tempest-keypair-1971386181',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:44:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57ba4e5fa37f4fd29d6712069230d3e6',ramdisk_id='',reservation_id='r-wbn2uy0x',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-472154126',owner_user_name='tempest-ServerActionsTestOtherB-472154126-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:44:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd4165666a1426aa1134c2889214b0f',uuid=4531bf11-b948-4d57-bf55-f33563815e26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Converting VIF {"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=348d8e54-a814-4893-8636-de9e795794a2,network=Network(7d8127bc-30f6-40e2-9bd3-2054440440d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348d8e54-a8') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG os_vif [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=348d8e54-a814-4893-8636-de9e795794a2,network=Network(7d8127bc-30f6-40e2-9bd3-2054440440d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348d8e54-a8') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap348d8e54-a8, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89b8eaa7-d3de-425a-bfd0-f0052e6b0175) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.119s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] <== connect_volume: return (2123ms) {'type': 'block', 'scsi_wwn': '23266386265653230', 'path': '/dev/sdi'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266386265653230', 'path': '/dev/sdi'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97d1f646-bc64-40e2-9418-c89a87473640/disk --force-share --output=json" returned: 0 in 0.359s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Cannot resize image /opt/stack/data/nova/instances/97d1f646-bc64-40e2-9418-c89a87473640/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Ensure instance console log exists: /opt/stack/data/nova/instances/97d1f646-bc64-40e2-9418-c89a87473640/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:17 user nova-compute[75247]: INFO os_vif [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=348d8e54-a814-4893-8636-de9e795794a2,network=Network(7d8127bc-30f6-40e2-9bd3-2054440440d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348d8e54-a8')
Dec 06 12:46:17 user nova-compute[75247]: DEBUG nova.objects.instance [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lazy-loading 'flavor' on Instance uuid cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YiAyasdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:46:17 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:46:17 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 12:46:17 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:46:17 user nova-compute[75247]:   <source dev="/dev/sdi"/>
Dec 06 12:46:17 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:46:17 user nova-compute[75247]:   <serial>4933a54b-1240-4fda-8beb-b2d5cb8ed579</serial>
Dec 06 12:46:17 user nova-compute[75247]: </disk>
Dec 06 12:46:17 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f399f36-7d19-4684-bda9-aff814884d51]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:46:17 user nova-compute[75247]: No targets found.
Dec 06 12:46:17 user nova-compute[75247]: iSNS:
Dec 06 12:46:17 user nova-compute[75247]: No targets found.
Dec 06 12:46:17 user nova-compute[75247]: STATIC:
Dec 06 12:46:17 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b
Dec 06 12:46:17 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:17 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:17 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1
Dec 06 12:46:17 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:17 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:17 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd
Dec 06 12:46:17 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:17 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:17 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:46:17 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:17 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:17 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92
Dec 06 12:46:17 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:17 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:17 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db
Dec 06 12:46:17 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:17 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:17 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579
Dec 06 12:46:17 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:17 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:17 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482
Dec 06 12:46:17 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:17 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:17 user nova-compute[75247]: FIRMWARE:
Dec 06 12:46:17 user nova-compute[75247]: No targets found.
Dec 06 12:46:17 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:46:17 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:46:17 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[452e1ce2-17ef-4168-80e4-633a5e819713]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.079s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac888c6-a45e-4fff-a1e0-5441118b0f31]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:17 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:17 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:17 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:17 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:17 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:17 user nova-compute[75247]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:46:17 user nova-compute[75247]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:46:17 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:17 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:17 user nova-compute[75247]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:17 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:17 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:17 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:17 user nova-compute[75247]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:46:17 user nova-compute[75247]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:46:17 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c6b53f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db'): ({'sdb'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Removing single pathed devices sdb {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6734148-274d-498d-9fbc-7bc4e1362c59]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.036s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a34996-3a19-45b5-ae40-d9538299a09c]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Flushing IO for device /dev/sdb {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51929fb-dc77-4094-b755-abe6b493a89f]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG nova.network.neutron [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Successfully created port: 85ce649b-cff1-4ab2-b9f8-c187f9124936 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[202bf4c3-6d95-4885-aea8-88930ad3098f]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[42530206-9bc4-46de-ad5d-7b6f56bdfa11]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.401s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f3dec7-54b7-4f0d-8192-dd979e70df11]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db, portal: 172.16.0.220,3260]
Dec 06 12:46:17 user nova-compute[75247]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db, portal: 172.16.0.220,3260] successful.
Dec 06 12:46:17 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:22 user nova-compute[75247]: DEBUG nova.network.neutron [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Successfully updated port: 85ce649b-cff1-4ab2-b9f8-c187f9124936 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:46:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.050s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70840b1-8856-4dd4-9305-efabb5e33050]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-plugged-a079e33d-4b03-49ef-8315-f33edfb30f8f {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-plugged-a079e33d-4b03-49ef-8315-f33edfb30f8f {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:22 user nova-compute[75247]: WARNING nova.compute.manager [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received unexpected event network-vif-plugged-a079e33d-4b03-49ef-8315-f33edfb30f8f for instance with vm_state building and task_state spawning.
Dec 06 12:46:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received event network-vif-unplugged-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] Acquiring lock "4531bf11-b948-4d57-bf55-f33563815e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] No waiting events found dispatching network-vif-unplugged-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:22 user nova-compute[75247]: WARNING nova.compute.manager [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received unexpected event network-vif-unplugged-348d8e54-a814-4893-8636-de9e795794a2 for instance with vm_state resized and task_state resize_reverting.
Dec 06 12:46:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received event network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] Acquiring lock "4531bf11-b948-4d57-bf55-f33563815e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] No waiting events found dispatching network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:22 user nova-compute[75247]: WARNING nova.compute.manager [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received unexpected event network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 for instance with vm_state resized and task_state resize_reverting.
Dec 06 12:46:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-plugged-681745af-b6fd-4f84-bc98-43bc601c3759 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-plugged-681745af-b6fd-4f84-bc98-43bc601c3759 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:23 user nova-compute[75247]: WARNING nova.compute.manager [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received unexpected event network-vif-plugged-681745af-b6fd-4f84-bc98-43bc601c3759 for instance with vm_state building and task_state spawning.
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-plugged-681745af-b6fd-4f84-bc98-43bc601c3759 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-plugged-681745af-b6fd-4f84-bc98-43bc601c3759 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:23 user nova-compute[75247]: WARNING nova.compute.manager [req-5b43b077-2cc2-44a6-b65a-909bfee3baf6 req-cbba57db-bfa7-49af-bf13-591b53057f23 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received unexpected event network-vif-plugged-681745af-b6fd-4f84-bc98-43bc601c3759 for instance with vm_state building and task_state spawning.
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-28d2143a-314d-4a0d-91ab-78069efd46e0 req-45b0d8ce-4190-419a-97cb-763aa39d79d8 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-plugged-2d117aa5-7c18-4adb-be72-d785e4905735 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-28d2143a-314d-4a0d-91ab-78069efd46e0 req-45b0d8ce-4190-419a-97cb-763aa39d79d8 service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-28d2143a-314d-4a0d-91ab-78069efd46e0 req-45b0d8ce-4190-419a-97cb-763aa39d79d8 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-28d2143a-314d-4a0d-91ab-78069efd46e0 req-45b0d8ce-4190-419a-97cb-763aa39d79d8 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-28d2143a-314d-4a0d-91ab-78069efd46e0 req-45b0d8ce-4190-419a-97cb-763aa39d79d8 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-plugged-2d117aa5-7c18-4adb-be72-d785e4905735 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:23 user nova-compute[75247]: WARNING nova.compute.manager [req-28d2143a-314d-4a0d-91ab-78069efd46e0 req-45b0d8ce-4190-419a-97cb-763aa39d79d8 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received unexpected event network-vif-plugged-2d117aa5-7c18-4adb-be72-d785e4905735 for instance with vm_state building and task_state spawning.
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-28d2143a-314d-4a0d-91ab-78069efd46e0 req-45b0d8ce-4190-419a-97cb-763aa39d79d8 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-plugged-267ee847-5894-4c58-8554-e30b91938a6d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-28d2143a-314d-4a0d-91ab-78069efd46e0 req-45b0d8ce-4190-419a-97cb-763aa39d79d8 service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-28d2143a-314d-4a0d-91ab-78069efd46e0 req-45b0d8ce-4190-419a-97cb-763aa39d79d8 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-28d2143a-314d-4a0d-91ab-78069efd46e0 req-45b0d8ce-4190-419a-97cb-763aa39d79d8 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-28d2143a-314d-4a0d-91ab-78069efd46e0 req-45b0d8ce-4190-419a-97cb-763aa39d79d8 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-plugged-267ee847-5894-4c58-8554-e30b91938a6d {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:23 user nova-compute[75247]: WARNING nova.compute.manager [req-28d2143a-314d-4a0d-91ab-78069efd46e0 req-45b0d8ce-4190-419a-97cb-763aa39d79d8 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received unexpected event network-vif-plugged-267ee847-5894-4c58-8554-e30b91938a6d for instance with vm_state building and task_state spawning.
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-28d2143a-314d-4a0d-91ab-78069efd46e0 req-45b0d8ce-4190-419a-97cb-763aa39d79d8 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-plugged-267ee847-5894-4c58-8554-e30b91938a6d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-28d2143a-314d-4a0d-91ab-78069efd46e0 req-45b0d8ce-4190-419a-97cb-763aa39d79d8 service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-28d2143a-314d-4a0d-91ab-78069efd46e0 req-45b0d8ce-4190-419a-97cb-763aa39d79d8 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-28d2143a-314d-4a0d-91ab-78069efd46e0 req-45b0d8ce-4190-419a-97cb-763aa39d79d8 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-28d2143a-314d-4a0d-91ab-78069efd46e0 req-45b0d8ce-4190-419a-97cb-763aa39d79d8 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-plugged-267ee847-5894-4c58-8554-e30b91938a6d {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:23 user nova-compute[75247]: WARNING nova.compute.manager [req-28d2143a-314d-4a0d-91ab-78069efd46e0 req-45b0d8ce-4190-419a-97cb-763aa39d79d8 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received unexpected event network-vif-plugged-267ee847-5894-4c58-8554-e30b91938a6d for instance with vm_state building and task_state spawning.
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-b4b42d60-5817-4ebd-bf35-44f5d194525e req-1640fdd7-be2c-4223-bb91-cead65430dbb service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-plugged-7b8c474e-894c-43c2-9a4a-0836089a16a1 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b4b42d60-5817-4ebd-bf35-44f5d194525e req-1640fdd7-be2c-4223-bb91-cead65430dbb service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b4b42d60-5817-4ebd-bf35-44f5d194525e req-1640fdd7-be2c-4223-bb91-cead65430dbb service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b4b42d60-5817-4ebd-bf35-44f5d194525e req-1640fdd7-be2c-4223-bb91-cead65430dbb service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-b4b42d60-5817-4ebd-bf35-44f5d194525e req-1640fdd7-be2c-4223-bb91-cead65430dbb service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-plugged-7b8c474e-894c-43c2-9a4a-0836089a16a1 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:23 user nova-compute[75247]: WARNING nova.compute.manager [req-b4b42d60-5817-4ebd-bf35-44f5d194525e req-1640fdd7-be2c-4223-bb91-cead65430dbb service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received unexpected event network-vif-plugged-7b8c474e-894c-43c2-9a4a-0836089a16a1 for instance with vm_state building and task_state spawning.
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-597b5779-6e53-4b5e-9ea3-b8c74994e9d6 req-8c9ed10d-4450-4c6d-a53e-bda69346991d service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-plugged-097e6f29-41d9-4842-a697-ad3d1a1b0d7c {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-597b5779-6e53-4b5e-9ea3-b8c74994e9d6 req-8c9ed10d-4450-4c6d-a53e-bda69346991d service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-597b5779-6e53-4b5e-9ea3-b8c74994e9d6 req-8c9ed10d-4450-4c6d-a53e-bda69346991d service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-597b5779-6e53-4b5e-9ea3-b8c74994e9d6 req-8c9ed10d-4450-4c6d-a53e-bda69346991d service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-597b5779-6e53-4b5e-9ea3-b8c74994e9d6 req-8c9ed10d-4450-4c6d-a53e-bda69346991d service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-plugged-097e6f29-41d9-4842-a697-ad3d1a1b0d7c {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:23 user nova-compute[75247]: WARNING nova.compute.manager [req-597b5779-6e53-4b5e-9ea3-b8c74994e9d6 req-8c9ed10d-4450-4c6d-a53e-bda69346991d service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received unexpected event network-vif-plugged-097e6f29-41d9-4842-a697-ad3d1a1b0d7c for instance with vm_state building and task_state spawning.
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-597b5779-6e53-4b5e-9ea3-b8c74994e9d6 req-8c9ed10d-4450-4c6d-a53e-bda69346991d service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-plugged-097e6f29-41d9-4842-a697-ad3d1a1b0d7c {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-597b5779-6e53-4b5e-9ea3-b8c74994e9d6 req-8c9ed10d-4450-4c6d-a53e-bda69346991d service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-597b5779-6e53-4b5e-9ea3-b8c74994e9d6 req-8c9ed10d-4450-4c6d-a53e-bda69346991d service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-597b5779-6e53-4b5e-9ea3-b8c74994e9d6 req-8c9ed10d-4450-4c6d-a53e-bda69346991d service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-597b5779-6e53-4b5e-9ea3-b8c74994e9d6 req-8c9ed10d-4450-4c6d-a53e-bda69346991d service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-plugged-097e6f29-41d9-4842-a697-ad3d1a1b0d7c {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:23 user nova-compute[75247]: WARNING nova.compute.manager [req-597b5779-6e53-4b5e-9ea3-b8c74994e9d6 req-8c9ed10d-4450-4c6d-a53e-bda69346991d service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received unexpected event network-vif-plugged-097e6f29-41d9-4842-a697-ad3d1a1b0d7c for instance with vm_state building and task_state spawning.
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-fc34a785-6d62-4553-9741-d8dd66738569 req-a17fafd2-8bce-4ddf-bbe4-6feb66847303 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-plugged-c587e85c-ccd5-4bb9-803c-b08aed3baaeb {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fc34a785-6d62-4553-9741-d8dd66738569 req-a17fafd2-8bce-4ddf-bbe4-6feb66847303 service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fc34a785-6d62-4553-9741-d8dd66738569 req-a17fafd2-8bce-4ddf-bbe4-6feb66847303 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fc34a785-6d62-4553-9741-d8dd66738569 req-a17fafd2-8bce-4ddf-bbe4-6feb66847303 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-fc34a785-6d62-4553-9741-d8dd66738569 req-a17fafd2-8bce-4ddf-bbe4-6feb66847303 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-plugged-c587e85c-ccd5-4bb9-803c-b08aed3baaeb {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:23 user nova-compute[75247]: WARNING nova.compute.manager [req-fc34a785-6d62-4553-9741-d8dd66738569 req-a17fafd2-8bce-4ddf-bbe4-6feb66847303 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received unexpected event network-vif-plugged-c587e85c-ccd5-4bb9-803c-b08aed3baaeb for instance with vm_state building and task_state spawning.
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-fc34a785-6d62-4553-9741-d8dd66738569 req-a17fafd2-8bce-4ddf-bbe4-6feb66847303 service nova] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Received event network-changed-85ce649b-cff1-4ab2-b9f8-c187f9124936 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-fc34a785-6d62-4553-9741-d8dd66738569 req-a17fafd2-8bce-4ddf-bbe4-6feb66847303 service nova] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Refreshing instance network info cache due to event network-changed-85ce649b-cff1-4ab2-b9f8-c187f9124936. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fc34a785-6d62-4553-9741-d8dd66738569 req-a17fafd2-8bce-4ddf-bbe4-6feb66847303 service nova] Acquiring lock "refresh_cache-97d1f646-bc64-40e2-9418-c89a87473640" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fc34a785-6d62-4553-9741-d8dd66738569 req-a17fafd2-8bce-4ddf-bbe4-6feb66847303 service nova] Acquired lock "refresh_cache-97d1f646-bc64-40e2-9418-c89a87473640" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.network.neutron [req-fc34a785-6d62-4553-9741-d8dd66738569 req-a17fafd2-8bce-4ddf-bbe4-6feb66847303 service nova] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Refreshing network info cache for port 85ce649b-cff1-4ab2-b9f8-c187f9124936 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.manager [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 4.767s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] <== disconnect_volume: return (4773ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "refresh_cache-97d1f646-bc64-40e2-9418-c89a87473640" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:46:23 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:46:23 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=7482MB free_disk=25.27588653564453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:23 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Instance spawned successfully.
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] No VIF found with MAC fa:16:3e:b5:b1:be, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.network.neutron [req-fc34a785-6d62-4553-9741-d8dd66738569 req-a17fafd2-8bce-4ddf-bbe4-6feb66847303 service nova] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Applying migration context for instance 4531bf11-b948-4d57-bf55-f33563815e26 as it has an incoming, in-progress migration ebd7dca9-1b0a-4f79-971b-48b7913fd325. Migration status is reverting {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 06 12:46:23 user nova-compute[75247]: INFO nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Updating resource usage from migration ebd7dca9-1b0a-4f79-971b-48b7913fd325
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 70c4664e-ae7a-47de-bba7-18300391d209 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 782289e2-91cd-4aee-9a08-eadfb2a5965b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 3e1b5197-dc38-48a5-b9f9-e053be499433 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 0a86fe94-933a-4e0d-8a65-4834c3d3e40b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Migration ebd7dca9-1b0a-4f79-971b-48b7913fd325 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1712}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 4531bf11-b948-4d57-bf55-f33563815e26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 8c5711ad-a295-4b5d-8baf-50921601f26e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance db837c7a-c52d-469b-abf7-cea107454c60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance ea75ba22-b4af-4454-93ed-cdfdc76a895b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 97d1f646-bc64-40e2-9418-c89a87473640 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 12:46:23 user nova-compute[75247]: INFO nova.compute.manager [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Took 17.52 seconds to spawn the instance on the hypervisor.
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.manager [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-008f0a5e-8f0a-4174-a5a4-23f71081dfda tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.085s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.network.neutron [req-fc34a785-6d62-4553-9741-d8dd66738569 req-a17fafd2-8bce-4ddf-bbe4-6feb66847303 service nova] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fc34a785-6d62-4553-9741-d8dd66738569 req-a17fafd2-8bce-4ddf-bbe4-6feb66847303 service nova] Releasing lock "refresh_cache-97d1f646-bc64-40e2-9418-c89a87473640" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-fc34a785-6d62-4553-9741-d8dd66738569 req-a17fafd2-8bce-4ddf-bbe4-6feb66847303 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-plugged-c587e85c-ccd5-4bb9-803c-b08aed3baaeb {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fc34a785-6d62-4553-9741-d8dd66738569 req-a17fafd2-8bce-4ddf-bbe4-6feb66847303 service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fc34a785-6d62-4553-9741-d8dd66738569 req-a17fafd2-8bce-4ddf-bbe4-6feb66847303 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fc34a785-6d62-4553-9741-d8dd66738569 req-a17fafd2-8bce-4ddf-bbe4-6feb66847303 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-fc34a785-6d62-4553-9741-d8dd66738569 req-a17fafd2-8bce-4ddf-bbe4-6feb66847303 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-plugged-c587e85c-ccd5-4bb9-803c-b08aed3baaeb {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:23 user nova-compute[75247]: WARNING nova.compute.manager [req-fc34a785-6d62-4553-9741-d8dd66738569 req-a17fafd2-8bce-4ddf-bbe4-6feb66847303 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received unexpected event network-vif-plugged-c587e85c-ccd5-4bb9-803c-b08aed3baaeb for instance with vm_state building and task_state spawning.
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquired lock "refresh_cache-97d1f646-bc64-40e2-9418-c89a87473640" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.network.neutron [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:46:23 user nova-compute[75247]: INFO nova.compute.manager [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Took 80.86 seconds to build instance.
Dec 06 12:46:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-649628c8-b669-4683-9c8b-6712ef871b28 tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 81.041s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG nova.network.neutron [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:46:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.871s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.network.neutron [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Updating instance_info_cache with network_info: [{"id": "85ce649b-cff1-4ab2-b9f8-c187f9124936", "address": "fa:16:3e:f8:f7:bd", "network": {"id": "24492570-dfe5-49d1-944e-7435cc85d347", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145359804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58ba64f48e946098b72d7061d354ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ce649b-cf", "ovs_interfaceid": "85ce649b-cff1-4ab2-b9f8-c187f9124936", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Releasing lock "refresh_cache-97d1f646-bc64-40e2-9418-c89a87473640" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Instance network_info: |[{"id": "85ce649b-cff1-4ab2-b9f8-c187f9124936", "address": "fa:16:3e:f8:f7:bd", "network": {"id": "24492570-dfe5-49d1-944e-7435cc85d347", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145359804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58ba64f48e946098b72d7061d354ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ce649b-cf", "ovs_interfaceid": "85ce649b-cff1-4ab2-b9f8-c187f9124936", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Start _get_guest_xml network_info=[{"id": "85ce649b-cff1-4ab2-b9f8-c187f9124936", "address": "fa:16:3e:f8:f7:bd", "network": {"id": "24492570-dfe5-49d1-944e-7435cc85d347", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145359804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58ba64f48e946098b72d7061d354ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ce649b-cf", "ovs_interfaceid": "85ce649b-cff1-4ab2-b9f8-c187f9124936", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:46:24 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:46:24 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:46:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1690776951',display_name='tempest-VolumesSnapshotTestJSON-instance-1690776951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1690776951',id=21,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGSUSj/rjsjkVcF/pjDxNa+MmNtbMAUkZGikxUw+KQreaFx1LKMvOD4eWcnFo81T2a+CHSxdJEqlLOQTRFnsfc6lWlGCJKzxld4ExdcxsicBRvwrPwj4KV6LFB36g9Dcg==',key_name='tempest-keypair-502750157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b58ba64f48e946098b72d7061d354ef3',ramdisk_id='',reservation_id='r-uuu23vg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1940428801',owner_user_name='tempest-VolumesSnapshotTestJSON-1940428801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35d1ce8c369941aab5effd18633a73b0',uuid=97d1f646-bc64-40e2-9418-c89a87473640,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85ce649b-cff1-4ab2-b9f8-c187f9124936", "address": "fa:16:3e:f8:f7:bd", "network": {"id": "24492570-dfe5-49d1-944e-7435cc85d347", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145359804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58ba64f48e946098b72d7061d354ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ce649b-cf", "ovs_interfaceid": "85ce649b-cff1-4ab2-b9f8-c187f9124936", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Converting VIF {"id": "85ce649b-cff1-4ab2-b9f8-c187f9124936", "address": "fa:16:3e:f8:f7:bd", "network": {"id": "24492570-dfe5-49d1-944e-7435cc85d347", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145359804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58ba64f48e946098b72d7061d354ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ce649b-cf", "ovs_interfaceid": "85ce649b-cff1-4ab2-b9f8-c187f9124936", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:f7:bd,bridge_name='br-int',has_traffic_filtering=True,id=85ce649b-cff1-4ab2-b9f8-c187f9124936,network=Network(24492570-dfe5-49d1-944e-7435cc85d347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ce649b-cf') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.objects.instance [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lazy-loading 'pci_devices' on Instance uuid 97d1f646-bc64-40e2-9418-c89a87473640 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:46:24 user nova-compute[75247]:   <uuid>97d1f646-bc64-40e2-9418-c89a87473640</uuid>
Dec 06 12:46:24 user nova-compute[75247]:   <name>instance-00000015</name>
Dec 06 12:46:24 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:46:24 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:46:24 user nova-compute[75247]:   <metadata>
Dec 06 12:46:24 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:46:24 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:46:24 user nova-compute[75247]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1690776951</nova:name>
Dec 06 12:46:24 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:46:24</nova:creationTime>
Dec 06 12:46:24 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:46:24 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:46:24 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:46:24 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:46:24 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:46:24 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:46:24 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:46:24 user nova-compute[75247]:       <nova:owner>
Dec 06 12:46:24 user nova-compute[75247]:         <nova:user uuid="35d1ce8c369941aab5effd18633a73b0">tempest-VolumesSnapshotTestJSON-1940428801-project-member</nova:user>
Dec 06 12:46:24 user nova-compute[75247]:         <nova:project uuid="b58ba64f48e946098b72d7061d354ef3">tempest-VolumesSnapshotTestJSON-1940428801</nova:project>
Dec 06 12:46:24 user nova-compute[75247]:       </nova:owner>
Dec 06 12:46:24 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:46:24 user nova-compute[75247]:       <nova:ports>
Dec 06 12:46:24 user nova-compute[75247]:         <nova:port uuid="85ce649b-cff1-4ab2-b9f8-c187f9124936">
Dec 06 12:46:24 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 06 12:46:24 user nova-compute[75247]:         </nova:port>
Dec 06 12:46:24 user nova-compute[75247]:       </nova:ports>
Dec 06 12:46:24 user nova-compute[75247]:     </nova:instance>
Dec 06 12:46:24 user nova-compute[75247]:   </metadata>
Dec 06 12:46:24 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:46:24 user nova-compute[75247]:     <system>
Dec 06 12:46:24 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:46:24 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:46:24 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:46:24 user nova-compute[75247]:       <entry name="serial">97d1f646-bc64-40e2-9418-c89a87473640</entry>
Dec 06 12:46:24 user nova-compute[75247]:       <entry name="uuid">97d1f646-bc64-40e2-9418-c89a87473640</entry>
Dec 06 12:46:24 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:46:24 user nova-compute[75247]:     </system>
Dec 06 12:46:24 user nova-compute[75247]:   </sysinfo>
Dec 06 12:46:24 user nova-compute[75247]:   <os>
Dec 06 12:46:24 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:46:24 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:46:24 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:46:24 user nova-compute[75247]:   </os>
Dec 06 12:46:24 user nova-compute[75247]:   <features>
Dec 06 12:46:24 user nova-compute[75247]:     <acpi/>
Dec 06 12:46:24 user nova-compute[75247]:     <apic/>
Dec 06 12:46:24 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:46:24 user nova-compute[75247]:   </features>
Dec 06 12:46:24 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:46:24 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:46:24 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:46:24 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:46:24 user nova-compute[75247]:   </clock>
Dec 06 12:46:24 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:46:24 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:46:24 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:46:24 user nova-compute[75247]:   </cpu>
Dec 06 12:46:24 user nova-compute[75247]:   <devices>
Dec 06 12:46:24 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:46:24 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:46:24 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/97d1f646-bc64-40e2-9418-c89a87473640/disk"/>
Dec 06 12:46:24 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:46:24 user nova-compute[75247]:     </disk>
Dec 06 12:46:24 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:46:24 user nova-compute[75247]:       <mac address="fa:16:3e:f8:f7:bd"/>
Dec 06 12:46:24 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:46:24 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:46:24 user nova-compute[75247]:       <target dev="tap85ce649b-cf"/>
Dec 06 12:46:24 user nova-compute[75247]:     </interface>
Dec 06 12:46:24 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:46:24 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/97d1f646-bc64-40e2-9418-c89a87473640/console.log" append="off"/>
Dec 06 12:46:24 user nova-compute[75247]:     </serial>
Dec 06 12:46:24 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:46:24 user nova-compute[75247]:     <video>
Dec 06 12:46:24 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:46:24 user nova-compute[75247]:     </video>
Dec 06 12:46:24 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:46:24 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:46:24 user nova-compute[75247]:     </rng>
Dec 06 12:46:24 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:46:24 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:46:24 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:46:24 user nova-compute[75247]:     </memballoon>
Dec 06 12:46:24 user nova-compute[75247]:   </devices>
Dec 06 12:46:24 user nova-compute[75247]: </domain>
Dec 06 12:46:24 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:46:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1690776951',display_name='tempest-VolumesSnapshotTestJSON-instance-1690776951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1690776951',id=21,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGSUSj/rjsjkVcF/pjDxNa+MmNtbMAUkZGikxUw+KQreaFx1LKMvOD4eWcnFo81T2a+CHSxdJEqlLOQTRFnsfc6lWlGCJKzxld4ExdcxsicBRvwrPwj4KV6LFB36g9Dcg==',key_name='tempest-keypair-502750157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b58ba64f48e946098b72d7061d354ef3',ramdisk_id='',reservation_id='r-uuu23vg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1940428801',owner_user_name='tempest-VolumesSnapshotTestJSON-1940428801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35d1ce8c369941aab5effd18633a73b0',uuid=97d1f646-bc64-40e2-9418-c89a87473640,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85ce649b-cff1-4ab2-b9f8-c187f9124936", "address": "fa:16:3e:f8:f7:bd", "network": {"id": "24492570-dfe5-49d1-944e-7435cc85d347", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145359804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58ba64f48e946098b72d7061d354ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ce649b-cf", "ovs_interfaceid": "85ce649b-cff1-4ab2-b9f8-c187f9124936", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Converting VIF {"id": "85ce649b-cff1-4ab2-b9f8-c187f9124936", "address": "fa:16:3e:f8:f7:bd", "network": {"id": "24492570-dfe5-49d1-944e-7435cc85d347", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145359804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58ba64f48e946098b72d7061d354ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ce649b-cf", "ovs_interfaceid": "85ce649b-cff1-4ab2-b9f8-c187f9124936", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:f7:bd,bridge_name='br-int',has_traffic_filtering=True,id=85ce649b-cff1-4ab2-b9f8-c187f9124936,network=Network(24492570-dfe5-49d1-944e-7435cc85d347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ce649b-cf') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG os_vif [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:f7:bd,bridge_name='br-int',has_traffic_filtering=True,id=85ce649b-cff1-4ab2-b9f8-c187f9124936,network=Network(24492570-dfe5-49d1-944e-7435cc85d347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ce649b-cf') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6928d58e-09dd-52b8-bf35-f99a18a8ac37', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85ce649b-cf, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85ce649b-cf, col_values=(('qos', UUID('4f08ebb5-5216-49e5-be11-22522ecb5cd2')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85ce649b-cf, col_values=(('external_ids', {'iface-id': '85ce649b-cff1-4ab2-b9f8-c187f9124936', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:f7:bd', 'vm-uuid': '97d1f646-bc64-40e2-9418-c89a87473640'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:24 user nova-compute[75247]: INFO os_vif [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:f7:bd,bridge_name='br-int',has_traffic_filtering=True,id=85ce649b-cff1-4ab2-b9f8-c187f9124936,network=Network(24492570-dfe5-49d1-944e-7435cc85d347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ce649b-cf')
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] No VIF found with MAC fa:16:3e:f8:f7:bd, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.objects.instance [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lazy-loading 'migration_context' on Instance uuid 4531bf11-b948-4d57-bf55-f33563815e26 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:46:24 user nova-compute[75247]: DEBUG nova.objects.base [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Object Instance<4531bf11-b948-4d57-bf55-f33563815e26> lazy-loaded attributes: resources,migration_context {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:46:25 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:46:25 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:46:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.595s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:25 user nova-compute[75247]: INFO nova.compute.manager [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Swapping old allocation on dict_keys(['d326b140-3450-4409-964c-9eafc6cc025d']) held by migration ebd7dca9-1b0a-4f79-971b-48b7913fd325 for instance
Dec 06 12:46:25 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Overwriting current allocation {'allocations': {'d326b140-3450-4409-964c-9eafc6cc025d': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 25}}, 'project_id': '57ba4e5fa37f4fd29d6712069230d3e6', 'user_id': '5dd4165666a1426aa1134c2889214b0f', 'consumer_generation': 1} on consumer 4531bf11-b948-4d57-bf55-f33563815e26 {{(pid=75247) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Dec 06 12:46:25 user nova-compute[75247]: INFO nova.compute.manager [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Rebuilding instance
Dec 06 12:46:25 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:46:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "refresh_cache-4531bf11-b948-4d57-bf55-f33563815e26" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:46:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquired lock "refresh_cache-4531bf11-b948-4d57-bf55-f33563815e26" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:46:26 user nova-compute[75247]: DEBUG nova.network.neutron [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:46:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-317fb1dc-1708-4e9d-9414-25ff10d8ef80 req-cbd12960-cb16-4c9d-a97a-d8fa6afee9ec service nova] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Received event network-vif-plugged-85ce649b-cff1-4ab2-b9f8-c187f9124936 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-317fb1dc-1708-4e9d-9414-25ff10d8ef80 req-cbd12960-cb16-4c9d-a97a-d8fa6afee9ec service nova] Acquiring lock "97d1f646-bc64-40e2-9418-c89a87473640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-317fb1dc-1708-4e9d-9414-25ff10d8ef80 req-cbd12960-cb16-4c9d-a97a-d8fa6afee9ec service nova] Lock "97d1f646-bc64-40e2-9418-c89a87473640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-317fb1dc-1708-4e9d-9414-25ff10d8ef80 req-cbd12960-cb16-4c9d-a97a-d8fa6afee9ec service nova] Lock "97d1f646-bc64-40e2-9418-c89a87473640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-317fb1dc-1708-4e9d-9414-25ff10d8ef80 req-cbd12960-cb16-4c9d-a97a-d8fa6afee9ec service nova] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] No waiting events found dispatching network-vif-plugged-85ce649b-cff1-4ab2-b9f8-c187f9124936 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:26 user nova-compute[75247]: WARNING nova.compute.manager [req-317fb1dc-1708-4e9d-9414-25ff10d8ef80 req-cbd12960-cb16-4c9d-a97a-d8fa6afee9ec service nova] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Received unexpected event network-vif-plugged-85ce649b-cff1-4ab2-b9f8-c187f9124936 for instance with vm_state building and task_state spawning.
Dec 06 12:46:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-de1af6eb-91a1-41f0-b775-452eeb99f246 req-df44f972-3833-499b-b920-1907acaef7fd service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received event network-changed-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-de1af6eb-91a1-41f0-b775-452eeb99f246 req-df44f972-3833-499b-b920-1907acaef7fd service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Refreshing instance network info cache due to event network-changed-a8d5f682-76a1-4b39-8153-487fe53a127a. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:46:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-de1af6eb-91a1-41f0-b775-452eeb99f246 req-df44f972-3833-499b-b920-1907acaef7fd service nova] Acquiring lock "refresh_cache-0a86fe94-933a-4e0d-8a65-4834c3d3e40b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:46:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-de1af6eb-91a1-41f0-b775-452eeb99f246 req-df44f972-3833-499b-b920-1907acaef7fd service nova] Acquired lock "refresh_cache-0a86fe94-933a-4e0d-8a65-4834c3d3e40b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:46:26 user nova-compute[75247]: DEBUG nova.network.neutron [req-de1af6eb-91a1-41f0-b775-452eeb99f246 req-df44f972-3833-499b-b920-1907acaef7fd service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Refreshing network info cache for port a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:46:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:27 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Instance destroyed successfully.
Dec 06 12:46:27 user nova-compute[75247]: INFO nova.compute.manager [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Detaching volume 4933a54b-1240-4fda-8beb-b2d5cb8ed579
Dec 06 12:46:27 user nova-compute[75247]: INFO nova.virt.block_device [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Attempting to driver detach volume 4933a54b-1240-4fda-8beb-b2d5cb8ed579 from mountpoint /dev/vdb
Dec 06 12:46:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Attempting to detach device vdb from instance cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:46:27 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:46:27 user nova-compute[75247]:   <source dev="/dev/sdi"/>
Dec 06 12:46:27 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:46:27 user nova-compute[75247]:   <serial>4933a54b-1240-4fda-8beb-b2d5cb8ed579</serial>
Dec 06 12:46:27 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:46:27 user nova-compute[75247]: </disk>
Dec 06 12:46:27 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG nova.network.neutron [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Updating instance_info_cache with network_info: [{"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:46:27 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Successfully detached device vdb from instance cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b from the persistent domain config.
Dec 06 12:46:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sfnVXxkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:46:27 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 06 12:46:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.058s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd38b8c-5bf2-467b-8e76-9fa7655bcc98]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:46:27 user nova-compute[75247]: No targets found.
Dec 06 12:46:27 user nova-compute[75247]: iSNS:
Dec 06 12:46:27 user nova-compute[75247]: No targets found.
Dec 06 12:46:27 user nova-compute[75247]: STATIC:
Dec 06 12:46:27 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b
Dec 06 12:46:27 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:27 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:27 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1
Dec 06 12:46:27 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:27 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:27 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd
Dec 06 12:46:27 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:27 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:27 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:46:27 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:27 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:27 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92
Dec 06 12:46:27 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:27 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:27 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579
Dec 06 12:46:27 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:27 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:27 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482
Dec 06 12:46:27 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:27 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:27 user nova-compute[75247]: FIRMWARE:
Dec 06 12:46:27 user nova-compute[75247]: No targets found.
Dec 06 12:46:27 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:46:27 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:46:27 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Releasing lock "refresh_cache-4531bf11-b948-4d57-bf55-f33563815e26" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG os_brick.utils [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.035s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c29e26-7aec-407d-b089-bce4ec0d502c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cdf39a-d1be-49dd-8335-b2ab0c8a8678]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0399436f-8560-45c0-9e9a-2540859d3d28]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5fea45-1beb-48bc-b45b-0976ff535ea7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:27 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:27 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:27 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:27 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:27 user nova-compute[75247]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:46:27 user nova-compute[75247]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:46:27 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:27 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:27 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:27 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:27 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:27 user nova-compute[75247]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:46:27 user nova-compute[75247]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:46:27 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c645fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579'): ({'sdi'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Removing single pathed devices sdi {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4daa36d8-b43d-4a41-adc7-4167ad7ed358]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5833a578-de1f-4852-80bd-86aa607a60d5]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f3ffa7-0b42-460b-bbcb-c6b42ccc94c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.043s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[74feadd7-b1ce-4b56-b4d3-7d6eced2cd7a]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Flushing IO for device /dev/sdi {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:46:27 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7dcc062-ee08-46f2-9cd0-13313af6e71a]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[195029cc-3e2e-4661-b312-7d727b1243ec]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG os_brick.utils [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] <== get_connector_properties: return (205ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.051s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf09e80-7f66-498c-9030-05a24ce8b7e8]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] SCSI volumes sdi have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ddd026-12d9-471d-8ba5-38dc2da0f3aa]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG nova.network.neutron [req-de1af6eb-91a1-41f0-b775-452eeb99f246 req-df44f972-3833-499b-b920-1907acaef7fd service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Updated VIF entry in instance network info cache for port a8d5f682-76a1-4b39-8153-487fe53a127a. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG nova.network.neutron [req-de1af6eb-91a1-41f0-b775-452eeb99f246 req-df44f972-3833-499b-b920-1907acaef7fd service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Updating instance_info_cache with network_info: [{"id": "a8d5f682-76a1-4b39-8153-487fe53a127a", "address": "fa:16:3e:a7:11:06", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d5f682-76", "ovs_interfaceid": "a8d5f682-76a1-4b39-8153-487fe53a127a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-de1af6eb-91a1-41f0-b775-452eeb99f246 req-df44f972-3833-499b-b920-1907acaef7fd service nova] Releasing lock "refresh_cache-0a86fe94-933a-4e0d-8a65-4834c3d3e40b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c26339d-79b3-49be-aa32-11669e6245ad]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579, portal: 172.16.0.220,3260]
Dec 06 12:46:27 user nova-compute[75247]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579, portal: 172.16.0.220,3260] successful.
Dec 06 12:46:27 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3daa4caf-be9c-4e13-8347-cf77b2cec100]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.553s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] <== disconnect_volume: return (554ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:46:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:46:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-adacb53c-9ca9-4b6b-8a9b-f761af996662 req-ed2c9c39-0f6a-4dbd-a444-60f1e4f7cdcd service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Received event network-vif-unplugged-434efb9d-06e4-413b-b470-4952e114c298 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-adacb53c-9ca9-4b6b-8a9b-f761af996662 req-ed2c9c39-0f6a-4dbd-a444-60f1e4f7cdcd service nova] Acquiring lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-adacb53c-9ca9-4b6b-8a9b-f761af996662 req-ed2c9c39-0f6a-4dbd-a444-60f1e4f7cdcd service nova] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-adacb53c-9ca9-4b6b-8a9b-f761af996662 req-ed2c9c39-0f6a-4dbd-a444-60f1e4f7cdcd service nova] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-adacb53c-9ca9-4b6b-8a9b-f761af996662 req-ed2c9c39-0f6a-4dbd-a444-60f1e4f7cdcd service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] No waiting events found dispatching network-vif-unplugged-434efb9d-06e4-413b-b470-4952e114c298 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:28 user nova-compute[75247]: WARNING nova.compute.manager [req-adacb53c-9ca9-4b6b-8a9b-f761af996662 req-ed2c9c39-0f6a-4dbd-a444-60f1e4f7cdcd service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Received unexpected event network-vif-unplugged-434efb9d-06e4-413b-b470-4952e114c298 for instance with vm_state active and task_state rebuilding.
Dec 06 12:46:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-adacb53c-9ca9-4b6b-8a9b-f761af996662 req-ed2c9c39-0f6a-4dbd-a444-60f1e4f7cdcd service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Received event network-vif-plugged-434efb9d-06e4-413b-b470-4952e114c298 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-adacb53c-9ca9-4b6b-8a9b-f761af996662 req-ed2c9c39-0f6a-4dbd-a444-60f1e4f7cdcd service nova] Acquiring lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-adacb53c-9ca9-4b6b-8a9b-f761af996662 req-ed2c9c39-0f6a-4dbd-a444-60f1e4f7cdcd service nova] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-adacb53c-9ca9-4b6b-8a9b-f761af996662 req-ed2c9c39-0f6a-4dbd-a444-60f1e4f7cdcd service nova] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-adacb53c-9ca9-4b6b-8a9b-f761af996662 req-ed2c9c39-0f6a-4dbd-a444-60f1e4f7cdcd service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] No waiting events found dispatching network-vif-plugged-434efb9d-06e4-413b-b470-4952e114c298 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:28 user nova-compute[75247]: WARNING nova.compute.manager [req-adacb53c-9ca9-4b6b-8a9b-f761af996662 req-ed2c9c39-0f6a-4dbd-a444-60f1e4f7cdcd service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Received unexpected event network-vif-plugged-434efb9d-06e4-413b-b470-4952e114c298 for instance with vm_state active and task_state rebuilding.
Dec 06 12:46:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-a411b63a-68f4-4ae7-9ea5-8c12cd4bdee2 req-e4e6202c-7570-4abf-bf9f-a458d2b4c1e4 service nova] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Received event network-vif-plugged-85ce649b-cff1-4ab2-b9f8-c187f9124936 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a411b63a-68f4-4ae7-9ea5-8c12cd4bdee2 req-e4e6202c-7570-4abf-bf9f-a458d2b4c1e4 service nova] Acquiring lock "97d1f646-bc64-40e2-9418-c89a87473640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a411b63a-68f4-4ae7-9ea5-8c12cd4bdee2 req-e4e6202c-7570-4abf-bf9f-a458d2b4c1e4 service nova] Lock "97d1f646-bc64-40e2-9418-c89a87473640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a411b63a-68f4-4ae7-9ea5-8c12cd4bdee2 req-e4e6202c-7570-4abf-bf9f-a458d2b4c1e4 service nova] Lock "97d1f646-bc64-40e2-9418-c89a87473640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-a411b63a-68f4-4ae7-9ea5-8c12cd4bdee2 req-e4e6202c-7570-4abf-bf9f-a458d2b4c1e4 service nova] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] No waiting events found dispatching network-vif-plugged-85ce649b-cff1-4ab2-b9f8-c187f9124936 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:28 user nova-compute[75247]: WARNING nova.compute.manager [req-a411b63a-68f4-4ae7-9ea5-8c12cd4bdee2 req-e4e6202c-7570-4abf-bf9f-a458d2b4c1e4 service nova] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Received unexpected event network-vif-plugged-85ce649b-cff1-4ab2-b9f8-c187f9124936 for instance with vm_state building and task_state spawning.
Dec 06 12:46:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:29 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Instance destroyed successfully.
Dec 06 12:46:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:44:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2133511103',display_name='tempest-ServerActionsTestOtherA-server-1393924721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2133511103',id=16,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBDhQTUEw1R3RfVHPhzTtaiheMfD6p83eCfaICq1MZJ1xFdfRrt1xoh/Vh31BgL5j0HqUltFVWq6oXJAAH3kNbtsonPlpThgj+8ZXQcR+K3dodbuTA7Es5PaooP9IaaWg==',key_name='tempest-keypair-1057326227',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:44:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a0ccf15765714ca2a8c4700d2d6e3ed2',ramdisk_id='',reservation_id='r-1mxkfe1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2075667053',owner_user_name='tempest-ServerActionsTestOtherA-2075667053-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:46:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13843d8f074da189dbd3e93750b811',uuid=cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "434efb9d-06e4-413b-b470-4952e114c298", "address": "fa:16:3e:b5:b1:be", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434efb9d-06", "ovs_interfaceid": "434efb9d-06e4-413b-b470-4952e114c298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converting VIF {"id": "434efb9d-06e4-413b-b470-4952e114c298", "address": "fa:16:3e:b5:b1:be", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434efb9d-06", "ovs_interfaceid": "434efb9d-06e4-413b-b470-4952e114c298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:b1:be,bridge_name='br-int',has_traffic_filtering=True,id=434efb9d-06e4-413b-b470-4952e114c298,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434efb9d-06') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG os_vif [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:b1:be,bridge_name='br-int',has_traffic_filtering=True,id=434efb9d-06e4-413b-b470-4952e114c298,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434efb9d-06') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap434efb9d-06, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=421e10f8-10e8-4f27-a889-bba2d6a3ba60) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:29 user nova-compute[75247]: INFO os_vif [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:b1:be,bridge_name='br-int',has_traffic_filtering=True,id=434efb9d-06e4-413b-b470-4952e114c298,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434efb9d-06')
Dec 06 12:46:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sfnVXxkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:46:29 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 06 12:46:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5833db9-fad3-4edc-860e-3f27858d6f61]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:46:29 user nova-compute[75247]: No targets found.
Dec 06 12:46:29 user nova-compute[75247]: iSNS:
Dec 06 12:46:29 user nova-compute[75247]: No targets found.
Dec 06 12:46:29 user nova-compute[75247]: STATIC:
Dec 06 12:46:29 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b
Dec 06 12:46:29 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:29 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:29 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1
Dec 06 12:46:29 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:29 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:29 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd
Dec 06 12:46:29 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:29 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:29 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:46:29 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:29 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:29 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92
Dec 06 12:46:29 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:29 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:29 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482
Dec 06 12:46:29 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:29 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:29 user nova-compute[75247]: FIRMWARE:
Dec 06 12:46:29 user nova-compute[75247]: No targets found.
Dec 06 12:46:29 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:46:29 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:46:29 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd877fa-fb09-4f46-a4e3-d0141c08635a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[025a3622-07ab-482c-b216-3c00f56a2ff1]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:29 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:29 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:29 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:29 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:29 user nova-compute[75247]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:46:29 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:29 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:29 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:29 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:29 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:29 user nova-compute[75247]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:46:29 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd730569870>, {}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Disconnecting from: [] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.129s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] <== disconnect_volume: return (130ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:46:29 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Deleting instance files /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b_del
Dec 06 12:46:29 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Deletion of /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b_del complete
Dec 06 12:46:29 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:46:29 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Instance spawned successfully.
Dec 06 12:46:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:29 user nova-compute[75247]: INFO nova.virt.block_device [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Booting with volume 4933a54b-1240-4fda-8beb-b2d5cb8ed579 at /dev/vdb
Dec 06 12:46:29 user nova-compute[75247]: INFO nova.compute.manager [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Took 13.65 seconds to spawn the instance on the hypervisor.
Dec 06 12:46:29 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG os_brick.utils [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d42365-ec87-4e93-afd4-d0e790640923]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2fa751-fb83-4791-bf71-e3e49c852f15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:29 user nova-compute[75247]: INFO nova.compute.manager [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Took 15.62 seconds to build instance.
Dec 06 12:46:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdcfb36-f678-45da-a9a1-2bbdb557d713]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b88462-a5d2-4338-b55c-10ebcb3f68fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ffabf748-f25e-4730-8512-6f9a021509d8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "97d1f646-bc64-40e2-9418-c89a87473640" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.820s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:46:29 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:46:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff56dd4-3137-4449-ad12-deeff16e2d1c]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG os_brick.utils [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:46:29 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Updating existing volume attachment record: 5191e737-7be8-4222-8d21-3649fefb8df4 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:46:30 user nova-compute[75247]: DEBUG nova.compute.manager [req-fff77142-1f67-46e7-9879-7ddc3ba4f32b req-4e28d7b9-bf65-4b3f-9c98-ace01d4d63d8 service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received event network-changed-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:30 user nova-compute[75247]: DEBUG nova.compute.manager [req-fff77142-1f67-46e7-9879-7ddc3ba4f32b req-4e28d7b9-bf65-4b3f-9c98-ace01d4d63d8 service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Refreshing instance network info cache due to event network-changed-a8d5f682-76a1-4b39-8153-487fe53a127a. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:46:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fff77142-1f67-46e7-9879-7ddc3ba4f32b req-4e28d7b9-bf65-4b3f-9c98-ace01d4d63d8 service nova] Acquiring lock "refresh_cache-0a86fe94-933a-4e0d-8a65-4834c3d3e40b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:46:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fff77142-1f67-46e7-9879-7ddc3ba4f32b req-4e28d7b9-bf65-4b3f-9c98-ace01d4d63d8 service nova] Acquired lock "refresh_cache-0a86fe94-933a-4e0d-8a65-4834c3d3e40b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:46:30 user nova-compute[75247]: DEBUG nova.network.neutron [req-fff77142-1f67-46e7-9879-7ddc3ba4f32b req-4e28d7b9-bf65-4b3f-9c98-ace01d4d63d8 service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Refreshing network info cache for port a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:46:31 user nova-compute[75247]: DEBUG nova.network.neutron [req-fff77142-1f67-46e7-9879-7ddc3ba4f32b req-4e28d7b9-bf65-4b3f-9c98-ace01d4d63d8 service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Updated VIF entry in instance network info cache for port a8d5f682-76a1-4b39-8153-487fe53a127a. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:46:31 user nova-compute[75247]: DEBUG nova.network.neutron [req-fff77142-1f67-46e7-9879-7ddc3ba4f32b req-4e28d7b9-bf65-4b3f-9c98-ace01d4d63d8 service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Updating instance_info_cache with network_info: [{"id": "a8d5f682-76a1-4b39-8153-487fe53a127a", "address": "fa:16:3e:a7:11:06", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d5f682-76", "ovs_interfaceid": "a8d5f682-76a1-4b39-8153-487fe53a127a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:46:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fff77142-1f67-46e7-9879-7ddc3ba4f32b req-4e28d7b9-bf65-4b3f-9c98-ace01d4d63d8 service nova] Releasing lock "refresh_cache-0a86fe94-933a-4e0d-8a65-4834c3d3e40b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:46:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:37 user nova-compute[75247]: INFO nova.compute.manager [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Rebooting instance
Dec 06 12:46:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "refresh_cache-0a86fe94-933a-4e0d-8a65-4834c3d3e40b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:46:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquired lock "refresh_cache-0a86fe94-933a-4e0d-8a65-4834c3d3e40b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:46:37 user nova-compute[75247]: DEBUG nova.network.neutron [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:46:37 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a is timed out.
Dec 06 12:46:37 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Successfully detached device vdb from instance a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a from the live domain config.
Dec 06 12:46:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:46:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vtTPyWGA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:46:37 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:46:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:46:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:46:37 user nova-compute[75247]: DEBUG nova.network.neutron [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Updating instance_info_cache with network_info: [{"id": "a8d5f682-76a1-4b39-8153-487fe53a127a", "address": "fa:16:3e:a7:11:06", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d5f682-76", "ovs_interfaceid": "a8d5f682-76a1-4b39-8153-487fe53a127a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:46:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Releasing lock "refresh_cache-0a86fe94-933a-4e0d-8a65-4834c3d3e40b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:46:37 user nova-compute[75247]: DEBUG nova.compute.manager [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4d6a96-43db-48f6-8e65-3d190b346c79]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:46:38 user nova-compute[75247]: No targets found.
Dec 06 12:46:38 user nova-compute[75247]: iSNS:
Dec 06 12:46:38 user nova-compute[75247]: No targets found.
Dec 06 12:46:38 user nova-compute[75247]: STATIC:
Dec 06 12:46:38 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b
Dec 06 12:46:38 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:38 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:38 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1
Dec 06 12:46:38 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:38 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:38 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd
Dec 06 12:46:38 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:38 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:38 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:46:38 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:38 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:38 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92
Dec 06 12:46:38 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:38 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:38 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482
Dec 06 12:46:38 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:38 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:38 user nova-compute[75247]: FIRMWARE:
Dec 06 12:46:38 user nova-compute[75247]: No targets found.
Dec 06 12:46:38 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:46:38 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:46:38 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0795a2-0b15-4a59-a96b-1939b6f251c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cd8938-a1bf-4da9-8166-aab7a95064ec]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:38 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:38 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:38 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:38 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:38 user nova-compute[75247]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:46:38 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:38 user nova-compute[75247]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 (non-flash)
Dec 06 12:46:38 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:38 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:38 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:38 user nova-compute[75247]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:46:38 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c50fe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482'): ({'sde'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Removing single pathed devices sde {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbe1c09-2b98-4645-94f5-c3af188e3482]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7e8fc0-54fb-4d96-9fd5-dd80911db1ab]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Flushing IO for device /dev/sde {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe204a13-17ef-487b-b0c5-a668f451f5a3]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de7401b-ae38-453d-ab6f-1ddec87b0d19]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] SCSI volumes sde have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a3869b-46c2-464d-b1fc-bb630068fe1a]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf7852e-becb-4e6d-82e3-de7d4714265a]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482, portal: 172.16.0.220,3260]
Dec 06 12:46:38 user nova-compute[75247]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482, portal: 172.16.0.220,3260] successful.
Dec 06 12:46:38 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc33ee51-434a-4506-8266-17b7b706f482 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.056s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[980b09ad-2632-4b0a-b26b-91e80cc7c519]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.436s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] <== disconnect_volume: return (438ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG nova.compute.manager [req-10e47a6a-bd19-4799-8eab-34bd4c2d3652 req-246ac9dd-5a26-4b9d-bf67-2eb9fd18871a service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received event network-vif-unplugged-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-10e47a6a-bd19-4799-8eab-34bd4c2d3652 req-246ac9dd-5a26-4b9d-bf67-2eb9fd18871a service nova] Acquiring lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-10e47a6a-bd19-4799-8eab-34bd4c2d3652 req-246ac9dd-5a26-4b9d-bf67-2eb9fd18871a service nova] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-10e47a6a-bd19-4799-8eab-34bd4c2d3652 req-246ac9dd-5a26-4b9d-bf67-2eb9fd18871a service nova] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG nova.compute.manager [req-10e47a6a-bd19-4799-8eab-34bd4c2d3652 req-246ac9dd-5a26-4b9d-bf67-2eb9fd18871a service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] No waiting events found dispatching network-vif-unplugged-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:38 user nova-compute[75247]: WARNING nova.compute.manager [req-10e47a6a-bd19-4799-8eab-34bd4c2d3652 req-246ac9dd-5a26-4b9d-bf67-2eb9fd18871a service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received unexpected event network-vif-unplugged-a8d5f682-76a1-4b39-8153-487fe53a127a for instance with vm_state active and task_state reboot_started_hard.
Dec 06 12:46:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:38 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Instance destroyed successfully.
Dec 06 12:46:38 user nova-compute[75247]: DEBUG nova.objects.instance [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lazy-loading 'resources' on Instance uuid 0a86fe94-933a-4e0d-8a65-4834c3d3e40b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2121046985',display_name='tempest-TestMinimumBasicScenario-server-2121046985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2121046985',id=15,image_ref='a4449aa0-dc9e-4135-81a7-803ee3d8f136',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENALU6V+1C8Yive07KA1tVNytMgJkyJ7zBITPFD/k7QX/C53xnZxG7Nj3ga2MhNQdhymkiPaD/Qm+Y3zch0QuL7UEl+iGb5BUzeR0Hi6d88zrxWSGsr13B14Fl5cFNYSA==',key_name='tempest-TestMinimumBasicScenario-1562390602',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:44:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df4c40ccbb8a410aa0e65c1f5897de97',ramdisk_id='',reservation_id='r-4am3hdod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a4449aa0-dc9e-4135-81a7-803ee3d8f136',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1052287778',owner_user_name='tempest-TestMinimumBasicScenario-1052287778-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:46:38Z,user_data=None,user_id='4548c5d3575e45d787758e52fbf274d6',uuid=0a86fe94-933a-4e0d-8a65-4834c3d3e40b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8d5f682-76a1-4b39-8153-487fe53a127a", "address": "fa:16:3e:a7:11:06", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d5f682-76", "ovs_interfaceid": "a8d5f682-76a1-4b39-8153-487fe53a127a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Converting VIF {"id": "a8d5f682-76a1-4b39-8153-487fe53a127a", "address": "fa:16:3e:a7:11:06", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d5f682-76", "ovs_interfaceid": "a8d5f682-76a1-4b39-8153-487fe53a127a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:11:06,bridge_name='br-int',has_traffic_filtering=True,id=a8d5f682-76a1-4b39-8153-487fe53a127a,network=Network(56756e7a-b384-43a0-88dc-bab3b11e5f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d5f682-76') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG os_vif [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:11:06,bridge_name='br-int',has_traffic_filtering=True,id=a8d5f682-76a1-4b39-8153-487fe53a127a,network=Network(56756e7a-b384-43a0-88dc-bab3b11e5f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d5f682-76') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8d5f682-76, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88201f7a-abe3-42f4-8ccc-3132b0d5ea14) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:38 user nova-compute[75247]: INFO os_vif [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:11:06,bridge_name='br-int',has_traffic_filtering=True,id=a8d5f682-76a1-4b39-8153-487fe53a127a,network=Network(56756e7a-b384-43a0-88dc-bab3b11e5f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d5f682-76')
Dec 06 12:46:38 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBzldZOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:46:38 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:46:38 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:46:38 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba53388-5c07-4fa3-8c3d-9044de8fe2c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:46:39 user nova-compute[75247]: No targets found.
Dec 06 12:46:39 user nova-compute[75247]: iSNS:
Dec 06 12:46:39 user nova-compute[75247]: No targets found.
Dec 06 12:46:39 user nova-compute[75247]: STATIC:
Dec 06 12:46:39 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b
Dec 06 12:46:39 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:39 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:39 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1
Dec 06 12:46:39 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:39 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:39 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd
Dec 06 12:46:39 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:39 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:39 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:46:39 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:39 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:39 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92
Dec 06 12:46:39 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:46:39 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:46:39 user nova-compute[75247]: FIRMWARE:
Dec 06 12:46:39 user nova-compute[75247]: No targets found.
Dec 06 12:46:39 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:46:39 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:46:39 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[98caf5be-8c30-49c1-86e9-ac960b51a18d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c2b4b0-30be-40f7-8a4b-7eca4662dd86]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:39 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:39 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:39 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:39 user nova-compute[75247]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:46:39 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:39 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:39 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:39 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:39 user nova-compute[75247]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:46:39 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c645ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92'): ({'sdh'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Removing single pathed devices sdh {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ae52f7-be27-47ee-ac44-2fb394687beb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00b689f-38b5-4de4-b5f6-473a3ae5f553]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Flushing IO for device /dev/sdh {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6616fa3e-b923-49c4-92fb-175aeb31e00a]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.046s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[df821fe3-4c21-4da2-b8c8-7a88e5c487a7]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] SCSI volumes sdh have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8a7dc9-4608-4413-bf02-40a2681c3842]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bb3df1-bc48-4161-8433-cca3eb4a97c9]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92, portal: 172.16.0.220,3260]
Dec 06 12:46:39 user nova-compute[75247]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92, portal: 172.16.0.220,3260] successful.
Dec 06 12:46:39 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG nova.objects.instance [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'flavor' on Instance uuid a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[72195f8f-1161-4794-8c5f-ff2bb5748976]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] <== disconnect_volume: return (347ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Start _get_guest_xml network_info=[{"id": "a8d5f682-76a1-4b39-8153-487fe53a127a", "address": "fa:16:3e:a7:11:06", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d5f682-76", "ovs_interfaceid": "a8d5f682-76a1-4b39-8153-487fe53a127a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a4449aa0-dc9e-4135-81a7-803ee3d8f136,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': 'a4449aa0-dc9e-4135-81a7-803ee3d8f136'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '73b716d1-c2b6-412a-b0df-3b4a7d3d44a7', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBzldZOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '0a86fe94-933a-4e0d-8a65-4834c3d3e40b', 'attached_at': '', 'detached_at': '', 'volume_id': 'b3c81dcf-076d-4330-aecd-a47fd48c4d92', 'serial': 'b3c81dcf-076d-4330-aecd-a47fd48c4d92'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:46:39 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:46:39 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-db6fec3b-9b3c-45f7-8709-48a5be53ff6a tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.059s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a4449aa0-dc9e-4135-81a7-803ee3d8f136,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG nova.objects.instance [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0a86fe94-933a-4e0d-8a65-4834c3d3e40b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG nova.objects.base [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Object Instance<0a86fe94-933a-4e0d-8a65-4834c3d3e40b> lazy-loaded attributes: resources,vcpu_model {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBzldZOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:46:39 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:46:39 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:46:39 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96a933d-8d3c-4129-bb6a-e1884e5aef0a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:46:39 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbabb8c2-10c4-4800-b124-5fc9a8577a46]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92] added
Dec 06 12:46:39 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc230d1-7465-4249-b71a-bdafe4e26f30]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f3794836-6c34-4041-b869-3195da397f15 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f3794836-6c34-4041-b869-3195da397f15 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f3794836-6c34-4041-b869-3195da397f15 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[534fc0b7-95bc-4592-83c3-a396df543784]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f3794836-6c34-4041-b869-3195da397f15 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75247) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG nova.objects.instance [None req-f3794836-6c34-4041-b869-3195da397f15 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'flavor' on Instance uuid a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yBzldZOa {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yBzldZOa" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d500961-2587-4345-932b-46b30910552e]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yBzldZOa'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1adcd0f-39fe-45a9-a592-7589d5773970]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2be80e6-4c12-47f2-8621-68bcb6c5ba9e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:39 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:39 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:39 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:39 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:39 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:39 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:39 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:39 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9966ff38-ba57-4760-a42d-a898dfcc1bbb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92, portal: 172.16.0.220,3260]
Dec 06 12:46:39 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92, portal: 172.16.0.220,3260] successful.
Dec 06 12:46:39 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab534ef1-7e17-409b-bb49-066385f6bdd5]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f908ed73-f9aa-4219-b2c5-8e25d4d14a44]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:39 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:39 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:39 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:39 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:46:39 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:39 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:39 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:39 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:39 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:46:39 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.562s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.039s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0e0121-fe69-4921-ba6c-8f8803c5ff1d]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBzldZOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG nova.compute.manager [req-a3dba918-6e72-45ed-b26f-1cced1ac08b4 req-28edf2b6-629b-4631-87ae-ba89d31f9e6d service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received event network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a3dba918-6e72-45ed-b26f-1cced1ac08b4 req-28edf2b6-629b-4631-87ae-ba89d31f9e6d service nova] Acquiring lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a3dba918-6e72-45ed-b26f-1cced1ac08b4 req-28edf2b6-629b-4631-87ae-ba89d31f9e6d service nova] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a3dba918-6e72-45ed-b26f-1cced1ac08b4 req-28edf2b6-629b-4631-87ae-ba89d31f9e6d service nova] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG nova.compute.manager [req-a3dba918-6e72-45ed-b26f-1cced1ac08b4 req-28edf2b6-629b-4631-87ae-ba89d31f9e6d service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] No waiting events found dispatching network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:40 user nova-compute[75247]: WARNING nova.compute.manager [req-a3dba918-6e72-45ed-b26f-1cced1ac08b4 req-28edf2b6-629b-4631-87ae-ba89d31f9e6d service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received unexpected event network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a for instance with vm_state active and task_state reboot_started_hard.
Dec 06 12:46:40 user nova-compute[75247]: DEBUG nova.compute.manager [req-a3dba918-6e72-45ed-b26f-1cced1ac08b4 req-28edf2b6-629b-4631-87ae-ba89d31f9e6d service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received event network-vif-unplugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a3dba918-6e72-45ed-b26f-1cced1ac08b4 req-28edf2b6-629b-4631-87ae-ba89d31f9e6d service nova] Acquiring lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a3dba918-6e72-45ed-b26f-1cced1ac08b4 req-28edf2b6-629b-4631-87ae-ba89d31f9e6d service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a3dba918-6e72-45ed-b26f-1cced1ac08b4 req-28edf2b6-629b-4631-87ae-ba89d31f9e6d service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG nova.compute.manager [req-a3dba918-6e72-45ed-b26f-1cced1ac08b4 req-28edf2b6-629b-4631-87ae-ba89d31f9e6d service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] No waiting events found dispatching network-vif-unplugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:40 user nova-compute[75247]: WARNING nova.compute.manager [req-a3dba918-6e72-45ed-b26f-1cced1ac08b4 req-28edf2b6-629b-4631-87ae-ba89d31f9e6d service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received unexpected event network-vif-unplugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc for instance with vm_state active and task_state powering-off.
Dec 06 12:46:40 user nova-compute[75247]: DEBUG nova.compute.manager [req-a3dba918-6e72-45ed-b26f-1cced1ac08b4 req-28edf2b6-629b-4631-87ae-ba89d31f9e6d service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received event network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a3dba918-6e72-45ed-b26f-1cced1ac08b4 req-28edf2b6-629b-4631-87ae-ba89d31f9e6d service nova] Acquiring lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a3dba918-6e72-45ed-b26f-1cced1ac08b4 req-28edf2b6-629b-4631-87ae-ba89d31f9e6d service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a3dba918-6e72-45ed-b26f-1cced1ac08b4 req-28edf2b6-629b-4631-87ae-ba89d31f9e6d service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG nova.compute.manager [req-a3dba918-6e72-45ed-b26f-1cced1ac08b4 req-28edf2b6-629b-4631-87ae-ba89d31f9e6d service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] No waiting events found dispatching network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:40 user nova-compute[75247]: WARNING nova.compute.manager [req-a3dba918-6e72-45ed-b26f-1cced1ac08b4 req-28edf2b6-629b-4631-87ae-ba89d31f9e6d service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received unexpected event network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc for instance with vm_state active and task_state powering-off.
Dec 06 12:46:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:40 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Instance destroyed successfully.
Dec 06 12:46:40 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f3794836-6c34-4041-b869-3195da397f15 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f3794836-6c34-4041-b869-3195da397f15 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.026s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Starting finish_revert_migration {{(pid=75247) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11822}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Start _get_guest_xml network_info=[{"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'efef4279-cf07-4ab5-8eb1-aef0dcae3fa4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YiAyasdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4531bf11-b948-4d57-bf55-f33563815e26', 'attached_at': '2023-12-06T12:46:41.000000', 'detached_at': '', 'volume_id': '6492a8c0-e442-4b99-867a-e95fa38234db', 'serial': '6492a8c0-e442-4b99-867a-e95fa38234db'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:46:40 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:46:40 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:46:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:46:40 user nova-compute[75247]: DEBUG nova.objects.instance [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4531bf11-b948-4d57-bf55-f33563815e26 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YiAyasdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:46:41 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:46:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.625s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] <== connect_volume: return (1627ms) {'type': 'block', 'scsi_wwn': '26234343462396263', 'path': '/dev/sdb'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234343462396263', 'path': '/dev/sdb'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:46:41 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:46:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:46:41 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[416e217e-166d-4a30-a30a-c1618c18e7f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:46:41 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2121046985',display_name='tempest-TestMinimumBasicScenario-server-2121046985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2121046985',id=15,image_ref='a4449aa0-dc9e-4135-81a7-803ee3d8f136',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENALU6V+1C8Yive07KA1tVNytMgJkyJ7zBITPFD/k7QX/C53xnZxG7Nj3ga2MhNQdhymkiPaD/Qm+Y3zch0QuL7UEl+iGb5BUzeR0Hi6d88zrxWSGsr13B14Fl5cFNYSA==',key_name='tempest-TestMinimumBasicScenario-1562390602',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:44:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df4c40ccbb8a410aa0e65c1f5897de97',ramdisk_id='',reservation_id='r-4am3hdod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a4449aa0-dc9e-4135-81a7-803ee3d8f136',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1052287778',owner_user_name='tempest-TestMinimumBasicScenario-1052287778-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:46:38Z,user_data=None,user_id='4548c5d3575e45d787758e52fbf274d6',uuid=0a86fe94-933a-4e0d-8a65-4834c3d3e40b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8d5f682-76a1-4b39-8153-487fe53a127a", "address": "fa:16:3e:a7:11:06", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d5f682-76", "ovs_interfaceid": "a8d5f682-76a1-4b39-8153-487fe53a127a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Converting VIF {"id": "a8d5f682-76a1-4b39-8153-487fe53a127a", "address": "fa:16:3e:a7:11:06", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d5f682-76", "ovs_interfaceid": "a8d5f682-76a1-4b39-8153-487fe53a127a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:11:06,bridge_name='br-int',has_traffic_filtering=True,id=a8d5f682-76a1-4b39-8153-487fe53a127a,network=Network(56756e7a-b384-43a0-88dc-bab3b11e5f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d5f682-76') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG nova.objects.instance [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a86fe94-933a-4e0d-8a65-4834c3d3e40b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ebed77-34e4-4692-9026-e8628ccc9cb2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db] added
Dec 06 12:46:41 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG nova.objects.base [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Object Instance<0a86fe94-933a-4e0d-8a65-4834c3d3e40b> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:46:41 user nova-compute[75247]:   <uuid>0a86fe94-933a-4e0d-8a65-4834c3d3e40b</uuid>
Dec 06 12:46:41 user nova-compute[75247]:   <name>instance-0000000f</name>
Dec 06 12:46:41 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:46:41 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:46:41 user nova-compute[75247]:   <metadata>
Dec 06 12:46:41 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:46:41 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:46:41 user nova-compute[75247]:       <nova:name>tempest-TestMinimumBasicScenario-server-2121046985</nova:name>
Dec 06 12:46:41 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:46:39</nova:creationTime>
Dec 06 12:46:41 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:46:41 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:46:41 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:46:41 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:46:41 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:46:41 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:46:41 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:46:41 user nova-compute[75247]:       <nova:owner>
Dec 06 12:46:41 user nova-compute[75247]:         <nova:user uuid="4548c5d3575e45d787758e52fbf274d6">tempest-TestMinimumBasicScenario-1052287778-project-member</nova:user>
Dec 06 12:46:41 user nova-compute[75247]:         <nova:project uuid="df4c40ccbb8a410aa0e65c1f5897de97">tempest-TestMinimumBasicScenario-1052287778</nova:project>
Dec 06 12:46:41 user nova-compute[75247]:       </nova:owner>
Dec 06 12:46:41 user nova-compute[75247]:       <nova:root type="image" uuid="a4449aa0-dc9e-4135-81a7-803ee3d8f136"/>
Dec 06 12:46:41 user nova-compute[75247]:       <nova:ports>
Dec 06 12:46:41 user nova-compute[75247]:         <nova:port uuid="a8d5f682-76a1-4b39-8153-487fe53a127a">
Dec 06 12:46:41 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 06 12:46:41 user nova-compute[75247]:         </nova:port>
Dec 06 12:46:41 user nova-compute[75247]:       </nova:ports>
Dec 06 12:46:41 user nova-compute[75247]:     </nova:instance>
Dec 06 12:46:41 user nova-compute[75247]:   </metadata>
Dec 06 12:46:41 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:46:41 user nova-compute[75247]:     <system>
Dec 06 12:46:41 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:46:41 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:46:41 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:46:41 user nova-compute[75247]:       <entry name="serial">0a86fe94-933a-4e0d-8a65-4834c3d3e40b</entry>
Dec 06 12:46:41 user nova-compute[75247]:       <entry name="uuid">0a86fe94-933a-4e0d-8a65-4834c3d3e40b</entry>
Dec 06 12:46:41 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:46:41 user nova-compute[75247]:     </system>
Dec 06 12:46:41 user nova-compute[75247]:   </sysinfo>
Dec 06 12:46:41 user nova-compute[75247]:   <os>
Dec 06 12:46:41 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:46:41 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:46:41 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:46:41 user nova-compute[75247]:   </os>
Dec 06 12:46:41 user nova-compute[75247]:   <features>
Dec 06 12:46:41 user nova-compute[75247]:     <acpi/>
Dec 06 12:46:41 user nova-compute[75247]:     <apic/>
Dec 06 12:46:41 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:46:41 user nova-compute[75247]:   </features>
Dec 06 12:46:41 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:46:41 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:46:41 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:46:41 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:46:41 user nova-compute[75247]:   </clock>
Dec 06 12:46:41 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:46:41 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:46:41 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:46:41 user nova-compute[75247]:   </cpu>
Dec 06 12:46:41 user nova-compute[75247]:   <devices>
Dec 06 12:46:41 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:46:41 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:46:41 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk"/>
Dec 06 12:46:41 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:46:41 user nova-compute[75247]:     </disk>
Dec 06 12:46:41 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 12:46:41 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:46:41 user nova-compute[75247]:       <source dev="/dev/sdb"/>
Dec 06 12:46:41 user nova-compute[75247]:       <target dev="vdb" bus="virtio"/>
Dec 06 12:46:41 user nova-compute[75247]:       <serial>b3c81dcf-076d-4330-aecd-a47fd48c4d92</serial>
Dec 06 12:46:41 user nova-compute[75247]:     </disk>
Dec 06 12:46:41 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:46:41 user nova-compute[75247]:       <mac address="fa:16:3e:a7:11:06"/>
Dec 06 12:46:41 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:46:41 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:46:41 user nova-compute[75247]:       <target dev="tapa8d5f682-76"/>
Dec 06 12:46:41 user nova-compute[75247]:     </interface>
Dec 06 12:46:41 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:46:41 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/console.log" append="off"/>
Dec 06 12:46:41 user nova-compute[75247]:     </serial>
Dec 06 12:46:41 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:46:41 user nova-compute[75247]:     <video>
Dec 06 12:46:41 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:46:41 user nova-compute[75247]:     </video>
Dec 06 12:46:41 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:46:41 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:46:41 user nova-compute[75247]:     </rng>
Dec 06 12:46:41 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:46:41 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:46:41 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:46:41 user nova-compute[75247]:     </memballoon>
Dec 06 12:46:41 user nova-compute[75247]:   </devices>
Dec 06 12:46:41 user nova-compute[75247]: </domain>
Dec 06 12:46:41 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06b1956-fae2-41ae-a38f-6c0683d23b23]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[036ee229-6ee7-4740-9d9e-2a2850dac16b]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YiAyasdQ {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YiAyasdQ" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1285ec60-a639-4a38-8759-918b3a222623]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YiAyasdQ'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b868383-65de-47b0-b5b2-73f07c2dd995]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c309fb-f4eb-42e1-8279-50e697996876]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:41 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:41 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:41 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:41 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:46:41 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:41 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:41 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:41 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:41 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:46:41 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG nova.objects.instance [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0a86fe94-933a-4e0d-8a65-4834c3d3e40b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG nova.objects.base [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Object Instance<0a86fe94-933a-4e0d-8a65-4834c3d3e40b> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d46650896f9d747b9b763e9025ff6d0988cc343 --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d46650896f9d747b9b763e9025ff6d0988cc343 --force-share --output=json" returned: 0 in 0.230s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:46:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Cannot resize image /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG nova.objects.instance [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lazy-loading 'migration_context' on Instance uuid 0a86fe94-933a-4e0d-8a65-4834c3d3e40b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG nova.objects.base [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Object Instance<0a86fe94-933a-4e0d-8a65-4834c3d3e40b> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2121046985',display_name='tempest-TestMinimumBasicScenario-server-2121046985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2121046985',id=15,image_ref='a4449aa0-dc9e-4135-81a7-803ee3d8f136',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENALU6V+1C8Yive07KA1tVNytMgJkyJ7zBITPFD/k7QX/C53xnZxG7Nj3ga2MhNQdhymkiPaD/Qm+Y3zch0QuL7UEl+iGb5BUzeR0Hi6d88zrxWSGsr13B14Fl5cFNYSA==',key_name='tempest-TestMinimumBasicScenario-1562390602',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:44:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='df4c40ccbb8a410aa0e65c1f5897de97',ramdisk_id='',reservation_id='r-4am3hdod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a4449aa0-dc9e-4135-81a7-803ee3d8f136',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1052287778',owner_user_name='tempest-TestMinimumBasicScenario-1052287778-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:46:38Z,user_data=None,user_id='4548c5d3575e45d787758e52fbf274d6',uuid=0a86fe94-933a-4e0d-8a65-4834c3d3e40b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8d5f682-76a1-4b39-8153-487fe53a127a", "address": "fa:16:3e:a7:11:06", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d5f682-76", "ovs_interfaceid": "a8d5f682-76a1-4b39-8153-487fe53a127a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Converting VIF {"id": "a8d5f682-76a1-4b39-8153-487fe53a127a", "address": "fa:16:3e:a7:11:06", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d5f682-76", "ovs_interfaceid": "a8d5f682-76a1-4b39-8153-487fe53a127a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:11:06,bridge_name='br-int',has_traffic_filtering=True,id=a8d5f682-76a1-4b39-8153-487fe53a127a,network=Network(56756e7a-b384-43a0-88dc-bab3b11e5f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d5f682-76') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG os_vif [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:11:06,bridge_name='br-int',has_traffic_filtering=True,id=a8d5f682-76a1-4b39-8153-487fe53a127a,network=Network(56756e7a-b384-43a0-88dc-bab3b11e5f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d5f682-76') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a6c0242-f1d6-5c1b-bbcf-454a4569680f', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8d5f682-76, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8d5f682-76, col_values=(('qos', UUID('9ebf1f23-5749-408b-83c0-7911d3279b42')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8d5f682-76, col_values=(('external_ids', {'iface-id': 'a8d5f682-76a1-4b39-8153-487fe53a127a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:11:06', 'vm-uuid': '0a86fe94-933a-4e0d-8a65-4834c3d3e40b'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:42 user nova-compute[75247]: INFO os_vif [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:11:06,bridge_name='br-int',has_traffic_filtering=True,id=a8d5f682-76a1-4b39-8153-487fe53a127a,network=Network(56756e7a-b384-43a0-88dc-bab3b11e5f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d5f682-76')
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --login" returned: 0 in 1.100s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[481ad388-58e6-4280-bd1d-c9fe42243a82]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db, portal: 172.16.0.220,3260]
Dec 06 12:46:42 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db, portal: 172.16.0.220,3260] successful.
Dec 06 12:46:42 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc96319c-412d-4e1c-b6d4-f97dae3657ae]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d33f94-206d-4e18-843e-c61d6434e94f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:42 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:42 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:42 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:42 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:46:42 user nova-compute[75247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:42 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:42 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:42 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:42 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:42 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:46:42 user nova-compute[75247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:42 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.420s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d160e0-8433-4470-be0b-8ac55fca11f8]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: None {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG nova.compute.manager [req-a18693fe-c453-422e-935f-ff76051872c6 req-99913ff2-a268-41ca-9a41-c8bd7dcf57d9 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received event network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a18693fe-c453-422e-935f-ff76051872c6 req-99913ff2-a268-41ca-9a41-c8bd7dcf57d9 service nova] Acquiring lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a18693fe-c453-422e-935f-ff76051872c6 req-99913ff2-a268-41ca-9a41-c8bd7dcf57d9 service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a18693fe-c453-422e-935f-ff76051872c6 req-99913ff2-a268-41ca-9a41-c8bd7dcf57d9 service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG nova.compute.manager [req-a18693fe-c453-422e-935f-ff76051872c6 req-99913ff2-a268-41ca-9a41-c8bd7dcf57d9 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] No waiting events found dispatching network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:42 user nova-compute[75247]: WARNING nova.compute.manager [req-a18693fe-c453-422e-935f-ff76051872c6 req-99913ff2-a268-41ca-9a41-c8bd7dcf57d9 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received unexpected event network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc for instance with vm_state stopped and task_state None.
Dec 06 12:46:42 user nova-compute[75247]: DEBUG nova.compute.manager [req-a18693fe-c453-422e-935f-ff76051872c6 req-99913ff2-a268-41ca-9a41-c8bd7dcf57d9 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received event network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a18693fe-c453-422e-935f-ff76051872c6 req-99913ff2-a268-41ca-9a41-c8bd7dcf57d9 service nova] Acquiring lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a18693fe-c453-422e-935f-ff76051872c6 req-99913ff2-a268-41ca-9a41-c8bd7dcf57d9 service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a18693fe-c453-422e-935f-ff76051872c6 req-99913ff2-a268-41ca-9a41-c8bd7dcf57d9 service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG nova.compute.manager [req-a18693fe-c453-422e-935f-ff76051872c6 req-99913ff2-a268-41ca-9a41-c8bd7dcf57d9 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] No waiting events found dispatching network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:42 user nova-compute[75247]: WARNING nova.compute.manager [req-a18693fe-c453-422e-935f-ff76051872c6 req-99913ff2-a268-41ca-9a41-c8bd7dcf57d9 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received unexpected event network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc for instance with vm_state stopped and task_state None.
Dec 06 12:46:42 user nova-compute[75247]: DEBUG nova.compute.manager [req-a18693fe-c453-422e-935f-ff76051872c6 req-99913ff2-a268-41ca-9a41-c8bd7dcf57d9 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received event network-vif-unplugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a18693fe-c453-422e-935f-ff76051872c6 req-99913ff2-a268-41ca-9a41-c8bd7dcf57d9 service nova] Acquiring lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a18693fe-c453-422e-935f-ff76051872c6 req-99913ff2-a268-41ca-9a41-c8bd7dcf57d9 service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a18693fe-c453-422e-935f-ff76051872c6 req-99913ff2-a268-41ca-9a41-c8bd7dcf57d9 service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG nova.compute.manager [req-a18693fe-c453-422e-935f-ff76051872c6 req-99913ff2-a268-41ca-9a41-c8bd7dcf57d9 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] No waiting events found dispatching network-vif-unplugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:42 user nova-compute[75247]: WARNING nova.compute.manager [req-a18693fe-c453-422e-935f-ff76051872c6 req-99913ff2-a268-41ca-9a41-c8bd7dcf57d9 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received unexpected event network-vif-unplugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc for instance with vm_state stopped and task_state None.
Dec 06 12:46:42 user nova-compute[75247]: DEBUG nova.compute.manager [req-a18693fe-c453-422e-935f-ff76051872c6 req-99913ff2-a268-41ca-9a41-c8bd7dcf57d9 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received event network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a18693fe-c453-422e-935f-ff76051872c6 req-99913ff2-a268-41ca-9a41-c8bd7dcf57d9 service nova] Acquiring lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a18693fe-c453-422e-935f-ff76051872c6 req-99913ff2-a268-41ca-9a41-c8bd7dcf57d9 service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a18693fe-c453-422e-935f-ff76051872c6 req-99913ff2-a268-41ca-9a41-c8bd7dcf57d9 service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG nova.compute.manager [req-a18693fe-c453-422e-935f-ff76051872c6 req-99913ff2-a268-41ca-9a41-c8bd7dcf57d9 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] No waiting events found dispatching network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:42 user nova-compute[75247]: WARNING nova.compute.manager [req-a18693fe-c453-422e-935f-ff76051872c6 req-99913ff2-a268-41ca-9a41-c8bd7dcf57d9 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received unexpected event network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc for instance with vm_state stopped and task_state None.
Dec 06 12:46:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:46:42 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Creating image(s)
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "/opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "/opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.221s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.190s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk 1073741824" returned: 0 in 0.052s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.185s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YiAyasdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.462s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] <== connect_volume: return (2467ms) {'type': 'block', 'scsi_wwn': '23837616363616163', 'path': '/dev/sde'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837616363616163', 'path': '/dev/sde'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1307258181',display_name='tempest-ServerActionsTestOtherB-server-1307258181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1307258181',id=5,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXd4LdKL4pG7XKtcC6TX8wMNmPTD7z6hx6EQTzh/vLbbeocUHdpJ42qGTjwVyD4AThWLqebjjgjZMtQsvJgysEhbuskpjq8ZyizdS/bi/KghYHYkKPwpNCJccaNThNvgg==',key_name='tempest-keypair-1971386181',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:44:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='57ba4e5fa37f4fd29d6712069230d3e6',ramdisk_id='',reservation_id='r-wbn2uy0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-472154126',owner_user_name='tempest-ServerActionsTestOtherB-472154126-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:46:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd4165666a1426aa1134c2889214b0f',uuid=4531bf11-b948-4d57-bf55-f33563815e26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Converting VIF {"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=348d8e54-a814-4893-8636-de9e795794a2,network=Network(7d8127bc-30f6-40e2-9bd3-2054440440d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348d8e54-a8') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:46:43 user nova-compute[75247]:   <uuid>4531bf11-b948-4d57-bf55-f33563815e26</uuid>
Dec 06 12:46:43 user nova-compute[75247]:   <name>instance-00000005</name>
Dec 06 12:46:43 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:46:43 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:46:43 user nova-compute[75247]:   <metadata>
Dec 06 12:46:43 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:46:43 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:46:43 user nova-compute[75247]:       <nova:name>tempest-ServerActionsTestOtherB-server-1307258181</nova:name>
Dec 06 12:46:43 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:46:40</nova:creationTime>
Dec 06 12:46:43 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:46:43 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:46:43 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:46:43 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:46:43 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:46:43 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:46:43 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:46:43 user nova-compute[75247]:       <nova:owner>
Dec 06 12:46:43 user nova-compute[75247]:         <nova:user uuid="5dd4165666a1426aa1134c2889214b0f">tempest-ServerActionsTestOtherB-472154126-project-member</nova:user>
Dec 06 12:46:43 user nova-compute[75247]:         <nova:project uuid="57ba4e5fa37f4fd29d6712069230d3e6">tempest-ServerActionsTestOtherB-472154126</nova:project>
Dec 06 12:46:43 user nova-compute[75247]:       </nova:owner>
Dec 06 12:46:43 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:46:43 user nova-compute[75247]:       <nova:ports>
Dec 06 12:46:43 user nova-compute[75247]:         <nova:port uuid="348d8e54-a814-4893-8636-de9e795794a2">
Dec 06 12:46:43 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 06 12:46:43 user nova-compute[75247]:         </nova:port>
Dec 06 12:46:43 user nova-compute[75247]:       </nova:ports>
Dec 06 12:46:43 user nova-compute[75247]:     </nova:instance>
Dec 06 12:46:43 user nova-compute[75247]:   </metadata>
Dec 06 12:46:43 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:46:43 user nova-compute[75247]:     <system>
Dec 06 12:46:43 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:46:43 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:46:43 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:46:43 user nova-compute[75247]:       <entry name="serial">4531bf11-b948-4d57-bf55-f33563815e26</entry>
Dec 06 12:46:43 user nova-compute[75247]:       <entry name="uuid">4531bf11-b948-4d57-bf55-f33563815e26</entry>
Dec 06 12:46:43 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:46:43 user nova-compute[75247]:     </system>
Dec 06 12:46:43 user nova-compute[75247]:   </sysinfo>
Dec 06 12:46:43 user nova-compute[75247]:   <os>
Dec 06 12:46:43 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:46:43 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:46:43 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:46:43 user nova-compute[75247]:   </os>
Dec 06 12:46:43 user nova-compute[75247]:   <features>
Dec 06 12:46:43 user nova-compute[75247]:     <acpi/>
Dec 06 12:46:43 user nova-compute[75247]:     <apic/>
Dec 06 12:46:43 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:46:43 user nova-compute[75247]:   </features>
Dec 06 12:46:43 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:46:43 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:46:43 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:46:43 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:46:43 user nova-compute[75247]:   </clock>
Dec 06 12:46:43 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:46:43 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:46:43 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:46:43 user nova-compute[75247]:   </cpu>
Dec 06 12:46:43 user nova-compute[75247]:   <devices>
Dec 06 12:46:43 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:46:43 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:46:43 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk"/>
Dec 06 12:46:43 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:46:43 user nova-compute[75247]:     </disk>
Dec 06 12:46:43 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 12:46:43 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:46:43 user nova-compute[75247]:       <source dev="/dev/sde"/>
Dec 06 12:46:43 user nova-compute[75247]:       <target dev="vdb" bus="virtio"/>
Dec 06 12:46:43 user nova-compute[75247]:       <serial>6492a8c0-e442-4b99-867a-e95fa38234db</serial>
Dec 06 12:46:43 user nova-compute[75247]:     </disk>
Dec 06 12:46:43 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:46:43 user nova-compute[75247]:       <mac address="fa:16:3e:7d:fe:f6"/>
Dec 06 12:46:43 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:46:43 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:46:43 user nova-compute[75247]:       <target dev="tap348d8e54-a8"/>
Dec 06 12:46:43 user nova-compute[75247]:     </interface>
Dec 06 12:46:43 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:46:43 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/console.log" append="off"/>
Dec 06 12:46:43 user nova-compute[75247]:     </serial>
Dec 06 12:46:43 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:46:43 user nova-compute[75247]:     <video>
Dec 06 12:46:43 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:46:43 user nova-compute[75247]:     </video>
Dec 06 12:46:43 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:46:43 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:46:43 user nova-compute[75247]:     </rng>
Dec 06 12:46:43 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:46:43 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:46:43 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:46:43 user nova-compute[75247]:     </memballoon>
Dec 06 12:46:43 user nova-compute[75247]:   </devices>
Dec 06 12:46:43 user nova-compute[75247]: </domain>
Dec 06 12:46:43 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1307258181',display_name='tempest-ServerActionsTestOtherB-server-1307258181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1307258181',id=5,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXd4LdKL4pG7XKtcC6TX8wMNmPTD7z6hx6EQTzh/vLbbeocUHdpJ42qGTjwVyD4AThWLqebjjgjZMtQsvJgysEhbuskpjq8ZyizdS/bi/KghYHYkKPwpNCJccaNThNvgg==',key_name='tempest-keypair-1971386181',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:44:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='57ba4e5fa37f4fd29d6712069230d3e6',ramdisk_id='',reservation_id='r-wbn2uy0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-472154126',owner_user_name='tempest-ServerActionsTestOtherB-472154126-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:46:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd4165666a1426aa1134c2889214b0f',uuid=4531bf11-b948-4d57-bf55-f33563815e26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Converting VIF {"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=348d8e54-a814-4893-8636-de9e795794a2,network=Network(7d8127bc-30f6-40e2-9bd3-2054440440d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348d8e54-a8') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG os_vif [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=348d8e54-a814-4893-8636-de9e795794a2,network=Network(7d8127bc-30f6-40e2-9bd3-2054440440d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348d8e54-a8') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2e811f34-8db5-5fe0-9563-f5f73c51a248', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap348d8e54-a8, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap348d8e54-a8, col_values=(('qos', UUID('40b47a7a-37c1-4d0a-ac8b-fffd356675e1')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap348d8e54-a8, col_values=(('external_ids', {'iface-id': '348d8e54-a814-4893-8636-de9e795794a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:fe:f6', 'vm-uuid': '4531bf11-b948-4d57-bf55-f33563815e26'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Cannot resize image /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Ensure instance console log exists: /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Start _get_guest_xml network_info=[{"id": "434efb9d-06e4-413b-b470-4952e114c298", "address": "fa:16:3e:b5:b1:be", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434efb9d-06", "ovs_interfaceid": "434efb9d-06e4-413b-b470-4952e114c298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '5191e737-7be8-4222-8d21-3649fefb8df4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sfnVXxkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b', 'attached_at': '', 'detached_at': '', 'volume_id': '4933a54b-1240-4fda-8beb-b2d5cb8ed579', 'serial': '4933a54b-1240-4fda-8beb-b2d5cb8ed579'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:43 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 06 12:46:43 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 06 12:46:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:43 user nova-compute[75247]: INFO os_vif [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=348d8e54-a814-4893-8636-de9e795794a2,network=Network(7d8127bc-30f6-40e2-9bd3-2054440440d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348d8e54-a8')
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.objects.instance [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lazy-loading 'vcpu_model' on Instance uuid cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sfnVXxkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:46:43 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 06 12:46:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:46:43 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 06 12:46:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:46:43 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:46:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1377f94c-f866-4a43-9b30-b709425a5fbe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:46:43 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[28231160-0fe9-4806-95cb-f37c7ef25675]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579] added
Dec 06 12:46:43 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cd78a7-8053-445b-8949-5c02cc4d5381]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff508ea2-cf57-41fb-b837-bb1c8a7ac703]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sfnVXxkD {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sfnVXxkD" returned: 0 in 0.033s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ace2854-77cf-4835-8c4c-0876d4a761b8]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sfnVXxkD'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e5d339-50f5-4cd7-a1b6-6a5dfc85a354]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e817fb9c-2c97-4b59-a076-3c05702cc12a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:43 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:43 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:43 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:43 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:46:43 user nova-compute[75247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:43 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:43 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:43 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:43 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:43 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:46:43 user nova-compute[75247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:43 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:46:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6865a1c-5c9e-4d9e-9420-42a84845a4a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579, portal: 172.16.0.220,3260]
Dec 06 12:46:44 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579, portal: 172.16.0.220,3260] successful.
Dec 06 12:46:44 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6973cc-0195-4596-85e3-8f9e441d62fb]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a357df09-7607-436b-9229-de8cf8f61fa7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:44 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:44 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:44 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:44 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:46:44 user nova-compute[75247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:44 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:46:44 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:46:44 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:46:44 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:46:44 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:46:44 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:46:44 user nova-compute[75247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:46:44 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:46:44 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.404s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] HCTL ('39', '-', '-', 0) found on session 28 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11cd2d6-1cb2-419f-830a-c3bb1e399c3d]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Searching for a device in session 28 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sfnVXxkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG nova.compute.manager [req-78e7cebb-2472-4ce7-a9c4-54f07d188463 req-81a2c902-14c9-4ae3-b0b8-55e709386dbc service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received event network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-78e7cebb-2472-4ce7-a9c4-54f07d188463 req-81a2c902-14c9-4ae3-b0b8-55e709386dbc service nova] Acquiring lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-78e7cebb-2472-4ce7-a9c4-54f07d188463 req-81a2c902-14c9-4ae3-b0b8-55e709386dbc service nova] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-78e7cebb-2472-4ce7-a9c4-54f07d188463 req-81a2c902-14c9-4ae3-b0b8-55e709386dbc service nova] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG nova.compute.manager [req-78e7cebb-2472-4ce7-a9c4-54f07d188463 req-81a2c902-14c9-4ae3-b0b8-55e709386dbc service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] No waiting events found dispatching network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:44 user nova-compute[75247]: WARNING nova.compute.manager [req-78e7cebb-2472-4ce7-a9c4-54f07d188463 req-81a2c902-14c9-4ae3-b0b8-55e709386dbc service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received unexpected event network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a for instance with vm_state active and task_state reboot_started_hard.
Dec 06 12:46:44 user nova-compute[75247]: DEBUG nova.compute.manager [req-78e7cebb-2472-4ce7-a9c4-54f07d188463 req-81a2c902-14c9-4ae3-b0b8-55e709386dbc service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received event network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-78e7cebb-2472-4ce7-a9c4-54f07d188463 req-81a2c902-14c9-4ae3-b0b8-55e709386dbc service nova] Acquiring lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-78e7cebb-2472-4ce7-a9c4-54f07d188463 req-81a2c902-14c9-4ae3-b0b8-55e709386dbc service nova] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-78e7cebb-2472-4ce7-a9c4-54f07d188463 req-81a2c902-14c9-4ae3-b0b8-55e709386dbc service nova] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG nova.compute.manager [req-78e7cebb-2472-4ce7-a9c4-54f07d188463 req-81a2c902-14c9-4ae3-b0b8-55e709386dbc service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] No waiting events found dispatching network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:44 user nova-compute[75247]: WARNING nova.compute.manager [req-78e7cebb-2472-4ce7-a9c4-54f07d188463 req-81a2c902-14c9-4ae3-b0b8-55e709386dbc service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received unexpected event network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a for instance with vm_state active and task_state reboot_started_hard.
Dec 06 12:46:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.456s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] <== connect_volume: return (1458ms) {'type': 'block', 'scsi_wwn': '23266386265653230', 'path': '/dev/sdh'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266386265653230', 'path': '/dev/sdh'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T12:44:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2133511103',display_name='tempest-ServerActionsTestOtherA-server-1393924721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2133511103',id=16,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBDhQTUEw1R3RfVHPhzTtaiheMfD6p83eCfaICq1MZJ1xFdfRrt1xoh/Vh31BgL5j0HqUltFVWq6oXJAAH3kNbtsonPlpThgj+8ZXQcR+K3dodbuTA7Es5PaooP9IaaWg==',key_name='tempest-keypair-1057326227',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:44:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a0ccf15765714ca2a8c4700d2d6e3ed2',ramdisk_id='',reservation_id='r-1mxkfe1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2075667053',owner_user_name='tempest-ServerActionsTestOtherA-2075667053-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:46:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13843d8f074da189dbd3e93750b811',uuid=cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "434efb9d-06e4-413b-b470-4952e114c298", "address": "fa:16:3e:b5:b1:be", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434efb9d-06", "ovs_interfaceid": "434efb9d-06e4-413b-b470-4952e114c298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converting VIF {"id": "434efb9d-06e4-413b-b470-4952e114c298", "address": "fa:16:3e:b5:b1:be", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434efb9d-06", "ovs_interfaceid": "434efb9d-06e4-413b-b470-4952e114c298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:b1:be,bridge_name='br-int',has_traffic_filtering=True,id=434efb9d-06e4-413b-b470-4952e114c298,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434efb9d-06') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:46:45 user nova-compute[75247]:   <uuid>cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b</uuid>
Dec 06 12:46:45 user nova-compute[75247]:   <name>instance-00000010</name>
Dec 06 12:46:45 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:46:45 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:46:45 user nova-compute[75247]:   <metadata>
Dec 06 12:46:45 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:46:45 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:46:45 user nova-compute[75247]:       <nova:name>tempest-ServerActionsTestOtherA-server-1393924721</nova:name>
Dec 06 12:46:45 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:46:43</nova:creationTime>
Dec 06 12:46:45 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:46:45 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:46:45 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:46:45 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:46:45 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:46:45 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:46:45 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:46:45 user nova-compute[75247]:       <nova:owner>
Dec 06 12:46:45 user nova-compute[75247]:         <nova:user uuid="fc13843d8f074da189dbd3e93750b811">tempest-ServerActionsTestOtherA-2075667053-project-member</nova:user>
Dec 06 12:46:45 user nova-compute[75247]:         <nova:project uuid="a0ccf15765714ca2a8c4700d2d6e3ed2">tempest-ServerActionsTestOtherA-2075667053</nova:project>
Dec 06 12:46:45 user nova-compute[75247]:       </nova:owner>
Dec 06 12:46:45 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:46:45 user nova-compute[75247]:       <nova:ports>
Dec 06 12:46:45 user nova-compute[75247]:         <nova:port uuid="434efb9d-06e4-413b-b470-4952e114c298">
Dec 06 12:46:45 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 06 12:46:45 user nova-compute[75247]:         </nova:port>
Dec 06 12:46:45 user nova-compute[75247]:       </nova:ports>
Dec 06 12:46:45 user nova-compute[75247]:     </nova:instance>
Dec 06 12:46:45 user nova-compute[75247]:   </metadata>
Dec 06 12:46:45 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:46:45 user nova-compute[75247]:     <system>
Dec 06 12:46:45 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:46:45 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:46:45 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:46:45 user nova-compute[75247]:       <entry name="serial">cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b</entry>
Dec 06 12:46:45 user nova-compute[75247]:       <entry name="uuid">cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b</entry>
Dec 06 12:46:45 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:46:45 user nova-compute[75247]:     </system>
Dec 06 12:46:45 user nova-compute[75247]:   </sysinfo>
Dec 06 12:46:45 user nova-compute[75247]:   <os>
Dec 06 12:46:45 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:46:45 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:46:45 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:46:45 user nova-compute[75247]:   </os>
Dec 06 12:46:45 user nova-compute[75247]:   <features>
Dec 06 12:46:45 user nova-compute[75247]:     <acpi/>
Dec 06 12:46:45 user nova-compute[75247]:     <apic/>
Dec 06 12:46:45 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:46:45 user nova-compute[75247]:   </features>
Dec 06 12:46:45 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:46:45 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:46:45 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:46:45 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:46:45 user nova-compute[75247]:   </clock>
Dec 06 12:46:45 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:46:45 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:46:45 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:46:45 user nova-compute[75247]:   </cpu>
Dec 06 12:46:45 user nova-compute[75247]:   <devices>
Dec 06 12:46:45 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:46:45 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:46:45 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk"/>
Dec 06 12:46:45 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:46:45 user nova-compute[75247]:     </disk>
Dec 06 12:46:45 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 12:46:45 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:46:45 user nova-compute[75247]:       <source dev="/dev/sdh"/>
Dec 06 12:46:45 user nova-compute[75247]:       <target dev="vdb" bus="virtio"/>
Dec 06 12:46:45 user nova-compute[75247]:       <serial>4933a54b-1240-4fda-8beb-b2d5cb8ed579</serial>
Dec 06 12:46:45 user nova-compute[75247]:     </disk>
Dec 06 12:46:45 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:46:45 user nova-compute[75247]:       <mac address="fa:16:3e:b5:b1:be"/>
Dec 06 12:46:45 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:46:45 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:46:45 user nova-compute[75247]:       <target dev="tap434efb9d-06"/>
Dec 06 12:46:45 user nova-compute[75247]:     </interface>
Dec 06 12:46:45 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:46:45 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/console.log" append="off"/>
Dec 06 12:46:45 user nova-compute[75247]:     </serial>
Dec 06 12:46:45 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:46:45 user nova-compute[75247]:     <video>
Dec 06 12:46:45 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:46:45 user nova-compute[75247]:     </video>
Dec 06 12:46:45 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:46:45 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:46:45 user nova-compute[75247]:     </rng>
Dec 06 12:46:45 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:46:45 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:46:45 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:46:45 user nova-compute[75247]:     </memballoon>
Dec 06 12:46:45 user nova-compute[75247]:   </devices>
Dec 06 12:46:45 user nova-compute[75247]: </domain>
Dec 06 12:46:45 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T12:44:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2133511103',display_name='tempest-ServerActionsTestOtherA-server-1393924721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2133511103',id=16,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBDhQTUEw1R3RfVHPhzTtaiheMfD6p83eCfaICq1MZJ1xFdfRrt1xoh/Vh31BgL5j0HqUltFVWq6oXJAAH3kNbtsonPlpThgj+8ZXQcR+K3dodbuTA7Es5PaooP9IaaWg==',key_name='tempest-keypair-1057326227',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:44:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a0ccf15765714ca2a8c4700d2d6e3ed2',ramdisk_id='',reservation_id='r-1mxkfe1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2075667053',owner_user_name='tempest-ServerActionsTestOtherA-2075667053-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:46:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13843d8f074da189dbd3e93750b811',uuid=cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "434efb9d-06e4-413b-b470-4952e114c298", "address": "fa:16:3e:b5:b1:be", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434efb9d-06", "ovs_interfaceid": "434efb9d-06e4-413b-b470-4952e114c298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converting VIF {"id": "434efb9d-06e4-413b-b470-4952e114c298", "address": "fa:16:3e:b5:b1:be", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434efb9d-06", "ovs_interfaceid": "434efb9d-06e4-413b-b470-4952e114c298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:b1:be,bridge_name='br-int',has_traffic_filtering=True,id=434efb9d-06e4-413b-b470-4952e114c298,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434efb9d-06') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG os_vif [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:b1:be,bridge_name='br-int',has_traffic_filtering=True,id=434efb9d-06e4-413b-b470-4952e114c298,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434efb9d-06') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4cea2c49-bfdd-5ecf-9c01-074f92595daa', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap434efb9d-06, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap434efb9d-06, col_values=(('qos', UUID('71be5a38-ee3e-45ab-ac08-d050a9f07d07')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap434efb9d-06, col_values=(('external_ids', {'iface-id': '434efb9d-06e4-413b-b470-4952e114c298', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:b1:be', 'vm-uuid': 'cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:45 user nova-compute[75247]: INFO os_vif [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:b1:be,bridge_name='br-int',has_traffic_filtering=True,id=434efb9d-06e4-413b-b470-4952e114c298,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434efb9d-06')
Dec 06 12:46:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] No VIF found with MAC fa:16:3e:b5:b1:be, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG nova.compute.manager [req-6c745407-889a-43ca-9398-d5711ebc4284 req-72eb4b51-17eb-493a-891f-d507fe27a300 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received event network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6c745407-889a-43ca-9398-d5711ebc4284 req-72eb4b51-17eb-493a-891f-d507fe27a300 service nova] Acquiring lock "4531bf11-b948-4d57-bf55-f33563815e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6c745407-889a-43ca-9398-d5711ebc4284 req-72eb4b51-17eb-493a-891f-d507fe27a300 service nova] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6c745407-889a-43ca-9398-d5711ebc4284 req-72eb4b51-17eb-493a-891f-d507fe27a300 service nova] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:45 user nova-compute[75247]: DEBUG nova.compute.manager [req-6c745407-889a-43ca-9398-d5711ebc4284 req-72eb4b51-17eb-493a-891f-d507fe27a300 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] No waiting events found dispatching network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:45 user nova-compute[75247]: WARNING nova.compute.manager [req-6c745407-889a-43ca-9398-d5711ebc4284 req-72eb4b51-17eb-493a-891f-d507fe27a300 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received unexpected event network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 for instance with vm_state resized and task_state resize_reverting.
Dec 06 12:46:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:47 user nova-compute[75247]: DEBUG nova.compute.manager [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:46:47 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Instance rebooted successfully.
Dec 06 12:46:47 user nova-compute[75247]: DEBUG nova.compute.manager [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:46:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-a09669de-55f4-4234-8a65-a06d676f2927 req-126a1fb5-2742-45f1-b4da-43c84930bc01 service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Received event network-vif-plugged-434efb9d-06e4-413b-b470-4952e114c298 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a09669de-55f4-4234-8a65-a06d676f2927 req-126a1fb5-2742-45f1-b4da-43c84930bc01 service nova] Acquiring lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a09669de-55f4-4234-8a65-a06d676f2927 req-126a1fb5-2742-45f1-b4da-43c84930bc01 service nova] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a09669de-55f4-4234-8a65-a06d676f2927 req-126a1fb5-2742-45f1-b4da-43c84930bc01 service nova] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-a09669de-55f4-4234-8a65-a06d676f2927 req-126a1fb5-2742-45f1-b4da-43c84930bc01 service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] No waiting events found dispatching network-vif-plugged-434efb9d-06e4-413b-b470-4952e114c298 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:47 user nova-compute[75247]: WARNING nova.compute.manager [req-a09669de-55f4-4234-8a65-a06d676f2927 req-126a1fb5-2742-45f1-b4da-43c84930bc01 service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Received unexpected event network-vif-plugged-434efb9d-06e4-413b-b470-4952e114c298 for instance with vm_state active and task_state rebuild_spawning.
Dec 06 12:46:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b7fd7b9e-db6d-49fa-b641-e437c11371f7 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 10.102s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-3e751743-6176-45f7-9dbd-4931a623545c req-dafb56f1-71ea-4825-83eb-8add7a472a33 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received event network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3e751743-6176-45f7-9dbd-4931a623545c req-dafb56f1-71ea-4825-83eb-8add7a472a33 service nova] Acquiring lock "4531bf11-b948-4d57-bf55-f33563815e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3e751743-6176-45f7-9dbd-4931a623545c req-dafb56f1-71ea-4825-83eb-8add7a472a33 service nova] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3e751743-6176-45f7-9dbd-4931a623545c req-dafb56f1-71ea-4825-83eb-8add7a472a33 service nova] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-3e751743-6176-45f7-9dbd-4931a623545c req-dafb56f1-71ea-4825-83eb-8add7a472a33 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] No waiting events found dispatching network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:47 user nova-compute[75247]: WARNING nova.compute.manager [req-3e751743-6176-45f7-9dbd-4931a623545c req-dafb56f1-71ea-4825-83eb-8add7a472a33 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received unexpected event network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 for instance with vm_state resized and task_state resize_reverting.
Dec 06 12:46:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:49 user nova-compute[75247]: DEBUG nova.compute.manager [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:46:49 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Instance running successfully.
Dec 06 12:46:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] finish_revert_migration finished successfully. {{(pid=75247) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11866}}
Dec 06 12:46:49 user nova-compute[75247]: INFO nova.compute.manager [None req-0d3ca77e-54bb-4e6d-9451-76bdde3e3215 tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Updating instance to original state: 'active'
Dec 06 12:46:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-dcc71db7-b5b2-4f2b-9339-8d75d6e86040 req-03654b96-f2ed-4f86-b2fe-8fad566f33e1 service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Received event network-vif-plugged-434efb9d-06e4-413b-b470-4952e114c298 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-dcc71db7-b5b2-4f2b-9339-8d75d6e86040 req-03654b96-f2ed-4f86-b2fe-8fad566f33e1 service nova] Acquiring lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-dcc71db7-b5b2-4f2b-9339-8d75d6e86040 req-03654b96-f2ed-4f86-b2fe-8fad566f33e1 service nova] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-dcc71db7-b5b2-4f2b-9339-8d75d6e86040 req-03654b96-f2ed-4f86-b2fe-8fad566f33e1 service nova] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-dcc71db7-b5b2-4f2b-9339-8d75d6e86040 req-03654b96-f2ed-4f86-b2fe-8fad566f33e1 service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] No waiting events found dispatching network-vif-plugged-434efb9d-06e4-413b-b470-4952e114c298 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:49 user nova-compute[75247]: WARNING nova.compute.manager [req-dcc71db7-b5b2-4f2b-9339-8d75d6e86040 req-03654b96-f2ed-4f86-b2fe-8fad566f33e1 service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Received unexpected event network-vif-plugged-434efb9d-06e4-413b-b470-4952e114c298 for instance with vm_state active and task_state rebuild_spawning.
Dec 06 12:46:49 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:46:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:46:49 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Instance spawned successfully.
Dec 06 12:46:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:46:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:46:49 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:46:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:49 user nova-compute[75247]: DEBUG nova.objects.instance [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75247) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Dec 06 12:46:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7165a7bf-d6e6-4296-918f-2a4ea41ae1a1 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.100s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:56 user nova-compute[75247]: INFO nova.compute.manager [None req-34b62e87-479a-45c2-ba49-2586aaef18af tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Unrescuing
Dec 06 12:46:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-34b62e87-479a-45c2-ba49-2586aaef18af tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "refresh_cache-3e1b5197-dc38-48a5-b9f9-e053be499433" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:46:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-34b62e87-479a-45c2-ba49-2586aaef18af tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquired lock "refresh_cache-3e1b5197-dc38-48a5-b9f9-e053be499433" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:46:56 user nova-compute[75247]: DEBUG nova.network.neutron [None req-34b62e87-479a-45c2-ba49-2586aaef18af tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:46:57 user nova-compute[75247]: DEBUG nova.network.neutron [None req-34b62e87-479a-45c2-ba49-2586aaef18af tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Updating instance_info_cache with network_info: [{"id": "f373c320-8b0c-440d-b825-d7ec2555b89d", "address": "fa:16:3e:3f:8d:92", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf373c320-8b", "ovs_interfaceid": "f373c320-8b0c-440d-b825-d7ec2555b89d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:46:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-34b62e87-479a-45c2-ba49-2586aaef18af tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Releasing lock "refresh_cache-3e1b5197-dc38-48a5-b9f9-e053be499433" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:46:57 user nova-compute[75247]: DEBUG nova.objects.instance [None req-34b62e87-479a-45c2-ba49-2586aaef18af tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lazy-loading 'flavor' on Instance uuid 3e1b5197-dc38-48a5-b9f9-e053be499433 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:46:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:57 user nova-compute[75247]: DEBUG nova.compute.manager [req-ae7d8944-6a9d-4da9-b641-14c7af5173bd req-f5d4bd97-b058-40f3-bf52-ca04a07e8db3 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Received event network-vif-unplugged-f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ae7d8944-6a9d-4da9-b641-14c7af5173bd req-f5d4bd97-b058-40f3-bf52-ca04a07e8db3 service nova] Acquiring lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ae7d8944-6a9d-4da9-b641-14c7af5173bd req-f5d4bd97-b058-40f3-bf52-ca04a07e8db3 service nova] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ae7d8944-6a9d-4da9-b641-14c7af5173bd req-f5d4bd97-b058-40f3-bf52-ca04a07e8db3 service nova] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:57 user nova-compute[75247]: DEBUG nova.compute.manager [req-ae7d8944-6a9d-4da9-b641-14c7af5173bd req-f5d4bd97-b058-40f3-bf52-ca04a07e8db3 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] No waiting events found dispatching network-vif-unplugged-f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:57 user nova-compute[75247]: WARNING nova.compute.manager [req-ae7d8944-6a9d-4da9-b641-14c7af5173bd req-f5d4bd97-b058-40f3-bf52-ca04a07e8db3 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Received unexpected event network-vif-unplugged-f373c320-8b0c-440d-b825-d7ec2555b89d for instance with vm_state rescued and task_state unrescuing.
Dec 06 12:46:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:57 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Instance destroyed successfully.
Dec 06 12:46:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:59 user nova-compute[75247]: DEBUG nova.compute.manager [req-460bb656-74b9-40b7-ad8a-870ff3253cd5 req-534ddd7b-2adf-4596-89b4-23bd84487add service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Received event network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:46:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-460bb656-74b9-40b7-ad8a-870ff3253cd5 req-534ddd7b-2adf-4596-89b4-23bd84487add service nova] Acquiring lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:46:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-460bb656-74b9-40b7-ad8a-870ff3253cd5 req-534ddd7b-2adf-4596-89b4-23bd84487add service nova] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:46:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-460bb656-74b9-40b7-ad8a-870ff3253cd5 req-534ddd7b-2adf-4596-89b4-23bd84487add service nova] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:46:59 user nova-compute[75247]: DEBUG nova.compute.manager [req-460bb656-74b9-40b7-ad8a-870ff3253cd5 req-534ddd7b-2adf-4596-89b4-23bd84487add service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] No waiting events found dispatching network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:46:59 user nova-compute[75247]: WARNING nova.compute.manager [req-460bb656-74b9-40b7-ad8a-870ff3253cd5 req-534ddd7b-2adf-4596-89b4-23bd84487add service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Received unexpected event network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d for instance with vm_state rescued and task_state unrescuing.
Dec 06 12:46:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:46:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "a7113836-350f-4ef2-a64e-418c34e2446f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "a7113836-350f-4ef2-a64e-418c34e2446f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:01 user nova-compute[75247]: DEBUG nova.compute.manager [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:47:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:01 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:47:01 user nova-compute[75247]: INFO nova.compute.claims [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Claim successful on node user
Dec 06 12:47:01 user nova-compute[75247]: DEBUG nova.compute.manager [req-bbe3c518-33a7-4310-b01c-63045e828681 req-1594c051-d3df-4b1e-8273-d6c40c8a3028 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Received event network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bbe3c518-33a7-4310-b01c-63045e828681 req-1594c051-d3df-4b1e-8273-d6c40c8a3028 service nova] Acquiring lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bbe3c518-33a7-4310-b01c-63045e828681 req-1594c051-d3df-4b1e-8273-d6c40c8a3028 service nova] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bbe3c518-33a7-4310-b01c-63045e828681 req-1594c051-d3df-4b1e-8273-d6c40c8a3028 service nova] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:01 user nova-compute[75247]: DEBUG nova.compute.manager [req-bbe3c518-33a7-4310-b01c-63045e828681 req-1594c051-d3df-4b1e-8273-d6c40c8a3028 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] No waiting events found dispatching network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:47:01 user nova-compute[75247]: WARNING nova.compute.manager [req-bbe3c518-33a7-4310-b01c-63045e828681 req-1594c051-d3df-4b1e-8273-d6c40c8a3028 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Received unexpected event network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d for instance with vm_state rescued and task_state unrescuing.
Dec 06 12:47:01 user nova-compute[75247]: DEBUG nova.compute.manager [req-bbe3c518-33a7-4310-b01c-63045e828681 req-1594c051-d3df-4b1e-8273-d6c40c8a3028 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Received event network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bbe3c518-33a7-4310-b01c-63045e828681 req-1594c051-d3df-4b1e-8273-d6c40c8a3028 service nova] Acquiring lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bbe3c518-33a7-4310-b01c-63045e828681 req-1594c051-d3df-4b1e-8273-d6c40c8a3028 service nova] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bbe3c518-33a7-4310-b01c-63045e828681 req-1594c051-d3df-4b1e-8273-d6c40c8a3028 service nova] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:01 user nova-compute[75247]: DEBUG nova.compute.manager [req-bbe3c518-33a7-4310-b01c-63045e828681 req-1594c051-d3df-4b1e-8273-d6c40c8a3028 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] No waiting events found dispatching network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:47:01 user nova-compute[75247]: WARNING nova.compute.manager [req-bbe3c518-33a7-4310-b01c-63045e828681 req-1594c051-d3df-4b1e-8273-d6c40c8a3028 service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Received unexpected event network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d for instance with vm_state rescued and task_state unrescuing.
Dec 06 12:47:01 user nova-compute[75247]: DEBUG nova.compute.manager [None req-34b62e87-479a-45c2-ba49-2586aaef18af tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:47:01 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:47:01 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:47:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:01 user nova-compute[75247]: DEBUG nova.compute.manager [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:47:01 user nova-compute[75247]: DEBUG nova.compute.manager [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:47:01 user nova-compute[75247]: DEBUG nova.network.neutron [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:47:01 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:47:02 user nova-compute[75247]: DEBUG nova.compute.manager [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:47:02 user nova-compute[75247]: DEBUG nova.policy [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d7becd4d5734bc2b652e6f37492eb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6b077946334f1c8fd16d091a7738e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:47:02 user nova-compute[75247]: DEBUG nova.compute.manager [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:47:02 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:47:02 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Creating image(s)
Dec 06 12:47:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7113836-350f-4ef2-a64e-418c34e2446f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "/opt/stack/data/nova/instances/a7113836-350f-4ef2-a64e-418c34e2446f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "/opt/stack/data/nova/instances/a7113836-350f-4ef2-a64e-418c34e2446f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.197s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.185s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/a7113836-350f-4ef2-a64e-418c34e2446f/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/a7113836-350f-4ef2-a64e-418c34e2446f/disk 1073741824" returned: 0 in 0.066s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.191s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:02 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7113836-350f-4ef2-a64e-418c34e2446f/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:47:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7113836-350f-4ef2-a64e-418c34e2446f/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:02 user nova-compute[75247]: DEBUG nova.network.neutron [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Successfully created port: 23d45868-6be3-4f57-8579-243f11b02597 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:47:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7113836-350f-4ef2-a64e-418c34e2446f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:02 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Cannot resize image /opt/stack/data/nova/instances/a7113836-350f-4ef2-a64e-418c34e2446f/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:47:02 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:47:02 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Ensure instance console log exists: /opt/stack/data/nova/instances/a7113836-350f-4ef2-a64e-418c34e2446f/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:47:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.network.neutron [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Successfully updated port: 23d45868-6be3-4f57-8579-243f11b02597 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "refresh_cache-a7113836-350f-4ef2-a64e-418c34e2446f" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquired lock "refresh_cache-a7113836-350f-4ef2-a64e-418c34e2446f" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.network.neutron [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.network.neutron [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-b895870b-d9fe-44e8-8ca1-8aa2fa9e7ec7 req-f1cd3146-59cd-42a9-90ec-25e8bad6f8df service nova] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Received event network-changed-23d45868-6be3-4f57-8579-243f11b02597 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-b895870b-d9fe-44e8-8ca1-8aa2fa9e7ec7 req-f1cd3146-59cd-42a9-90ec-25e8bad6f8df service nova] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Refreshing instance network info cache due to event network-changed-23d45868-6be3-4f57-8579-243f11b02597. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b895870b-d9fe-44e8-8ca1-8aa2fa9e7ec7 req-f1cd3146-59cd-42a9-90ec-25e8bad6f8df service nova] Acquiring lock "refresh_cache-a7113836-350f-4ef2-a64e-418c34e2446f" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.network.neutron [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Updating instance_info_cache with network_info: [{"id": "23d45868-6be3-4f57-8579-243f11b02597", "address": "fa:16:3e:44:69:6b", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d45868-6b", "ovs_interfaceid": "23d45868-6be3-4f57-8579-243f11b02597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Releasing lock "refresh_cache-a7113836-350f-4ef2-a64e-418c34e2446f" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.compute.manager [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Instance network_info: |[{"id": "23d45868-6be3-4f57-8579-243f11b02597", "address": "fa:16:3e:44:69:6b", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d45868-6b", "ovs_interfaceid": "23d45868-6be3-4f57-8579-243f11b02597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b895870b-d9fe-44e8-8ca1-8aa2fa9e7ec7 req-f1cd3146-59cd-42a9-90ec-25e8bad6f8df service nova] Acquired lock "refresh_cache-a7113836-350f-4ef2-a64e-418c34e2446f" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.network.neutron [req-b895870b-d9fe-44e8-8ca1-8aa2fa9e7ec7 req-f1cd3146-59cd-42a9-90ec-25e8bad6f8df service nova] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Refreshing network info cache for port 23d45868-6be3-4f57-8579-243f11b02597 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Start _get_guest_xml network_info=[{"id": "23d45868-6be3-4f57-8579-243f11b02597", "address": "fa:16:3e:44:69:6b", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d45868-6b", "ovs_interfaceid": "23d45868-6be3-4f57-8579-243f11b02597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:47:03 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:47:03 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1299360918',display_name='tempest-AttachVolumeNegativeTest-server-1299360918',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1299360918',id=22,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHB05nkIgRjgJM3Lm5cUUVaQJnLpkIwP2H3SKCTlnE5d1PtMJs736XxTowim1eosP/BaYDzis1F8dvoMv0Fjgu7Vrl6JhpBZluK2TQyUg5AO8jfC9Ed6rtmrK4//wA4wjg==',key_name='tempest-keypair-1695380448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a6b077946334f1c8fd16d091a7738e1',ramdisk_id='',reservation_id='r-pd6phllj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2136789566',owner_user_name='tempest-AttachVolumeNegativeTest-2136789566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:47:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d7becd4d5734bc2b652e6f37492eb5e',uuid=a7113836-350f-4ef2-a64e-418c34e2446f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23d45868-6be3-4f57-8579-243f11b02597", "address": "fa:16:3e:44:69:6b", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d45868-6b", "ovs_interfaceid": "23d45868-6be3-4f57-8579-243f11b02597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Converting VIF {"id": "23d45868-6be3-4f57-8579-243f11b02597", "address": "fa:16:3e:44:69:6b", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d45868-6b", "ovs_interfaceid": "23d45868-6be3-4f57-8579-243f11b02597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:69:6b,bridge_name='br-int',has_traffic_filtering=True,id=23d45868-6be3-4f57-8579-243f11b02597,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23d45868-6b') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.objects.instance [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lazy-loading 'pci_devices' on Instance uuid a7113836-350f-4ef2-a64e-418c34e2446f {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:47:03 user nova-compute[75247]:   <uuid>a7113836-350f-4ef2-a64e-418c34e2446f</uuid>
Dec 06 12:47:03 user nova-compute[75247]:   <name>instance-00000016</name>
Dec 06 12:47:03 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:47:03 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:47:03 user nova-compute[75247]:   <metadata>
Dec 06 12:47:03 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:47:03 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:47:03 user nova-compute[75247]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1299360918</nova:name>
Dec 06 12:47:03 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:47:03</nova:creationTime>
Dec 06 12:47:03 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:47:03 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:47:03 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:47:03 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:47:03 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:47:03 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:47:03 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:47:03 user nova-compute[75247]:       <nova:owner>
Dec 06 12:47:03 user nova-compute[75247]:         <nova:user uuid="9d7becd4d5734bc2b652e6f37492eb5e">tempest-AttachVolumeNegativeTest-2136789566-project-member</nova:user>
Dec 06 12:47:03 user nova-compute[75247]:         <nova:project uuid="6a6b077946334f1c8fd16d091a7738e1">tempest-AttachVolumeNegativeTest-2136789566</nova:project>
Dec 06 12:47:03 user nova-compute[75247]:       </nova:owner>
Dec 06 12:47:03 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:47:03 user nova-compute[75247]:       <nova:ports>
Dec 06 12:47:03 user nova-compute[75247]:         <nova:port uuid="23d45868-6be3-4f57-8579-243f11b02597">
Dec 06 12:47:03 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 06 12:47:03 user nova-compute[75247]:         </nova:port>
Dec 06 12:47:03 user nova-compute[75247]:       </nova:ports>
Dec 06 12:47:03 user nova-compute[75247]:     </nova:instance>
Dec 06 12:47:03 user nova-compute[75247]:   </metadata>
Dec 06 12:47:03 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:47:03 user nova-compute[75247]:     <system>
Dec 06 12:47:03 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:47:03 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:47:03 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:47:03 user nova-compute[75247]:       <entry name="serial">a7113836-350f-4ef2-a64e-418c34e2446f</entry>
Dec 06 12:47:03 user nova-compute[75247]:       <entry name="uuid">a7113836-350f-4ef2-a64e-418c34e2446f</entry>
Dec 06 12:47:03 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:47:03 user nova-compute[75247]:     </system>
Dec 06 12:47:03 user nova-compute[75247]:   </sysinfo>
Dec 06 12:47:03 user nova-compute[75247]:   <os>
Dec 06 12:47:03 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:47:03 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:47:03 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:47:03 user nova-compute[75247]:   </os>
Dec 06 12:47:03 user nova-compute[75247]:   <features>
Dec 06 12:47:03 user nova-compute[75247]:     <acpi/>
Dec 06 12:47:03 user nova-compute[75247]:     <apic/>
Dec 06 12:47:03 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:47:03 user nova-compute[75247]:   </features>
Dec 06 12:47:03 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:47:03 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:47:03 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:47:03 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:47:03 user nova-compute[75247]:   </clock>
Dec 06 12:47:03 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:47:03 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:47:03 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:47:03 user nova-compute[75247]:   </cpu>
Dec 06 12:47:03 user nova-compute[75247]:   <devices>
Dec 06 12:47:03 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:47:03 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:47:03 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/a7113836-350f-4ef2-a64e-418c34e2446f/disk"/>
Dec 06 12:47:03 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:47:03 user nova-compute[75247]:     </disk>
Dec 06 12:47:03 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:47:03 user nova-compute[75247]:       <mac address="fa:16:3e:44:69:6b"/>
Dec 06 12:47:03 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:47:03 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:47:03 user nova-compute[75247]:       <target dev="tap23d45868-6b"/>
Dec 06 12:47:03 user nova-compute[75247]:     </interface>
Dec 06 12:47:03 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:47:03 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/a7113836-350f-4ef2-a64e-418c34e2446f/console.log" append="off"/>
Dec 06 12:47:03 user nova-compute[75247]:     </serial>
Dec 06 12:47:03 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:47:03 user nova-compute[75247]:     <video>
Dec 06 12:47:03 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:47:03 user nova-compute[75247]:     </video>
Dec 06 12:47:03 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:47:03 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:47:03 user nova-compute[75247]:     </rng>
Dec 06 12:47:03 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:47:03 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:47:03 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:47:03 user nova-compute[75247]:     </memballoon>
Dec 06 12:47:03 user nova-compute[75247]:   </devices>
Dec 06 12:47:03 user nova-compute[75247]: </domain>
Dec 06 12:47:03 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1299360918',display_name='tempest-AttachVolumeNegativeTest-server-1299360918',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1299360918',id=22,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHB05nkIgRjgJM3Lm5cUUVaQJnLpkIwP2H3SKCTlnE5d1PtMJs736XxTowim1eosP/BaYDzis1F8dvoMv0Fjgu7Vrl6JhpBZluK2TQyUg5AO8jfC9Ed6rtmrK4//wA4wjg==',key_name='tempest-keypair-1695380448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a6b077946334f1c8fd16d091a7738e1',ramdisk_id='',reservation_id='r-pd6phllj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2136789566',owner_user_name='tempest-AttachVolumeNegativeTest-2136789566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:47:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d7becd4d5734bc2b652e6f37492eb5e',uuid=a7113836-350f-4ef2-a64e-418c34e2446f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23d45868-6be3-4f57-8579-243f11b02597", "address": "fa:16:3e:44:69:6b", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d45868-6b", "ovs_interfaceid": "23d45868-6be3-4f57-8579-243f11b02597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Converting VIF {"id": "23d45868-6be3-4f57-8579-243f11b02597", "address": "fa:16:3e:44:69:6b", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d45868-6b", "ovs_interfaceid": "23d45868-6be3-4f57-8579-243f11b02597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:69:6b,bridge_name='br-int',has_traffic_filtering=True,id=23d45868-6be3-4f57-8579-243f11b02597,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23d45868-6b') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG os_vif [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:69:6b,bridge_name='br-int',has_traffic_filtering=True,id=23d45868-6be3-4f57-8579-243f11b02597,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23d45868-6b') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e5fa4232-d7fa-53be-8c2d-a409b34125f1', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23d45868-6b, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23d45868-6b, col_values=(('qos', UUID('97378075-fcb1-42b1-9880-65627fcfea5d')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23d45868-6b, col_values=(('external_ids', {'iface-id': '23d45868-6be3-4f57-8579-243f11b02597', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:69:6b', 'vm-uuid': 'a7113836-350f-4ef2-a64e-418c34e2446f'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:47:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:47:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:04 user nova-compute[75247]: INFO os_vif [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:69:6b,bridge_name='br-int',has_traffic_filtering=True,id=23d45868-6be3-4f57-8579-243f11b02597,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23d45868-6b')
Dec 06 12:47:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:47:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] No VIF found with MAC fa:16:3e:44:69:6b, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:47:04 user nova-compute[75247]: DEBUG nova.network.neutron [req-b895870b-d9fe-44e8-8ca1-8aa2fa9e7ec7 req-f1cd3146-59cd-42a9-90ec-25e8bad6f8df service nova] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Updated VIF entry in instance network info cache for port 23d45868-6be3-4f57-8579-243f11b02597. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:47:04 user nova-compute[75247]: DEBUG nova.network.neutron [req-b895870b-d9fe-44e8-8ca1-8aa2fa9e7ec7 req-f1cd3146-59cd-42a9-90ec-25e8bad6f8df service nova] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Updating instance_info_cache with network_info: [{"id": "23d45868-6be3-4f57-8579-243f11b02597", "address": "fa:16:3e:44:69:6b", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d45868-6b", "ovs_interfaceid": "23d45868-6be3-4f57-8579-243f11b02597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:47:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b895870b-d9fe-44e8-8ca1-8aa2fa9e7ec7 req-f1cd3146-59cd-42a9-90ec-25e8bad6f8df service nova] Releasing lock "refresh_cache-a7113836-350f-4ef2-a64e-418c34e2446f" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-5cbc047e-4f05-4956-8b22-f1879f9e87bd req-fd9b8743-9ab0-47c8-8745-45cfaa6a3f7f service nova] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Received event network-vif-plugged-23d45868-6be3-4f57-8579-243f11b02597 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5cbc047e-4f05-4956-8b22-f1879f9e87bd req-fd9b8743-9ab0-47c8-8745-45cfaa6a3f7f service nova] Acquiring lock "a7113836-350f-4ef2-a64e-418c34e2446f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5cbc047e-4f05-4956-8b22-f1879f9e87bd req-fd9b8743-9ab0-47c8-8745-45cfaa6a3f7f service nova] Lock "a7113836-350f-4ef2-a64e-418c34e2446f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5cbc047e-4f05-4956-8b22-f1879f9e87bd req-fd9b8743-9ab0-47c8-8745-45cfaa6a3f7f service nova] Lock "a7113836-350f-4ef2-a64e-418c34e2446f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-5cbc047e-4f05-4956-8b22-f1879f9e87bd req-fd9b8743-9ab0-47c8-8745-45cfaa6a3f7f service nova] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] No waiting events found dispatching network-vif-plugged-23d45868-6be3-4f57-8579-243f11b02597 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:47:05 user nova-compute[75247]: WARNING nova.compute.manager [req-5cbc047e-4f05-4956-8b22-f1879f9e87bd req-fd9b8743-9ab0-47c8-8745-45cfaa6a3f7f service nova] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Received unexpected event network-vif-plugged-23d45868-6be3-4f57-8579-243f11b02597 for instance with vm_state building and task_state spawning.
Dec 06 12:47:05 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid 70c4664e-ae7a-47de-bba7-18300391d209 {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid 782289e2-91cd-4aee-9a08-eadfb2a5965b {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid 4531bf11-b948-4d57-bf55-f33563815e26 {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid 3e1b5197-dc38-48a5-b9f9-e053be499433 {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid 0a86fe94-933a-4e0d-8a65-4834c3d3e40b {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid 8c5711ad-a295-4b5d-8baf-50921601f26e {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid db837c7a-c52d-469b-abf7-cea107454c60 {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid ea75ba22-b4af-4454-93ed-cdfdc76a895b {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid 97d1f646-bc64-40e2-9418-c89a87473640 {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid a7113836-350f-4ef2-a64e-418c34e2446f {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "70c4664e-ae7a-47de-bba7-18300391d209" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "70c4664e-ae7a-47de-bba7-18300391d209" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "782289e2-91cd-4aee-9a08-eadfb2a5965b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "782289e2-91cd-4aee-9a08-eadfb2a5965b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "4531bf11-b948-4d57-bf55-f33563815e26" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "4531bf11-b948-4d57-bf55-f33563815e26" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "3e1b5197-dc38-48a5-b9f9-e053be499433" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "8c5711ad-a295-4b5d-8baf-50921601f26e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "8c5711ad-a295-4b5d-8baf-50921601f26e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "db837c7a-c52d-469b-abf7-cea107454c60" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "db837c7a-c52d-469b-abf7-cea107454c60" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "97d1f646-bc64-40e2-9418-c89a87473640" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "97d1f646-bc64-40e2-9418-c89a87473640" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "a7113836-350f-4ef2-a64e-418c34e2446f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 12:47:05 user nova-compute[75247]: WARNING oslo_messaging._drivers.amqpdriver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "70c4664e-ae7a-47de-bba7-18300391d209" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "4531bf11-b948-4d57-bf55-f33563815e26" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "782289e2-91cd-4aee-9a08-eadfb2a5965b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.126s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "db837c7a-c52d-469b-abf7-cea107454c60" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.126s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "8c5711ad-a295-4b5d-8baf-50921601f26e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.134s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.139s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.145s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "97d1f646-bc64-40e2-9418-c89a87473640" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.141s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:07 user nova-compute[75247]: DEBUG nova.compute.manager [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:47:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:47:07 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Instance spawned successfully.
Dec 06 12:47:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:47:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:47:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:47:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:47:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:47:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:47:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:47:07 user nova-compute[75247]: DEBUG nova.compute.manager [req-145d4d3e-af2e-4256-a4ea-3e2f866f5b77 req-1e2f8a5f-eb55-458c-9764-d23977443344 service nova] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Received event network-vif-plugged-23d45868-6be3-4f57-8579-243f11b02597 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-145d4d3e-af2e-4256-a4ea-3e2f866f5b77 req-1e2f8a5f-eb55-458c-9764-d23977443344 service nova] Acquiring lock "a7113836-350f-4ef2-a64e-418c34e2446f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-145d4d3e-af2e-4256-a4ea-3e2f866f5b77 req-1e2f8a5f-eb55-458c-9764-d23977443344 service nova] Lock "a7113836-350f-4ef2-a64e-418c34e2446f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-145d4d3e-af2e-4256-a4ea-3e2f866f5b77 req-1e2f8a5f-eb55-458c-9764-d23977443344 service nova] Lock "a7113836-350f-4ef2-a64e-418c34e2446f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:07 user nova-compute[75247]: DEBUG nova.compute.manager [req-145d4d3e-af2e-4256-a4ea-3e2f866f5b77 req-1e2f8a5f-eb55-458c-9764-d23977443344 service nova] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] No waiting events found dispatching network-vif-plugged-23d45868-6be3-4f57-8579-243f11b02597 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:47:07 user nova-compute[75247]: WARNING nova.compute.manager [req-145d4d3e-af2e-4256-a4ea-3e2f866f5b77 req-1e2f8a5f-eb55-458c-9764-d23977443344 service nova] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Received unexpected event network-vif-plugged-23d45868-6be3-4f57-8579-243f11b02597 for instance with vm_state building and task_state spawning.
Dec 06 12:47:07 user nova-compute[75247]: INFO nova.compute.manager [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Took 5.62 seconds to spawn the instance on the hypervisor.
Dec 06 12:47:07 user nova-compute[75247]: DEBUG nova.compute.manager [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:47:07 user nova-compute[75247]: INFO nova.compute.manager [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Took 6.58 seconds to build instance.
Dec 06 12:47:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9122eb24-f23d-4af2-850b-338e570b713a tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "a7113836-350f-4ef2-a64e-418c34e2446f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.700s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "a7113836-350f-4ef2-a64e-418c34e2446f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.012s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:07 user nova-compute[75247]: INFO nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] During sync_power_state the instance has a pending task (spawning). Skip.
Dec 06 12:47:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "a7113836-350f-4ef2-a64e-418c34e2446f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:08 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:47:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:09 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:47:09 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 12:47:09 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 12:47:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-70c4664e-ae7a-47de-bba7-18300391d209" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:47:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-70c4664e-ae7a-47de-bba7-18300391d209" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:47:10 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 12:47:10 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lazy-loading 'info_cache' on Instance uuid 70c4664e-ae7a-47de-bba7-18300391d209 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:47:10 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Updating instance_info_cache with network_info: [{"id": "4f46192c-414a-4af4-b5de-5bd99d31d1fe", "address": "fa:16:3e:b5:83:aa", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f46192c-41", "ovs_interfaceid": "4f46192c-414a-4af4-b5de-5bd99d31d1fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:47:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-70c4664e-ae7a-47de-bba7-18300391d209" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:47:10 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 12:47:10 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:47:10 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:47:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:10 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 12:47:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:47:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:47:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:47:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:47:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97d1f646-bc64-40e2-9418-c89a87473640/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97d1f646-bc64-40e2-9418-c89a87473640/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97d1f646-bc64-40e2-9418-c89a87473640/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97d1f646-bc64-40e2-9418-c89a87473640/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:47:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5711ad-a295-4b5d-8baf-50921601f26e/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5711ad-a295-4b5d-8baf-50921601f26e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5711ad-a295-4b5d-8baf-50921601f26e/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5711ad-a295-4b5d-8baf-50921601f26e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7113836-350f-4ef2-a64e-418c34e2446f/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7113836-350f-4ef2-a64e-418c34e2446f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7113836-350f-4ef2-a64e-418c34e2446f/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7113836-350f-4ef2-a64e-418c34e2446f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:14 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:47:14 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:47:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:16 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:47:16 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:47:16 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=7039MB free_disk=25.161170959472656GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 12:47:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:16 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 70c4664e-ae7a-47de-bba7-18300391d209 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:47:16 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 782289e2-91cd-4aee-9a08-eadfb2a5965b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:47:16 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:47:16 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 3e1b5197-dc38-48a5-b9f9-e053be499433 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:47:16 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 0a86fe94-933a-4e0d-8a65-4834c3d3e40b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:47:16 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:47:16 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 4531bf11-b948-4d57-bf55-f33563815e26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:47:16 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:47:16 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 8c5711ad-a295-4b5d-8baf-50921601f26e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:47:16 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance db837c7a-c52d-469b-abf7-cea107454c60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:47:16 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance ea75ba22-b4af-4454-93ed-cdfdc76a895b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:47:16 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 97d1f646-bc64-40e2-9418-c89a87473640 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:47:16 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance a7113836-350f-4ef2-a64e-418c34e2446f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:47:16 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 12:47:16 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 12:47:16 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:47:16 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:47:16 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 12:47:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.607s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:47:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 12:47:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 12:47:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 12:47:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:44 user nova-compute[75247]: DEBUG nova.compute.manager [req-192aae12-e63e-4217-989b-aebdaf51890a req-ef7b2e79-1e17-42bf-bcf3-8aa161caabb2 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-changed-a079e33d-4b03-49ef-8315-f33edfb30f8f {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:44 user nova-compute[75247]: DEBUG nova.compute.manager [req-192aae12-e63e-4217-989b-aebdaf51890a req-ef7b2e79-1e17-42bf-bcf3-8aa161caabb2 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Refreshing instance network info cache due to event network-changed-a079e33d-4b03-49ef-8315-f33edfb30f8f. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:47:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-192aae12-e63e-4217-989b-aebdaf51890a req-ef7b2e79-1e17-42bf-bcf3-8aa161caabb2 service nova] Acquiring lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:47:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-192aae12-e63e-4217-989b-aebdaf51890a req-ef7b2e79-1e17-42bf-bcf3-8aa161caabb2 service nova] Acquired lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:47:44 user nova-compute[75247]: DEBUG nova.network.neutron [req-192aae12-e63e-4217-989b-aebdaf51890a req-ef7b2e79-1e17-42bf-bcf3-8aa161caabb2 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Refreshing network info cache for port a079e33d-4b03-49ef-8315-f33edfb30f8f {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:47:45 user nova-compute[75247]: DEBUG nova.network.neutron [req-192aae12-e63e-4217-989b-aebdaf51890a req-ef7b2e79-1e17-42bf-bcf3-8aa161caabb2 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Updated VIF entry in instance network info cache for port a079e33d-4b03-49ef-8315-f33edfb30f8f. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:47:45 user nova-compute[75247]: DEBUG nova.network.neutron [req-192aae12-e63e-4217-989b-aebdaf51890a req-ef7b2e79-1e17-42bf-bcf3-8aa161caabb2 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Updating instance_info_cache with network_info: [{"id": "a079e33d-4b03-49ef-8315-f33edfb30f8f", "address": "fa:16:3e:32:bb:08", "network": {"id": "488711cb-aa26-477a-832a-6a499b8b7c62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-923230583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa079e33d-4b", "ovs_interfaceid": "a079e33d-4b03-49ef-8315-f33edfb30f8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d117aa5-7c18-4adb-be72-d785e4905735", "address": "fa:16:3e:b3:6f:7c", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d117aa5-7c", "ovs_interfaceid": "2d117aa5-7c18-4adb-be72-d785e4905735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "681745af-b6fd-4f84-bc98-43bc601c3759", "address": "fa:16:3e:83:ce:7b", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681745af-b6", "ovs_interfaceid": "681745af-b6fd-4f84-bc98-43bc601c3759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b8c474e-894c-43c2-9a4a-0836089a16a1", "address": "fa:16:3e:09:e2:1a", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8c474e-89", "ovs_interfaceid": "7b8c474e-894c-43c2-9a4a-0836089a16a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "267ee847-5894-4c58-8554-e30b91938a6d", "address": "fa:16:3e:72:58:06", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267ee847-58", "ovs_interfaceid": "267ee847-5894-4c58-8554-e30b91938a6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "097e6f29-41d9-4842-a697-ad3d1a1b0d7c", "address": "fa:16:3e:fd:ac:f5", "network": {"id": "7321830d-5ca0-4292-9e4b-c1e160a2b612", "bridge": "br-int", "label": "tempest-device-tagging-net2-5103445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097e6f29-41", "ovs_interfaceid": "097e6f29-41d9-4842-a697-ad3d1a1b0d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c587e85c-ccd5-4bb9-803c-b08aed3baaeb", "address": "fa:16:3e:f9:0b:6e", "network": {"id": "7321830d-5ca0-4292-9e4b-c1e160a2b612", "bridge": "br-int", "label": "tempest-device-tagging-net2-5103445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc587e85c-cc", "ovs_interfaceid": "c587e85c-ccd5-4bb9-803c-b08aed3baaeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:47:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-192aae12-e63e-4217-989b-aebdaf51890a req-ef7b2e79-1e17-42bf-bcf3-8aa161caabb2 service nova] Releasing lock "refresh_cache-7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:47:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f6ade30-2b0a-4738-835f-6e7aad4d4af8 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Acquiring lock "8c5711ad-a295-4b5d-8baf-50921601f26e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f6ade30-2b0a-4738-835f-6e7aad4d4af8 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Lock "8c5711ad-a295-4b5d-8baf-50921601f26e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f6ade30-2b0a-4738-835f-6e7aad4d4af8 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Acquiring lock "8c5711ad-a295-4b5d-8baf-50921601f26e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f6ade30-2b0a-4738-835f-6e7aad4d4af8 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Lock "8c5711ad-a295-4b5d-8baf-50921601f26e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f6ade30-2b0a-4738-835f-6e7aad4d4af8 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Lock "8c5711ad-a295-4b5d-8baf-50921601f26e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:45 user nova-compute[75247]: INFO nova.compute.manager [None req-0f6ade30-2b0a-4738-835f-6e7aad4d4af8 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Terminating instance
Dec 06 12:47:45 user nova-compute[75247]: DEBUG nova.compute.manager [None req-0f6ade30-2b0a-4738-835f-6e7aad4d4af8 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:46 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Instance destroyed successfully.
Dec 06 12:47:46 user nova-compute[75247]: DEBUG nova.objects.instance [None req-0f6ade30-2b0a-4738-835f-6e7aad4d4af8 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Lazy-loading 'resources' on Instance uuid 8c5711ad-a295-4b5d-8baf-50921601f26e {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-0f6ade30-2b0a-4738-835f-6e7aad4d4af8 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:45:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1583061069',display_name='tempest-VolumesActionsTest-instance-1583061069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1583061069',id=18,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:45:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86d1676de49240649e41129c3906a43c',ramdisk_id='',reservation_id='r-25k1zm23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1885079958',owner_user_name='tempest-VolumesActionsTest-1885079958-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:45:56Z,user_data=None,user_id='1e073e98dd1a470c98ab45c0efbd7f48',uuid=8c5711ad-a295-4b5d-8baf-50921601f26e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b890e9e6-11b1-4990-a35b-5b20b9b6a14c", "address": "fa:16:3e:d9:30:31", "network": {"id": "b4fa0a00-9932-4aee-b21e-7faeee984d57", "bridge": "br-int", "label": "tempest-VolumesActionsTest-14311074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86d1676de49240649e41129c3906a43c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb890e9e6-11", "ovs_interfaceid": "b890e9e6-11b1-4990-a35b-5b20b9b6a14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-0f6ade30-2b0a-4738-835f-6e7aad4d4af8 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Converting VIF {"id": "b890e9e6-11b1-4990-a35b-5b20b9b6a14c", "address": "fa:16:3e:d9:30:31", "network": {"id": "b4fa0a00-9932-4aee-b21e-7faeee984d57", "bridge": "br-int", "label": "tempest-VolumesActionsTest-14311074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86d1676de49240649e41129c3906a43c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb890e9e6-11", "ovs_interfaceid": "b890e9e6-11b1-4990-a35b-5b20b9b6a14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-0f6ade30-2b0a-4738-835f-6e7aad4d4af8 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:30:31,bridge_name='br-int',has_traffic_filtering=True,id=b890e9e6-11b1-4990-a35b-5b20b9b6a14c,network=Network(b4fa0a00-9932-4aee-b21e-7faeee984d57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb890e9e6-11') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG os_vif [None req-0f6ade30-2b0a-4738-835f-6e7aad4d4af8 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:30:31,bridge_name='br-int',has_traffic_filtering=True,id=b890e9e6-11b1-4990-a35b-5b20b9b6a14c,network=Network(b4fa0a00-9932-4aee-b21e-7faeee984d57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb890e9e6-11') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb890e9e6-11, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eebd6be0-0cb2-4a11-921f-f5df27b030dc) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:46 user nova-compute[75247]: INFO os_vif [None req-0f6ade30-2b0a-4738-835f-6e7aad4d4af8 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:30:31,bridge_name='br-int',has_traffic_filtering=True,id=b890e9e6-11b1-4990-a35b-5b20b9b6a14c,network=Network(b4fa0a00-9932-4aee-b21e-7faeee984d57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb890e9e6-11')
Dec 06 12:47:46 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-0f6ade30-2b0a-4738-835f-6e7aad4d4af8 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Deleting instance files /opt/stack/data/nova/instances/8c5711ad-a295-4b5d-8baf-50921601f26e_del
Dec 06 12:47:46 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-0f6ade30-2b0a-4738-835f-6e7aad4d4af8 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Deletion of /opt/stack/data/nova/instances/8c5711ad-a295-4b5d-8baf-50921601f26e_del complete
Dec 06 12:47:46 user nova-compute[75247]: INFO nova.compute.manager [None req-0f6ade30-2b0a-4738-835f-6e7aad4d4af8 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Took 0.75 seconds to destroy the instance on the hypervisor.
Dec 06 12:47:46 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-0f6ade30-2b0a-4738-835f-6e7aad4d4af8 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG nova.compute.manager [req-7d124175-fd03-421b-b6d1-a2f7d31c8bb5 req-b5b798d9-2cba-4503-a8eb-d8ec1e7626d7 service nova] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Received event network-vif-unplugged-b890e9e6-11b1-4990-a35b-5b20b9b6a14c {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7d124175-fd03-421b-b6d1-a2f7d31c8bb5 req-b5b798d9-2cba-4503-a8eb-d8ec1e7626d7 service nova] Acquiring lock "8c5711ad-a295-4b5d-8baf-50921601f26e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7d124175-fd03-421b-b6d1-a2f7d31c8bb5 req-b5b798d9-2cba-4503-a8eb-d8ec1e7626d7 service nova] Lock "8c5711ad-a295-4b5d-8baf-50921601f26e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7d124175-fd03-421b-b6d1-a2f7d31c8bb5 req-b5b798d9-2cba-4503-a8eb-d8ec1e7626d7 service nova] Lock "8c5711ad-a295-4b5d-8baf-50921601f26e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG nova.compute.manager [req-7d124175-fd03-421b-b6d1-a2f7d31c8bb5 req-b5b798d9-2cba-4503-a8eb-d8ec1e7626d7 service nova] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] No waiting events found dispatching network-vif-unplugged-b890e9e6-11b1-4990-a35b-5b20b9b6a14c {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:47:46 user nova-compute[75247]: DEBUG nova.compute.manager [req-7d124175-fd03-421b-b6d1-a2f7d31c8bb5 req-b5b798d9-2cba-4503-a8eb-d8ec1e7626d7 service nova] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Received event network-vif-unplugged-b890e9e6-11b1-4990-a35b-5b20b9b6a14c for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:47:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:47 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:47:47 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Took 0.45 seconds to deallocate network for instance.
Dec 06 12:47:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-f9291c66-3c55-4903-bcd8-eb5d5d3d75c8 req-be571262-fd01-48af-a920-b2542b2ecabc service nova] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Received event network-vif-deleted-b890e9e6-11b1-4990-a35b-5b20b9b6a14c {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f6ade30-2b0a-4738-835f-6e7aad4d4af8 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f6ade30-2b0a-4738-835f-6e7aad4d4af8 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:47 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-0f6ade30-2b0a-4738-835f-6e7aad4d4af8 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:47:47 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-0f6ade30-2b0a-4738-835f-6e7aad4d4af8 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:47:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f6ade30-2b0a-4738-835f-6e7aad4d4af8 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:47 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-0f6ade30-2b0a-4738-835f-6e7aad4d4af8 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Deleted allocations for instance 8c5711ad-a295-4b5d-8baf-50921601f26e
Dec 06 12:47:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0f6ade30-2b0a-4738-835f-6e7aad4d4af8 tempest-VolumesActionsTest-1885079958 tempest-VolumesActionsTest-1885079958-project-member] Lock "8c5711ad-a295-4b5d-8baf-50921601f26e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.825s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:48 user nova-compute[75247]: INFO nova.compute.manager [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Terminating instance
Dec 06 12:47:48 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG nova.compute.manager [req-073b4a1b-cce9-4757-b065-d2c4ab47de06 req-bbd2a217-2583-4205-bf24-d0eab3e91b85 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-unplugged-a079e33d-4b03-49ef-8315-f33edfb30f8f {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-073b4a1b-cce9-4757-b065-d2c4ab47de06 req-bbd2a217-2583-4205-bf24-d0eab3e91b85 service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-073b4a1b-cce9-4757-b065-d2c4ab47de06 req-bbd2a217-2583-4205-bf24-d0eab3e91b85 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-073b4a1b-cce9-4757-b065-d2c4ab47de06 req-bbd2a217-2583-4205-bf24-d0eab3e91b85 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG nova.compute.manager [req-073b4a1b-cce9-4757-b065-d2c4ab47de06 req-bbd2a217-2583-4205-bf24-d0eab3e91b85 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-unplugged-a079e33d-4b03-49ef-8315-f33edfb30f8f {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG nova.compute.manager [req-073b4a1b-cce9-4757-b065-d2c4ab47de06 req-bbd2a217-2583-4205-bf24-d0eab3e91b85 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-unplugged-a079e33d-4b03-49ef-8315-f33edfb30f8f for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG nova.compute.manager [req-20931e2a-b9f0-42c4-9324-23f803b770b6 req-b92a39ee-a7a3-44e4-a7de-c29fb139a813 service nova] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Received event network-vif-plugged-b890e9e6-11b1-4990-a35b-5b20b9b6a14c {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-20931e2a-b9f0-42c4-9324-23f803b770b6 req-b92a39ee-a7a3-44e4-a7de-c29fb139a813 service nova] Acquiring lock "8c5711ad-a295-4b5d-8baf-50921601f26e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-20931e2a-b9f0-42c4-9324-23f803b770b6 req-b92a39ee-a7a3-44e4-a7de-c29fb139a813 service nova] Lock "8c5711ad-a295-4b5d-8baf-50921601f26e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-20931e2a-b9f0-42c4-9324-23f803b770b6 req-b92a39ee-a7a3-44e4-a7de-c29fb139a813 service nova] Lock "8c5711ad-a295-4b5d-8baf-50921601f26e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG nova.compute.manager [req-20931e2a-b9f0-42c4-9324-23f803b770b6 req-b92a39ee-a7a3-44e4-a7de-c29fb139a813 service nova] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] No waiting events found dispatching network-vif-plugged-b890e9e6-11b1-4990-a35b-5b20b9b6a14c {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:47:48 user nova-compute[75247]: WARNING nova.compute.manager [req-20931e2a-b9f0-42c4-9324-23f803b770b6 req-b92a39ee-a7a3-44e4-a7de-c29fb139a813 service nova] [instance: 8c5711ad-a295-4b5d-8baf-50921601f26e] Received unexpected event network-vif-plugged-b890e9e6-11b1-4990-a35b-5b20b9b6a14c for instance with vm_state deleted and task_state None.
Dec 06 12:47:48 user nova-compute[75247]: DEBUG nova.compute.manager [req-20931e2a-b9f0-42c4-9324-23f803b770b6 req-b92a39ee-a7a3-44e4-a7de-c29fb139a813 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-unplugged-7b8c474e-894c-43c2-9a4a-0836089a16a1 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-20931e2a-b9f0-42c4-9324-23f803b770b6 req-b92a39ee-a7a3-44e4-a7de-c29fb139a813 service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-20931e2a-b9f0-42c4-9324-23f803b770b6 req-b92a39ee-a7a3-44e4-a7de-c29fb139a813 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-20931e2a-b9f0-42c4-9324-23f803b770b6 req-b92a39ee-a7a3-44e4-a7de-c29fb139a813 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG nova.compute.manager [req-20931e2a-b9f0-42c4-9324-23f803b770b6 req-b92a39ee-a7a3-44e4-a7de-c29fb139a813 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-unplugged-7b8c474e-894c-43c2-9a4a-0836089a16a1 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG nova.compute.manager [req-20931e2a-b9f0-42c4-9324-23f803b770b6 req-b92a39ee-a7a3-44e4-a7de-c29fb139a813 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-unplugged-7b8c474e-894c-43c2-9a4a-0836089a16a1 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-77b8ecd9-7d72-4d51-997d-104ce97fde1a req-e632db94-3c85-4bb4-b096-2f4fec5e5742 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-unplugged-2d117aa5-7c18-4adb-be72-d785e4905735 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-77b8ecd9-7d72-4d51-997d-104ce97fde1a req-e632db94-3c85-4bb4-b096-2f4fec5e5742 service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-77b8ecd9-7d72-4d51-997d-104ce97fde1a req-e632db94-3c85-4bb4-b096-2f4fec5e5742 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-77b8ecd9-7d72-4d51-997d-104ce97fde1a req-e632db94-3c85-4bb4-b096-2f4fec5e5742 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-77b8ecd9-7d72-4d51-997d-104ce97fde1a req-e632db94-3c85-4bb4-b096-2f4fec5e5742 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-unplugged-2d117aa5-7c18-4adb-be72-d785e4905735 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-77b8ecd9-7d72-4d51-997d-104ce97fde1a req-e632db94-3c85-4bb4-b096-2f4fec5e5742 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-unplugged-2d117aa5-7c18-4adb-be72-d785e4905735 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-77b8ecd9-7d72-4d51-997d-104ce97fde1a req-e632db94-3c85-4bb4-b096-2f4fec5e5742 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-plugged-2d117aa5-7c18-4adb-be72-d785e4905735 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-77b8ecd9-7d72-4d51-997d-104ce97fde1a req-e632db94-3c85-4bb4-b096-2f4fec5e5742 service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-77b8ecd9-7d72-4d51-997d-104ce97fde1a req-e632db94-3c85-4bb4-b096-2f4fec5e5742 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-77b8ecd9-7d72-4d51-997d-104ce97fde1a req-e632db94-3c85-4bb4-b096-2f4fec5e5742 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-77b8ecd9-7d72-4d51-997d-104ce97fde1a req-e632db94-3c85-4bb4-b096-2f4fec5e5742 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-plugged-2d117aa5-7c18-4adb-be72-d785e4905735 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:47:49 user nova-compute[75247]: WARNING nova.compute.manager [req-77b8ecd9-7d72-4d51-997d-104ce97fde1a req-e632db94-3c85-4bb4-b096-2f4fec5e5742 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received unexpected event network-vif-plugged-2d117aa5-7c18-4adb-be72-d785e4905735 for instance with vm_state active and task_state deleting.
Dec 06 12:47:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-77b8ecd9-7d72-4d51-997d-104ce97fde1a req-e632db94-3c85-4bb4-b096-2f4fec5e5742 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-unplugged-267ee847-5894-4c58-8554-e30b91938a6d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-77b8ecd9-7d72-4d51-997d-104ce97fde1a req-e632db94-3c85-4bb4-b096-2f4fec5e5742 service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-77b8ecd9-7d72-4d51-997d-104ce97fde1a req-e632db94-3c85-4bb4-b096-2f4fec5e5742 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-77b8ecd9-7d72-4d51-997d-104ce97fde1a req-e632db94-3c85-4bb4-b096-2f4fec5e5742 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-77b8ecd9-7d72-4d51-997d-104ce97fde1a req-e632db94-3c85-4bb4-b096-2f4fec5e5742 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-unplugged-267ee847-5894-4c58-8554-e30b91938a6d {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-77b8ecd9-7d72-4d51-997d-104ce97fde1a req-e632db94-3c85-4bb4-b096-2f4fec5e5742 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-unplugged-267ee847-5894-4c58-8554-e30b91938a6d for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-77b8ecd9-7d72-4d51-997d-104ce97fde1a req-e632db94-3c85-4bb4-b096-2f4fec5e5742 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-plugged-267ee847-5894-4c58-8554-e30b91938a6d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-77b8ecd9-7d72-4d51-997d-104ce97fde1a req-e632db94-3c85-4bb4-b096-2f4fec5e5742 service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-77b8ecd9-7d72-4d51-997d-104ce97fde1a req-e632db94-3c85-4bb4-b096-2f4fec5e5742 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-77b8ecd9-7d72-4d51-997d-104ce97fde1a req-e632db94-3c85-4bb4-b096-2f4fec5e5742 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-77b8ecd9-7d72-4d51-997d-104ce97fde1a req-e632db94-3c85-4bb4-b096-2f4fec5e5742 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-plugged-267ee847-5894-4c58-8554-e30b91938a6d {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:47:49 user nova-compute[75247]: WARNING nova.compute.manager [req-77b8ecd9-7d72-4d51-997d-104ce97fde1a req-e632db94-3c85-4bb4-b096-2f4fec5e5742 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received unexpected event network-vif-plugged-267ee847-5894-4c58-8554-e30b91938a6d for instance with vm_state active and task_state deleting.
Dec 06 12:47:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:49 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Instance destroyed successfully.
Dec 06 12:47:49 user nova-compute[75247]: DEBUG nova.objects.instance [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lazy-loading 'resources' on Instance uuid 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286975828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-286975828',id=17,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2B8SHWnL5XT3DWY3gquaeb2zxCHvGF8t4a4ubj3jQmPtq9XBRNZCZWWoSYLM9FvzsvWTog0uix/tXd4joK1Eq8bokONhA/MCcUOpQ0086wGcwdflAWagcdXNUdya2xZw==',key_name='tempest-keypair-684324006',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:46:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66b95bb1359241ee8d2cf5015640a2b8',ramdisk_id='',reservation_id='r-6ft38hg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1989495369',owner_user_name='tempest-TaggedBootDevicesTest_v242-1989495369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:46:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9e5d32fc34046bcbf517062fe52f1a8',uuid=7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a079e33d-4b03-49ef-8315-f33edfb30f8f", "address": "fa:16:3e:32:bb:08", "network": {"id": "488711cb-aa26-477a-832a-6a499b8b7c62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-923230583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa079e33d-4b", "ovs_interfaceid": "a079e33d-4b03-49ef-8315-f33edfb30f8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converting VIF {"id": "a079e33d-4b03-49ef-8315-f33edfb30f8f", "address": "fa:16:3e:32:bb:08", "network": {"id": "488711cb-aa26-477a-832a-6a499b8b7c62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-923230583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa079e33d-4b", "ovs_interfaceid": "a079e33d-4b03-49ef-8315-f33edfb30f8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:bb:08,bridge_name='br-int',has_traffic_filtering=True,id=a079e33d-4b03-49ef-8315-f33edfb30f8f,network=Network(488711cb-aa26-477a-832a-6a499b8b7c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa079e33d-4b') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG os_vif [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:bb:08,bridge_name='br-int',has_traffic_filtering=True,id=a079e33d-4b03-49ef-8315-f33edfb30f8f,network=Network(488711cb-aa26-477a-832a-6a499b8b7c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa079e33d-4b') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa079e33d-4b, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:47:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9e7c527-10e5-4e61-9938-deea3a467fcb) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: INFO os_vif [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:bb:08,bridge_name='br-int',has_traffic_filtering=True,id=a079e33d-4b03-49ef-8315-f33edfb30f8f,network=Network(488711cb-aa26-477a-832a-6a499b8b7c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa079e33d-4b')
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286975828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-286975828',id=17,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2B8SHWnL5XT3DWY3gquaeb2zxCHvGF8t4a4ubj3jQmPtq9XBRNZCZWWoSYLM9FvzsvWTog0uix/tXd4joK1Eq8bokONhA/MCcUOpQ0086wGcwdflAWagcdXNUdya2xZw==',key_name='tempest-keypair-684324006',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:46:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66b95bb1359241ee8d2cf5015640a2b8',ramdisk_id='',reservation_id='r-6ft38hg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1989495369',owner_user_name='tempest-TaggedBootDevicesTest_v242-1989495369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:46:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9e5d32fc34046bcbf517062fe52f1a8',uuid=7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d117aa5-7c18-4adb-be72-d785e4905735", "address": "fa:16:3e:b3:6f:7c", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d117aa5-7c", "ovs_interfaceid": "2d117aa5-7c18-4adb-be72-d785e4905735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converting VIF {"id": "2d117aa5-7c18-4adb-be72-d785e4905735", "address": "fa:16:3e:b3:6f:7c", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d117aa5-7c", "ovs_interfaceid": "2d117aa5-7c18-4adb-be72-d785e4905735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:6f:7c,bridge_name='br-int',has_traffic_filtering=True,id=2d117aa5-7c18-4adb-be72-d785e4905735,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2d117aa5-7c') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_vif [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:6f:7c,bridge_name='br-int',has_traffic_filtering=True,id=2d117aa5-7c18-4adb-be72-d785e4905735,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2d117aa5-7c') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d117aa5-7c, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c17b0d1d-ceb8-4351-a875-6a0f025ce4e6) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: INFO os_vif [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:6f:7c,bridge_name='br-int',has_traffic_filtering=True,id=2d117aa5-7c18-4adb-be72-d785e4905735,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2d117aa5-7c')
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286975828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-286975828',id=17,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2B8SHWnL5XT3DWY3gquaeb2zxCHvGF8t4a4ubj3jQmPtq9XBRNZCZWWoSYLM9FvzsvWTog0uix/tXd4joK1Eq8bokONhA/MCcUOpQ0086wGcwdflAWagcdXNUdya2xZw==',key_name='tempest-keypair-684324006',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:46:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66b95bb1359241ee8d2cf5015640a2b8',ramdisk_id='',reservation_id='r-6ft38hg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1989495369',owner_user_name='tempest-TaggedBootDevicesTest_v242-1989495369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:46:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9e5d32fc34046bcbf517062fe52f1a8',uuid=7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "681745af-b6fd-4f84-bc98-43bc601c3759", "address": "fa:16:3e:83:ce:7b", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681745af-b6", "ovs_interfaceid": "681745af-b6fd-4f84-bc98-43bc601c3759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converting VIF {"id": "681745af-b6fd-4f84-bc98-43bc601c3759", "address": "fa:16:3e:83:ce:7b", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681745af-b6", "ovs_interfaceid": "681745af-b6fd-4f84-bc98-43bc601c3759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:ce:7b,bridge_name='br-int',has_traffic_filtering=True,id=681745af-b6fd-4f84-bc98-43bc601c3759,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap681745af-b6') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_vif [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:ce:7b,bridge_name='br-int',has_traffic_filtering=True,id=681745af-b6fd-4f84-bc98-43bc601c3759,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap681745af-b6') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap681745af-b6, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5401c72d-3470-4b76-8426-dedbd64d8920) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: INFO os_vif [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:ce:7b,bridge_name='br-int',has_traffic_filtering=True,id=681745af-b6fd-4f84-bc98-43bc601c3759,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap681745af-b6')
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286975828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-286975828',id=17,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2B8SHWnL5XT3DWY3gquaeb2zxCHvGF8t4a4ubj3jQmPtq9XBRNZCZWWoSYLM9FvzsvWTog0uix/tXd4joK1Eq8bokONhA/MCcUOpQ0086wGcwdflAWagcdXNUdya2xZw==',key_name='tempest-keypair-684324006',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:46:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66b95bb1359241ee8d2cf5015640a2b8',ramdisk_id='',reservation_id='r-6ft38hg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1989495369',owner_user_name='tempest-TaggedBootDevicesTest_v242-1989495369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:46:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9e5d32fc34046bcbf517062fe52f1a8',uuid=7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b8c474e-894c-43c2-9a4a-0836089a16a1", "address": "fa:16:3e:09:e2:1a", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8c474e-89", "ovs_interfaceid": "7b8c474e-894c-43c2-9a4a-0836089a16a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converting VIF {"id": "7b8c474e-894c-43c2-9a4a-0836089a16a1", "address": "fa:16:3e:09:e2:1a", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8c474e-89", "ovs_interfaceid": "7b8c474e-894c-43c2-9a4a-0836089a16a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:e2:1a,bridge_name='br-int',has_traffic_filtering=True,id=7b8c474e-894c-43c2-9a4a-0836089a16a1,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b8c474e-89') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_vif [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:e2:1a,bridge_name='br-int',has_traffic_filtering=True,id=7b8c474e-894c-43c2-9a4a-0836089a16a1,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b8c474e-89') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b8c474e-89, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=01165c50-7a9e-4a18-bc95-53d22327ea7d) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: INFO os_vif [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:e2:1a,bridge_name='br-int',has_traffic_filtering=True,id=7b8c474e-894c-43c2-9a4a-0836089a16a1,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b8c474e-89')
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286975828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-286975828',id=17,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2B8SHWnL5XT3DWY3gquaeb2zxCHvGF8t4a4ubj3jQmPtq9XBRNZCZWWoSYLM9FvzsvWTog0uix/tXd4joK1Eq8bokONhA/MCcUOpQ0086wGcwdflAWagcdXNUdya2xZw==',key_name='tempest-keypair-684324006',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:46:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66b95bb1359241ee8d2cf5015640a2b8',ramdisk_id='',reservation_id='r-6ft38hg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1989495369',owner_user_name='tempest-TaggedBootDevicesTest_v242-1989495369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:46:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9e5d32fc34046bcbf517062fe52f1a8',uuid=7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "267ee847-5894-4c58-8554-e30b91938a6d", "address": "fa:16:3e:72:58:06", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267ee847-58", "ovs_interfaceid": "267ee847-5894-4c58-8554-e30b91938a6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converting VIF {"id": "267ee847-5894-4c58-8554-e30b91938a6d", "address": "fa:16:3e:72:58:06", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267ee847-58", "ovs_interfaceid": "267ee847-5894-4c58-8554-e30b91938a6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:58:06,bridge_name='br-int',has_traffic_filtering=True,id=267ee847-5894-4c58-8554-e30b91938a6d,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267ee847-58') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_vif [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:58:06,bridge_name='br-int',has_traffic_filtering=True,id=267ee847-5894-4c58-8554-e30b91938a6d,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267ee847-58') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap267ee847-58, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da53358b-a9d1-4f7c-b779-dd0c2db094db) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.compute.manager [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-plugged-a079e33d-4b03-49ef-8315-f33edfb30f8f {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.compute.manager [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-plugged-a079e33d-4b03-49ef-8315-f33edfb30f8f {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:47:50 user nova-compute[75247]: WARNING nova.compute.manager [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received unexpected event network-vif-plugged-a079e33d-4b03-49ef-8315-f33edfb30f8f for instance with vm_state active and task_state deleting.
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.compute.manager [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-unplugged-681745af-b6fd-4f84-bc98-43bc601c3759 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.compute.manager [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-unplugged-681745af-b6fd-4f84-bc98-43bc601c3759 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.compute.manager [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-unplugged-681745af-b6fd-4f84-bc98-43bc601c3759 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.compute.manager [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-plugged-681745af-b6fd-4f84-bc98-43bc601c3759 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.compute.manager [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-plugged-681745af-b6fd-4f84-bc98-43bc601c3759 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:47:50 user nova-compute[75247]: WARNING nova.compute.manager [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received unexpected event network-vif-plugged-681745af-b6fd-4f84-bc98-43bc601c3759 for instance with vm_state active and task_state deleting.
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.compute.manager [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-unplugged-097e6f29-41d9-4842-a697-ad3d1a1b0d7c {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.compute.manager [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-unplugged-097e6f29-41d9-4842-a697-ad3d1a1b0d7c {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.compute.manager [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-unplugged-097e6f29-41d9-4842-a697-ad3d1a1b0d7c for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.compute.manager [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-plugged-097e6f29-41d9-4842-a697-ad3d1a1b0d7c {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.compute.manager [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-plugged-097e6f29-41d9-4842-a697-ad3d1a1b0d7c {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:47:50 user nova-compute[75247]: WARNING nova.compute.manager [req-6297afcc-102c-4380-8c7e-37261a00d8f7 req-c58065cc-8dd0-4b4a-b048-2b914cadb1cf service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received unexpected event network-vif-plugged-097e6f29-41d9-4842-a697-ad3d1a1b0d7c for instance with vm_state active and task_state deleting.
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: INFO os_vif [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:58:06,bridge_name='br-int',has_traffic_filtering=True,id=267ee847-5894-4c58-8554-e30b91938a6d,network=Network(01457309-20a2-4aaa-909d-163638785d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267ee847-58')
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286975828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-286975828',id=17,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2B8SHWnL5XT3DWY3gquaeb2zxCHvGF8t4a4ubj3jQmPtq9XBRNZCZWWoSYLM9FvzsvWTog0uix/tXd4joK1Eq8bokONhA/MCcUOpQ0086wGcwdflAWagcdXNUdya2xZw==',key_name='tempest-keypair-684324006',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:46:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66b95bb1359241ee8d2cf5015640a2b8',ramdisk_id='',reservation_id='r-6ft38hg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1989495369',owner_user_name='tempest-TaggedBootDevicesTest_v242-1989495369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:46:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9e5d32fc34046bcbf517062fe52f1a8',uuid=7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "097e6f29-41d9-4842-a697-ad3d1a1b0d7c", "address": "fa:16:3e:fd:ac:f5", "network": {"id": "7321830d-5ca0-4292-9e4b-c1e160a2b612", "bridge": "br-int", "label": "tempest-device-tagging-net2-5103445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097e6f29-41", "ovs_interfaceid": "097e6f29-41d9-4842-a697-ad3d1a1b0d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converting VIF {"id": "097e6f29-41d9-4842-a697-ad3d1a1b0d7c", "address": "fa:16:3e:fd:ac:f5", "network": {"id": "7321830d-5ca0-4292-9e4b-c1e160a2b612", "bridge": "br-int", "label": "tempest-device-tagging-net2-5103445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097e6f29-41", "ovs_interfaceid": "097e6f29-41d9-4842-a697-ad3d1a1b0d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:ac:f5,bridge_name='br-int',has_traffic_filtering=True,id=097e6f29-41d9-4842-a697-ad3d1a1b0d7c,network=Network(7321830d-5ca0-4292-9e4b-c1e160a2b612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap097e6f29-41') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_vif [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:ac:f5,bridge_name='br-int',has_traffic_filtering=True,id=097e6f29-41d9-4842-a697-ad3d1a1b0d7c,network=Network(7321830d-5ca0-4292-9e4b-c1e160a2b612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap097e6f29-41') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap097e6f29-41, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3dac9d23-cb9d-4135-806d-b30736479bdd) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: INFO os_vif [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:ac:f5,bridge_name='br-int',has_traffic_filtering=True,id=097e6f29-41d9-4842-a697-ad3d1a1b0d7c,network=Network(7321830d-5ca0-4292-9e4b-c1e160a2b612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap097e6f29-41')
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T12:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286975828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-286975828',id=17,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2B8SHWnL5XT3DWY3gquaeb2zxCHvGF8t4a4ubj3jQmPtq9XBRNZCZWWoSYLM9FvzsvWTog0uix/tXd4joK1Eq8bokONhA/MCcUOpQ0086wGcwdflAWagcdXNUdya2xZw==',key_name='tempest-keypair-684324006',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:46:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66b95bb1359241ee8d2cf5015640a2b8',ramdisk_id='',reservation_id='r-6ft38hg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1989495369',owner_user_name='tempest-TaggedBootDevicesTest_v242-1989495369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:46:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9e5d32fc34046bcbf517062fe52f1a8',uuid=7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c587e85c-ccd5-4bb9-803c-b08aed3baaeb", "address": "fa:16:3e:f9:0b:6e", "network": {"id": "7321830d-5ca0-4292-9e4b-c1e160a2b612", "bridge": "br-int", "label": "tempest-device-tagging-net2-5103445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc587e85c-cc", "ovs_interfaceid": "c587e85c-ccd5-4bb9-803c-b08aed3baaeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converting VIF {"id": "c587e85c-ccd5-4bb9-803c-b08aed3baaeb", "address": "fa:16:3e:f9:0b:6e", "network": {"id": "7321830d-5ca0-4292-9e4b-c1e160a2b612", "bridge": "br-int", "label": "tempest-device-tagging-net2-5103445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc587e85c-cc", "ovs_interfaceid": "c587e85c-ccd5-4bb9-803c-b08aed3baaeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:0b:6e,bridge_name='br-int',has_traffic_filtering=True,id=c587e85c-ccd5-4bb9-803c-b08aed3baaeb,network=Network(7321830d-5ca0-4292-9e4b-c1e160a2b612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc587e85c-cc') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_vif [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:0b:6e,bridge_name='br-int',has_traffic_filtering=True,id=c587e85c-ccd5-4bb9-803c-b08aed3baaeb,network=Network(7321830d-5ca0-4292-9e4b-c1e160a2b612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc587e85c-cc') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc587e85c-cc, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c100405-dd2d-41c3-bb04-6d55a3799a6d) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:50 user nova-compute[75247]: INFO os_vif [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:0b:6e,bridge_name='br-int',has_traffic_filtering=True,id=c587e85c-ccd5-4bb9-803c-b08aed3baaeb,network=Network(7321830d-5ca0-4292-9e4b-c1e160a2b612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc587e85c-cc')
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tWryFSfa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:47:50 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb9122e-3a92-46aa-b1d4-8bef0b428331]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:47:50 user nova-compute[75247]: No targets found.
Dec 06 12:47:50 user nova-compute[75247]: iSNS:
Dec 06 12:47:50 user nova-compute[75247]: No targets found.
Dec 06 12:47:50 user nova-compute[75247]: STATIC:
Dec 06 12:47:50 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b
Dec 06 12:47:50 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:47:50 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:47:50 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1
Dec 06 12:47:50 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:47:50 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:47:50 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd
Dec 06 12:47:50 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:47:50 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:47:50 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:47:50 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:47:50 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:47:50 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92
Dec 06 12:47:50 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:47:50 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:47:50 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db
Dec 06 12:47:50 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:47:50 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:47:50 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579
Dec 06 12:47:50 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:47:50 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:47:50 user nova-compute[75247]: FIRMWARE:
Dec 06 12:47:50 user nova-compute[75247]: No targets found.
Dec 06 12:47:50 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:47:50 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:47:50 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[064cce0f-b68e-4f27-b93f-4a566285ba61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9ea341-96e5-446e-bd53-cc89e2ca16db]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:47:50 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:47:50 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:47:50 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:47:50 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:47:50 user nova-compute[75247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:47:50 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:47:50 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:47:50 user nova-compute[75247]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b (non-flash)
Dec 06 12:47:50 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:47:50 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:47:50 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:47:50 user nova-compute[75247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:47:50 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:47:50 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c6128c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b'): ({'sdc'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Removing single pathed devices sdc {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[055cdcd3-10a1-4487-8a98-fadcb33c09c6]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59c9415-5a8f-455a-98b4-0e64c94a55a7]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Flushing IO for device /dev/sdc {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[649666ca-755a-4616-88ab-f70b1eb6c8d6]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab1f325-d9b1-4474-a068-d7bd1001afe6]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] SCSI volumes sdc have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d78d0da-fa25-4c16-bef6-44a2cb50a6cb]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.compute.manager [req-ccf1174d-2d11-4efd-a9df-558bfb93b43c req-bf7440b0-2e54-4b2c-990a-245cfb960897 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-plugged-7b8c474e-894c-43c2-9a4a-0836089a16a1 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ccf1174d-2d11-4efd-a9df-558bfb93b43c req-bf7440b0-2e54-4b2c-990a-245cfb960897 service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ccf1174d-2d11-4efd-a9df-558bfb93b43c req-bf7440b0-2e54-4b2c-990a-245cfb960897 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ccf1174d-2d11-4efd-a9df-558bfb93b43c req-bf7440b0-2e54-4b2c-990a-245cfb960897 service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.compute.manager [req-ccf1174d-2d11-4efd-a9df-558bfb93b43c req-bf7440b0-2e54-4b2c-990a-245cfb960897 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-plugged-7b8c474e-894c-43c2-9a4a-0836089a16a1 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:47:50 user nova-compute[75247]: WARNING nova.compute.manager [req-ccf1174d-2d11-4efd-a9df-558bfb93b43c req-bf7440b0-2e54-4b2c-990a-245cfb960897 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received unexpected event network-vif-plugged-7b8c474e-894c-43c2-9a4a-0836089a16a1 for instance with vm_state active and task_state deleting.
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c291e17-92ce-4b92-9021-799b90c1217d]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b, portal: 172.16.0.220,3260]
Dec 06 12:47:50 user nova-compute[75247]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b, portal: 172.16.0.220,3260] successful.
Dec 06 12:47:50 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f56b17-8536-40fa-aa9c-33f8aae05d8b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f3ecf2-21eb-4a50-8555-1401adb6b374]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] <== disconnect_volume: return (335ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JAXQZEqg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:47:50 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:47:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32b6abf-35fa-4702-9d97-f338de1a7394]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:47:51 user nova-compute[75247]: No targets found.
Dec 06 12:47:51 user nova-compute[75247]: iSNS:
Dec 06 12:47:51 user nova-compute[75247]: No targets found.
Dec 06 12:47:51 user nova-compute[75247]: STATIC:
Dec 06 12:47:51 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1
Dec 06 12:47:51 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:47:51 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:47:51 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd
Dec 06 12:47:51 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:47:51 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:47:51 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:47:51 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:47:51 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:47:51 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92
Dec 06 12:47:51 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:47:51 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:47:51 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db
Dec 06 12:47:51 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:47:51 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:47:51 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579
Dec 06 12:47:51 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:47:51 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:47:51 user nova-compute[75247]: FIRMWARE:
Dec 06 12:47:51 user nova-compute[75247]: No targets found.
Dec 06 12:47:51 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:47:51 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:47:51 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[718a0e77-2b4c-4d4b-8d34-9401e77c6a0a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61bea6c-08e4-4389-8d1b-6963618962e2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:47:51 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:47:51 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:47:51 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:47:51 user nova-compute[75247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:47:51 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:47:51 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:47:51 user nova-compute[75247]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd (non-flash)
Dec 06 12:47:51 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:47:51 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:47:51 user nova-compute[75247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:47:51 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:47:51 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c6128c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd'): ({'sdf'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Removing single pathed devices sdf {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d8a320-a405-46b2-84e1-bf5ecb8f9a62]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c66336-fc1c-424d-ba69-de76d0f9d5ce]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Flushing IO for device /dev/sdf {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42ac8d3-46c3-450c-9cf5-df2628186cf9]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6aeb8d-5380-48c4-8ccb-d963fb2f7497]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] SCSI volumes sdf have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe281f94-8a8f-4893-b28e-6fbdde34717b]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef5634e-8286-4ba5-a92f-6d33c6b2bb31]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd, portal: 172.16.0.220,3260]
Dec 06 12:47:51 user nova-compute[75247]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd, portal: 172.16.0.220,3260] successful.
Dec 06 12:47:51 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG nova.compute.manager [req-33e1a136-d7cd-4327-a0d2-203916f8f863 req-027f0002-4eb0-4f24-b9cd-0044082ff4ce service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-unplugged-c587e85c-ccd5-4bb9-803c-b08aed3baaeb {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-33e1a136-d7cd-4327-a0d2-203916f8f863 req-027f0002-4eb0-4f24-b9cd-0044082ff4ce service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-33e1a136-d7cd-4327-a0d2-203916f8f863 req-027f0002-4eb0-4f24-b9cd-0044082ff4ce service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-33e1a136-d7cd-4327-a0d2-203916f8f863 req-027f0002-4eb0-4f24-b9cd-0044082ff4ce service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG nova.compute.manager [req-33e1a136-d7cd-4327-a0d2-203916f8f863 req-027f0002-4eb0-4f24-b9cd-0044082ff4ce service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-unplugged-c587e85c-ccd5-4bb9-803c-b08aed3baaeb {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG nova.compute.manager [req-33e1a136-d7cd-4327-a0d2-203916f8f863 req-027f0002-4eb0-4f24-b9cd-0044082ff4ce service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-unplugged-c587e85c-ccd5-4bb9-803c-b08aed3baaeb for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG nova.compute.manager [req-33e1a136-d7cd-4327-a0d2-203916f8f863 req-027f0002-4eb0-4f24-b9cd-0044082ff4ce service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-plugged-c587e85c-ccd5-4bb9-803c-b08aed3baaeb {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-33e1a136-d7cd-4327-a0d2-203916f8f863 req-027f0002-4eb0-4f24-b9cd-0044082ff4ce service nova] Acquiring lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-33e1a136-d7cd-4327-a0d2-203916f8f863 req-027f0002-4eb0-4f24-b9cd-0044082ff4ce service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-33e1a136-d7cd-4327-a0d2-203916f8f863 req-027f0002-4eb0-4f24-b9cd-0044082ff4ce service nova] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG nova.compute.manager [req-33e1a136-d7cd-4327-a0d2-203916f8f863 req-027f0002-4eb0-4f24-b9cd-0044082ff4ce service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] No waiting events found dispatching network-vif-plugged-c587e85c-ccd5-4bb9-803c-b08aed3baaeb {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:47:51 user nova-compute[75247]: WARNING nova.compute.manager [req-33e1a136-d7cd-4327-a0d2-203916f8f863 req-027f0002-4eb0-4f24-b9cd-0044082ff4ce service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received unexpected event network-vif-plugged-c587e85c-ccd5-4bb9-803c-b08aed3baaeb for instance with vm_state active and task_state deleting.
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7af14201-81e7-40cd-b799-f09628defcfd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c916171e-d6ed-4aaa-8e33-4900fa28b2b4]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] <== disconnect_volume: return (324ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bWcOxIoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:47:51 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[12770a49-02c8-4263-b728-b567e26d5046]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:47:51 user nova-compute[75247]: No targets found.
Dec 06 12:47:51 user nova-compute[75247]: iSNS:
Dec 06 12:47:51 user nova-compute[75247]: No targets found.
Dec 06 12:47:51 user nova-compute[75247]: STATIC:
Dec 06 12:47:51 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1
Dec 06 12:47:51 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:47:51 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:47:51 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:47:51 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:47:51 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:47:51 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92
Dec 06 12:47:51 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:47:51 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:47:51 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db
Dec 06 12:47:51 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:47:51 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:47:51 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579
Dec 06 12:47:51 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:47:51 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:47:51 user nova-compute[75247]: FIRMWARE:
Dec 06 12:47:51 user nova-compute[75247]: No targets found.
Dec 06 12:47:51 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:47:51 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:47:51 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e91ba7-3a22-4eb2-877f-e5b42d210b8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[110cbdab-de63-4ccb-be28-21f895b57aa9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:47:51 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:47:51 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:47:51 user nova-compute[75247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:47:51 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:47:51 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:47:51 user nova-compute[75247]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 (non-flash)
Dec 06 12:47:51 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:47:51 user nova-compute[75247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:47:51 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:47:51 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd730462950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1'): ({'sdg'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Removing single pathed devices sdg {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[65324a79-a808-497e-8198-ce49f0cb7183]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82e6015-a107-4fc2-82a4-6b0bfe9a4a0c]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Flushing IO for device /dev/sdg {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0ae806-5364-4dd4-bf90-6618dacde410]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.053s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06bc43a-4f13-4b1a-a4e1-f377a625dcf8]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] SCSI volumes sdg have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fc1f0b-542f-4d9f-be90-3a241fb25229]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb79f6a-cd79-4f2c-a437-50b75d99dc1b]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1, portal: 172.16.0.220,3260]
Dec 06 12:47:51 user nova-compute[75247]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1, portal: 172.16.0.220,3260] successful.
Dec 06 12:47:51 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:097c5ec1-cec0-43f2-bafe-a31ca1cf2bf1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda53334-26e3-4d81-b6d4-2c0cab318468]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] <== disconnect_volume: return (309ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:47:51 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Deleting instance files /opt/stack/data/nova/instances/7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b_del
Dec 06 12:47:51 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Deletion of /opt/stack/data/nova/instances/7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b_del complete
Dec 06 12:47:51 user nova-compute[75247]: INFO nova.compute.manager [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Took 3.59 seconds to destroy the instance on the hypervisor.
Dec 06 12:47:51 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:47:51 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f88d6033-5424-4739-8cbb-110e4e4ca910 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:47:51 user nova-compute[75247]: INFO nova.compute.manager [None req-f88d6033-5424-4739-8cbb-110e4e4ca910 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] instance snapshotting
Dec 06 12:47:52 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-f88d6033-5424-4739-8cbb-110e4e4ca910 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Beginning live snapshot process
Dec 06 12:47:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f88d6033-5424-4739-8cbb-110e4e4ca910 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json -f qcow2 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f88d6033-5424-4739-8cbb-110e4e4ca910 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f88d6033-5424-4739-8cbb-110e4e4ca910 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json -f qcow2 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f88d6033-5424-4739-8cbb-110e4e4ca910 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f88d6033-5424-4739-8cbb-110e4e4ca910 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:52 user nova-compute[75247]: DEBUG nova.compute.manager [req-05a99f05-5104-4edf-b0af-4fbadef78bd5 req-0e675540-6bdb-49d5-9daa-b651fb4554a9 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received event network-changed-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:52 user nova-compute[75247]: DEBUG nova.compute.manager [req-05a99f05-5104-4edf-b0af-4fbadef78bd5 req-0e675540-6bdb-49d5-9daa-b651fb4554a9 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Refreshing instance network info cache due to event network-changed-861bfd56-2888-46b4-b583-08526d05bcd6. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:47:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-05a99f05-5104-4edf-b0af-4fbadef78bd5 req-0e675540-6bdb-49d5-9daa-b651fb4554a9 service nova] Acquiring lock "refresh_cache-db837c7a-c52d-469b-abf7-cea107454c60" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:47:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-05a99f05-5104-4edf-b0af-4fbadef78bd5 req-0e675540-6bdb-49d5-9daa-b651fb4554a9 service nova] Acquired lock "refresh_cache-db837c7a-c52d-469b-abf7-cea107454c60" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:47:52 user nova-compute[75247]: DEBUG nova.network.neutron [req-05a99f05-5104-4edf-b0af-4fbadef78bd5 req-0e675540-6bdb-49d5-9daa-b651fb4554a9 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Refreshing network info cache for port 861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:47:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f88d6033-5424-4739-8cbb-110e4e4ca910 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.183s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f88d6033-5424-4739-8cbb-110e4e4ca910 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfd5re8_a/b9003b21825049a2865fd9ca2b508582.delta 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f88d6033-5424-4739-8cbb-110e4e4ca910 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfd5re8_a/b9003b21825049a2865fd9ca2b508582.delta 1073741824" returned: 0 in 0.048s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:52 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-f88d6033-5424-4739-8cbb-110e4e4ca910 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 06 12:47:53 user nova-compute[75247]: DEBUG nova.network.neutron [req-05a99f05-5104-4edf-b0af-4fbadef78bd5 req-0e675540-6bdb-49d5-9daa-b651fb4554a9 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Updated VIF entry in instance network info cache for port 861bfd56-2888-46b4-b583-08526d05bcd6. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:47:53 user nova-compute[75247]: DEBUG nova.network.neutron [req-05a99f05-5104-4edf-b0af-4fbadef78bd5 req-0e675540-6bdb-49d5-9daa-b651fb4554a9 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Updating instance_info_cache with network_info: [{"id": "861bfd56-2888-46b4-b583-08526d05bcd6", "address": "fa:16:3e:eb:bc:82", "network": {"id": "52a97bc9-88b7-430a-80c8-3d6210441943", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1761062078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8f578ae9d44706b68eaac234ae6d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861bfd56-28", "ovs_interfaceid": "861bfd56-2888-46b4-b583-08526d05bcd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:47:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-05a99f05-5104-4edf-b0af-4fbadef78bd5 req-0e675540-6bdb-49d5-9daa-b651fb4554a9 service nova] Releasing lock "refresh_cache-db837c7a-c52d-469b-abf7-cea107454c60" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:47:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f88d6033-5424-4739-8cbb-110e4e4ca910 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 12:47:53 user nova-compute[75247]: DEBUG nova.compute.manager [req-9b364f97-76ef-4c79-827a-884dec03677f req-089c6b6c-a50c-4897-a418-53a788a6815a service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-deleted-a079e33d-4b03-49ef-8315-f33edfb30f8f {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:53 user nova-compute[75247]: INFO nova.compute.manager [req-9b364f97-76ef-4c79-827a-884dec03677f req-089c6b6c-a50c-4897-a418-53a788a6815a service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Neutron deleted interface a079e33d-4b03-49ef-8315-f33edfb30f8f; detaching it from the instance and deleting it from the info cache
Dec 06 12:47:53 user nova-compute[75247]: DEBUG nova.network.neutron [req-9b364f97-76ef-4c79-827a-884dec03677f req-089c6b6c-a50c-4897-a418-53a788a6815a service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Updating instance_info_cache with network_info: [{"id": "2d117aa5-7c18-4adb-be72-d785e4905735", "address": "fa:16:3e:b3:6f:7c", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d117aa5-7c", "ovs_interfaceid": "2d117aa5-7c18-4adb-be72-d785e4905735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "681745af-b6fd-4f84-bc98-43bc601c3759", "address": "fa:16:3e:83:ce:7b", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681745af-b6", "ovs_interfaceid": "681745af-b6fd-4f84-bc98-43bc601c3759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b8c474e-894c-43c2-9a4a-0836089a16a1", "address": "fa:16:3e:09:e2:1a", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8c474e-89", "ovs_interfaceid": "7b8c474e-894c-43c2-9a4a-0836089a16a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "267ee847-5894-4c58-8554-e30b91938a6d", "address": "fa:16:3e:72:58:06", "network": {"id": "01457309-20a2-4aaa-909d-163638785d1c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1465232969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267ee847-58", "ovs_interfaceid": "267ee847-5894-4c58-8554-e30b91938a6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "097e6f29-41d9-4842-a697-ad3d1a1b0d7c", "address": "fa:16:3e:fd:ac:f5", "network": {"id": "7321830d-5ca0-4292-9e4b-c1e160a2b612", "bridge": "br-int", "label": "tempest-device-tagging-net2-5103445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097e6f29-41", "ovs_interfaceid": "097e6f29-41d9-4842-a697-ad3d1a1b0d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c587e85c-ccd5-4bb9-803c-b08aed3baaeb", "address": "fa:16:3e:f9:0b:6e", "network": {"id": "7321830d-5ca0-4292-9e4b-c1e160a2b612", "bridge": "br-int", "label": "tempest-device-tagging-net2-5103445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66b95bb1359241ee8d2cf5015640a2b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc587e85c-cc", "ovs_interfaceid": "c587e85c-ccd5-4bb9-803c-b08aed3baaeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:47:53 user nova-compute[75247]: DEBUG nova.compute.manager [req-9b364f97-76ef-4c79-827a-884dec03677f req-089c6b6c-a50c-4897-a418-53a788a6815a service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Detach interface failed, port_id=a079e33d-4b03-49ef-8315-f33edfb30f8f, reason: Instance 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b could not be found. {{(pid=75247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 12:47:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:54 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f88d6033-5424-4739-8cbb-110e4e4ca910 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 12:47:54 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-f88d6033-5424-4739-8cbb-110e4e4ca910 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 06 12:47:54 user nova-compute[75247]: DEBUG nova.privsep.utils [None req-f88d6033-5424-4739-8cbb-110e4e4ca910 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 12:47:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f88d6033-5424-4739-8cbb-110e4e4ca910 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfd5re8_a/b9003b21825049a2865fd9ca2b508582.delta /opt/stack/data/nova/instances/snapshots/tmpfd5re8_a/b9003b21825049a2865fd9ca2b508582 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f88d6033-5424-4739-8cbb-110e4e4ca910 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfd5re8_a/b9003b21825049a2865fd9ca2b508582.delta /opt/stack/data/nova/instances/snapshots/tmpfd5re8_a/b9003b21825049a2865fd9ca2b508582" returned: 0 in 0.655s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:54 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-f88d6033-5424-4739-8cbb-110e4e4ca910 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Snapshot extracted, beginning image upload
Dec 06 12:47:55 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:47:55 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Took 3.75 seconds to deallocate network for instance.
Dec 06 12:47:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:55 user nova-compute[75247]: DEBUG nova.compute.manager [req-5a1fa94a-1fbc-409a-a949-d2344d1e8437 req-64d20608-981f-4a5f-889b-58ec55f035f2 service nova] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Received event network-changed-02bb5689-5d75-4967-b307-862ab2c1fb7f {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:55 user nova-compute[75247]: DEBUG nova.compute.manager [req-5a1fa94a-1fbc-409a-a949-d2344d1e8437 req-64d20608-981f-4a5f-889b-58ec55f035f2 service nova] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Refreshing instance network info cache due to event network-changed-02bb5689-5d75-4967-b307-862ab2c1fb7f. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:47:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5a1fa94a-1fbc-409a-a949-d2344d1e8437 req-64d20608-981f-4a5f-889b-58ec55f035f2 service nova] Acquiring lock "refresh_cache-ea75ba22-b4af-4454-93ed-cdfdc76a895b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:47:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5a1fa94a-1fbc-409a-a949-d2344d1e8437 req-64d20608-981f-4a5f-889b-58ec55f035f2 service nova] Acquired lock "refresh_cache-ea75ba22-b4af-4454-93ed-cdfdc76a895b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:47:55 user nova-compute[75247]: DEBUG nova.network.neutron [req-5a1fa94a-1fbc-409a-a949-d2344d1e8437 req-64d20608-981f-4a5f-889b-58ec55f035f2 service nova] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Refreshing network info cache for port 02bb5689-5d75-4967-b307-862ab2c1fb7f {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:47:55 user nova-compute[75247]: DEBUG nova.compute.manager [req-590680a1-939c-415e-a70f-9c2d9132c779 req-4d168b98-c860-4d72-9ada-b8701128cd42 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-deleted-097e6f29-41d9-4842-a697-ad3d1a1b0d7c {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:55 user nova-compute[75247]: DEBUG nova.compute.manager [req-590680a1-939c-415e-a70f-9c2d9132c779 req-4d168b98-c860-4d72-9ada-b8701128cd42 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-deleted-7b8c474e-894c-43c2-9a4a-0836089a16a1 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:55 user nova-compute[75247]: DEBUG nova.compute.manager [req-590680a1-939c-415e-a70f-9c2d9132c779 req-4d168b98-c860-4d72-9ada-b8701128cd42 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-deleted-c587e85c-ccd5-4bb9-803c-b08aed3baaeb {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:55 user nova-compute[75247]: DEBUG nova.compute.manager [req-590680a1-939c-415e-a70f-9c2d9132c779 req-4d168b98-c860-4d72-9ada-b8701128cd42 service nova] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Received event network-vif-deleted-267ee847-5894-4c58-8554-e30b91938a6d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:47:56 user nova-compute[75247]: DEBUG nova.network.neutron [req-5a1fa94a-1fbc-409a-a949-d2344d1e8437 req-64d20608-981f-4a5f-889b-58ec55f035f2 service nova] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Updated VIF entry in instance network info cache for port 02bb5689-5d75-4967-b307-862ab2c1fb7f. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:47:56 user nova-compute[75247]: DEBUG nova.network.neutron [req-5a1fa94a-1fbc-409a-a949-d2344d1e8437 req-64d20608-981f-4a5f-889b-58ec55f035f2 service nova] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Updating instance_info_cache with network_info: [{"id": "02bb5689-5d75-4967-b307-862ab2c1fb7f", "address": "fa:16:3e:88:36:c4", "network": {"id": "783b08eb-3a13-4dea-a30d-94ce21434b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-358384266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4efbc08c0354cb28d4d62be836f5e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02bb5689-5d", "ovs_interfaceid": "02bb5689-5d75-4967-b307-862ab2c1fb7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:47:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5a1fa94a-1fbc-409a-a949-d2344d1e8437 req-64d20608-981f-4a5f-889b-58ec55f035f2 service nova] Releasing lock "refresh_cache-ea75ba22-b4af-4454-93ed-cdfdc76a895b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:47:57 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-f88d6033-5424-4739-8cbb-110e4e4ca910 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Snapshot image upload complete
Dec 06 12:47:57 user nova-compute[75247]: INFO nova.compute.manager [None req-f88d6033-5424-4739-8cbb-110e4e4ca910 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Took 5.61 seconds to snapshot the instance on the hypervisor.
Dec 06 12:47:58 user nova-compute[75247]: INFO nova.compute.manager [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] [instance: 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b] Took 2.63 seconds to detach 3 volumes for instance.
Dec 06 12:47:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:58 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:47:58 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:47:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.447s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:58 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Deleted allocations for instance 7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b
Dec 06 12:47:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Acquiring lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:58 user nova-compute[75247]: DEBUG nova.objects.instance [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lazy-loading 'flavor' on Instance uuid ea75ba22-b4af-4454-93ed-cdfdc76a895b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:47:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e20c13da-4887-46ac-b849-7d0c2322529c tempest-TaggedBootDevicesTest_v242-1989495369 tempest-TaggedBootDevicesTest_v242-1989495369-project-member] Lock "7bc09cb2-9c2e-4f2f-8055-fd9ab5f72b7b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.619s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:47:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Acquiring lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:47:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:47:58 user nova-compute[75247]: INFO nova.compute.manager [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Attaching volume ec803e33-a7d5-4e87-bee6-9deea4f57251 to /dev/vdb
Dec 06 12:47:58 user nova-compute[75247]: DEBUG os_brick.utils [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:47:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d8c573-819b-4d7b-89c3-d08cb788ad44]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9d92aa-54cc-490e-81c2-71b834d19d57]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:47:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[88de6549-db25-4db3-ab93-22ff353d244e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02c04d8-a6ee-476b-b720-ef77ff7c3ad5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:47:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:47:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:47:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:47:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:47:59 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:47:59 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ee8533-6e9a-4d89-a40a-edb2739c2f0f]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:47:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:47:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:47:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:47:59 user nova-compute[75247]: DEBUG os_brick.utils [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:47:59 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Updating existing volume attachment record: 42638073-2607-4b14-8fd3-c7dd27f65120 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:48:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:04 user nova-compute[75247]: DEBUG nova.compute.manager [req-ffb652aa-12e3-488b-b5cd-7d822f34796a req-bf933dcb-81f1-432c-9551-698e6a117831 service nova] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Received event network-changed-85ce649b-cff1-4ab2-b9f8-c187f9124936 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:48:04 user nova-compute[75247]: DEBUG nova.compute.manager [req-ffb652aa-12e3-488b-b5cd-7d822f34796a req-bf933dcb-81f1-432c-9551-698e6a117831 service nova] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Refreshing instance network info cache due to event network-changed-85ce649b-cff1-4ab2-b9f8-c187f9124936. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:48:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ffb652aa-12e3-488b-b5cd-7d822f34796a req-bf933dcb-81f1-432c-9551-698e6a117831 service nova] Acquiring lock "refresh_cache-97d1f646-bc64-40e2-9418-c89a87473640" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:48:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ffb652aa-12e3-488b-b5cd-7d822f34796a req-bf933dcb-81f1-432c-9551-698e6a117831 service nova] Acquired lock "refresh_cache-97d1f646-bc64-40e2-9418-c89a87473640" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:48:04 user nova-compute[75247]: DEBUG nova.network.neutron [req-ffb652aa-12e3-488b-b5cd-7d822f34796a req-bf933dcb-81f1-432c-9551-698e6a117831 service nova] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Refreshing network info cache for port 85ce649b-cff1-4ab2-b9f8-c187f9124936 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "97d1f646-bc64-40e2-9418-c89a87473640" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "97d1f646-bc64-40e2-9418-c89a87473640" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG nova.objects.instance [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lazy-loading 'flavor' on Instance uuid 97d1f646-bc64-40e2-9418-c89a87473640 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:48:05 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Ignoring supplied device name: /dev/vdb
Dec 06 12:48:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "97d1f646-bc64-40e2-9418-c89a87473640" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "97d1f646-bc64-40e2-9418-c89a87473640" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "97d1f646-bc64-40e2-9418-c89a87473640" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:48:05 user nova-compute[75247]: INFO nova.compute.manager [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Attaching volume 8cced015-e2df-4f38-ba42-6c2c09257732 to /dev/vdb
Dec 06 12:48:05 user nova-compute[75247]: DEBUG nova.network.neutron [req-ffb652aa-12e3-488b-b5cd-7d822f34796a req-bf933dcb-81f1-432c-9551-698e6a117831 service nova] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Updated VIF entry in instance network info cache for port 85ce649b-cff1-4ab2-b9f8-c187f9124936. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG nova.network.neutron [req-ffb652aa-12e3-488b-b5cd-7d822f34796a req-bf933dcb-81f1-432c-9551-698e6a117831 service nova] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Updating instance_info_cache with network_info: [{"id": "85ce649b-cff1-4ab2-b9f8-c187f9124936", "address": "fa:16:3e:f8:f7:bd", "network": {"id": "24492570-dfe5-49d1-944e-7435cc85d347", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145359804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58ba64f48e946098b72d7061d354ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ce649b-cf", "ovs_interfaceid": "85ce649b-cff1-4ab2-b9f8-c187f9124936", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ffb652aa-12e3-488b-b5cd-7d822f34796a req-bf933dcb-81f1-432c-9551-698e6a117831 service nova] Releasing lock "refresh_cache-97d1f646-bc64-40e2-9418-c89a87473640" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG os_brick.utils [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdd6c5b-cad6-422c-9f42-d0b0ea6d20aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6786dd-e8f5-4d3f-a7ef-d92e2a454ab6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[df793caf-c354-44ad-bdd8-c0af6f70e1ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b74b168-7fc9-46e3-bcb3-cb639219f687]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:48:05 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:48:05 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b393b46b-e80e-44f2-bbc3-a81cb1285881]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG os_brick.utils [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Updating existing volume attachment record: f695745f-1245-4ef9-a4ad-c2c3e0aebc5a {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:48:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:09 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:48:09 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:48:09 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:48:09 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:48:09 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:48:09 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:48:09 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 12:48:09 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:48:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:10 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:48:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:48:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:48:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:48:10 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 12:48:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:48:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97d1f646-bc64-40e2-9418-c89a87473640/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97d1f646-bc64-40e2-9418-c89a87473640/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97d1f646-bc64-40e2-9418-c89a87473640/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97d1f646-bc64-40e2-9418-c89a87473640/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:48:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7113836-350f-4ef2-a64e-418c34e2446f/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7113836-350f-4ef2-a64e-418c34e2446f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7113836-350f-4ef2-a64e-418c34e2446f/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7113836-350f-4ef2-a64e-418c34e2446f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:14 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:48:14 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:48:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:15 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:48:15 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:48:15 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=7485MB free_disk=25.10839080810547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 12:48:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:48:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:48:15 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 70c4664e-ae7a-47de-bba7-18300391d209 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:48:15 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 782289e2-91cd-4aee-9a08-eadfb2a5965b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:48:15 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:48:15 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 3e1b5197-dc38-48a5-b9f9-e053be499433 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:48:15 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 0a86fe94-933a-4e0d-8a65-4834c3d3e40b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:48:15 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:48:15 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 4531bf11-b948-4d57-bf55-f33563815e26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:48:15 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance db837c7a-c52d-469b-abf7-cea107454c60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:48:15 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance ea75ba22-b4af-4454-93ed-cdfdc76a895b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:48:15 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 97d1f646-bc64-40e2-9418-c89a87473640 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:48:15 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance a7113836-350f-4ef2-a64e-418c34e2446f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:48:15 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 12:48:15 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 12:48:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:15 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:48:15 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:48:15 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 12:48:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.508s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:48:16 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:48:16 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 12:48:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-782289e2-91cd-4aee-9a08-eadfb2a5965b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:48:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-782289e2-91cd-4aee-9a08-eadfb2a5965b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:48:16 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 12:48:17 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Updating instance_info_cache with network_info: [{"id": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "address": "fa:16:3e:e4:cb:02", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924c627-a1", "ovs_interfaceid": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:48:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-782289e2-91cd-4aee-9a08-eadfb2a5965b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:48:17 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 12:48:17 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEyJusrd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:48:18 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:48:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:48:18 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:48:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:48:18 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde5eb40-0875-41dc-bc5a-c8f3884dc153]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:48:18 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[becc3d83-ef42-47db-9819-86583721cc69]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251] added
Dec 06 12:48:18 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6468ecc8-a79b-4b3c-b4b6-13308d699e9d]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDiZelgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:48:18 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:48:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d71648-0e0b-4a76-9994-89cf7ce625f0]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LEyJusrd {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LEyJusrd" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eff7a25-5235-4608-8742-710bd51fe465]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LEyJusrd'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7110e58d-188f-47ae-9b9a-16817c18aa62]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d8f2d4-e29a-4d03-bf22-57fb578533b6]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:48:18 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:48:18 user nova-compute[75247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:48:18 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:48:18 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:48:18 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:48:18 user nova-compute[75247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:48:18 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:48:18 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f72cbcb-5f02-46a8-a3cb-bd181237be20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251, portal: 172.16.0.220,3260]
Dec 06 12:48:18 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251, portal: 172.16.0.220,3260] successful.
Dec 06 12:48:18 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4801e0-d5fa-4bbf-9f8e-ac533d995108]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[99156acd-32c3-4034-8f8c-0d2f9638b7b5]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:48:18 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:48:18 user nova-compute[75247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:48:18 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:48:18 user nova-compute[75247]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 (non-flash)
Dec 06 12:48:18 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:48:18 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:48:18 user nova-compute[75247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:48:18 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:48:18 user nova-compute[75247]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 (non-flash)
Dec 06 12:48:18 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f065730-3beb-4ec5-aa15-a10a3b25fc65]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:48:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEyJusrd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23836653634396262', 'path': '/dev/sdc'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836653634396262', 'path': '/dev/sdc'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.231s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:48:19 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:48:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:48:19 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG nova.objects.instance [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lazy-loading 'flavor' on Instance uuid ea75ba22-b4af-4454-93ed-cdfdc76a895b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[58750947-1520-43ae-940e-bc7c9f5ef61d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:48:19 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 12:48:19 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:48:19 user nova-compute[75247]:   <source dev="/dev/sdc"/>
Dec 06 12:48:19 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:48:19 user nova-compute[75247]:   <serial>ec803e33-a7d5-4e87-bee6-9deea4f57251</serial>
Dec 06 12:48:19 user nova-compute[75247]: </disk>
Dec 06 12:48:19 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cc65b6-1666-443b-be16-ab9e5c084fcd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732] added
Dec 06 12:48:19 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[57720d1d-a407-44b1-9d73-5b160e0edbe0]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[358db4b2-a329-4ece-8193-cd998d68bfd5]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yDiZelgO {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yDiZelgO" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76a959a-84b6-4ea4-bb2a-893da27b4c3a]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yDiZelgO'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[853a6f6b-2233-4b2a-9bb4-578314c888c1]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1ef7c6-48c7-4840-827e-1c07cdbf7bf0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:48:19 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:48:19 user nova-compute[75247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:48:19 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:48:19 user nova-compute[75247]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 (non-flash)
Dec 06 12:48:19 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:48:19 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:48:19 user nova-compute[75247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:48:19 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:48:19 user nova-compute[75247]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 (non-flash)
Dec 06 12:48:19 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b89a4b-ce23-4d7a-8ca4-36bc89c64321]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732, portal: 172.16.0.220,3260]
Dec 06 12:48:19 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732, portal: 172.16.0.220,3260] successful.
Dec 06 12:48:19 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fe516f-29ea-41e1-97fa-462d9c72d0fe]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1007b2-baf8-4066-9744-8eb3e8494c4d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:48:19 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:48:19 user nova-compute[75247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:48:19 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:48:19 user nova-compute[75247]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 (non-flash)
Dec 06 12:48:19 user nova-compute[75247]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 (non-flash)
Dec 06 12:48:19 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:48:19 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:48:19 user nova-compute[75247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:48:19 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:48:19 user nova-compute[75247]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 (non-flash)
Dec 06 12:48:19 user nova-compute[75247]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 (non-flash)
Dec 06 12:48:19 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] HCTL ('37', '-', '-', 0) found on session 30 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[353d5325-e297-4ab3-9106-ad36e1d38b65]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Searching for a device in session 30 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDiZelgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] No VIF found with MAC fa:16:3e:88:36:c4, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:48:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-09ad18b1-f926-4bfc-b3a1-f0350172eb05 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.066s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:48:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:48:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] <== connect_volume: return (2585ms) {'type': 'block', 'scsi_wwn': '23262633734303562', 'path': '/dev/sdf'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:48:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262633734303562', 'path': '/dev/sdf'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:48:20 user nova-compute[75247]: DEBUG nova.objects.instance [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lazy-loading 'flavor' on Instance uuid 97d1f646-bc64-40e2-9418-c89a87473640 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:48:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 12:48:20 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:48:20 user nova-compute[75247]:   <source dev="/dev/sdf"/>
Dec 06 12:48:20 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:48:20 user nova-compute[75247]:   <serial>8cced015-e2df-4f38-ba42-6c2c09257732</serial>
Dec 06 12:48:20 user nova-compute[75247]: </disk>
Dec 06 12:48:20 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 12:48:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Acquiring lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:48:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:48:20 user nova-compute[75247]: INFO nova.compute.manager [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Detaching volume ec803e33-a7d5-4e87-bee6-9deea4f57251
Dec 06 12:48:21 user nova-compute[75247]: INFO nova.virt.block_device [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Attempting to driver detach volume ec803e33-a7d5-4e87-bee6-9deea4f57251 from mountpoint /dev/vdb
Dec 06 12:48:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Attempting to detach device vdb from instance ea75ba22-b4af-4454-93ed-cdfdc76a895b from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 12:48:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:48:21 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:48:21 user nova-compute[75247]:   <source dev="/dev/sdc"/>
Dec 06 12:48:21 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:48:21 user nova-compute[75247]:   <serial>ec803e33-a7d5-4e87-bee6-9deea4f57251</serial>
Dec 06 12:48:21 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:48:21 user nova-compute[75247]: </disk>
Dec 06 12:48:21 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:48:21 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Successfully detached device vdb from instance ea75ba22-b4af-4454-93ed-cdfdc76a895b from the persistent domain config.
Dec 06 12:48:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ea75ba22-b4af-4454-93ed-cdfdc76a895b from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 12:48:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:48:21 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:48:21 user nova-compute[75247]:   <source dev="/dev/sdc"/>
Dec 06 12:48:21 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:48:21 user nova-compute[75247]:   <serial>ec803e33-a7d5-4e87-bee6-9deea4f57251</serial>
Dec 06 12:48:21 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:48:21 user nova-compute[75247]: </disk>
Dec 06 12:48:21 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:48:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:48:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:48:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] No VIF found with MAC fa:16:3e:f8:f7:bd, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:48:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-2a6370e0-3b7b-42a1-8051-a613dcf8768b tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "97d1f646-bc64-40e2-9418-c89a87473640" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.070s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:48:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ea75ba22-b4af-4454-93ed-cdfdc76a895b {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 12:48:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:29 user nova-compute[75247]: DEBUG nova.compute.manager [req-6fdcedde-956b-4fe9-ae40-966f6dce820d req-e73343eb-0912-47c3-9a33-c9ffb96630cf service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received event network-changed-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:48:29 user nova-compute[75247]: DEBUG nova.compute.manager [req-6fdcedde-956b-4fe9-ae40-966f6dce820d req-e73343eb-0912-47c3-9a33-c9ffb96630cf service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Refreshing instance network info cache due to event network-changed-a8d5f682-76a1-4b39-8153-487fe53a127a. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:48:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6fdcedde-956b-4fe9-ae40-966f6dce820d req-e73343eb-0912-47c3-9a33-c9ffb96630cf service nova] Acquiring lock "refresh_cache-0a86fe94-933a-4e0d-8a65-4834c3d3e40b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:48:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6fdcedde-956b-4fe9-ae40-966f6dce820d req-e73343eb-0912-47c3-9a33-c9ffb96630cf service nova] Acquired lock "refresh_cache-0a86fe94-933a-4e0d-8a65-4834c3d3e40b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:48:29 user nova-compute[75247]: DEBUG nova.network.neutron [req-6fdcedde-956b-4fe9-ae40-966f6dce820d req-e73343eb-0912-47c3-9a33-c9ffb96630cf service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Refreshing network info cache for port a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:48:30 user nova-compute[75247]: DEBUG nova.network.neutron [req-6fdcedde-956b-4fe9-ae40-966f6dce820d req-e73343eb-0912-47c3-9a33-c9ffb96630cf service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Updated VIF entry in instance network info cache for port a8d5f682-76a1-4b39-8153-487fe53a127a. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:48:30 user nova-compute[75247]: DEBUG nova.network.neutron [req-6fdcedde-956b-4fe9-ae40-966f6dce820d req-e73343eb-0912-47c3-9a33-c9ffb96630cf service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Updating instance_info_cache with network_info: [{"id": "a8d5f682-76a1-4b39-8153-487fe53a127a", "address": "fa:16:3e:a7:11:06", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d5f682-76", "ovs_interfaceid": "a8d5f682-76a1-4b39-8153-487fe53a127a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:48:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6fdcedde-956b-4fe9-ae40-966f6dce820d req-e73343eb-0912-47c3-9a33-c9ffb96630cf service nova] Releasing lock "refresh_cache-0a86fe94-933a-4e0d-8a65-4834c3d3e40b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:48:30 user nova-compute[75247]: DEBUG nova.objects.instance [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'flavor' on Instance uuid a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:48:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:48:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:48:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "refresh_cache-a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:48:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquired lock "refresh_cache-a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:48:30 user nova-compute[75247]: DEBUG nova.network.neutron [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:48:30 user nova-compute[75247]: DEBUG nova.objects.instance [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'info_cache' on Instance uuid a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:48:30 user nova-compute[75247]: INFO nova.compute.manager [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Detaching volume b3c81dcf-076d-4330-aecd-a47fd48c4d92
Dec 06 12:48:30 user nova-compute[75247]: DEBUG nova.objects.base [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Object Instance<a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a> lazy-loaded attributes: flavor,info_cache {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:48:30 user nova-compute[75247]: INFO nova.virt.block_device [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Attempting to driver detach volume b3c81dcf-076d-4330-aecd-a47fd48c4d92 from mountpoint /dev/vdb
Dec 06 12:48:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Attempting to detach device vdb from instance 0a86fe94-933a-4e0d-8a65-4834c3d3e40b from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 12:48:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:48:30 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:48:30 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:48:30 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:48:30 user nova-compute[75247]:   <serial>b3c81dcf-076d-4330-aecd-a47fd48c4d92</serial>
Dec 06 12:48:30 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 06 12:48:30 user nova-compute[75247]: </disk>
Dec 06 12:48:30 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:48:30 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Successfully detached device vdb from instance 0a86fe94-933a-4e0d-8a65-4834c3d3e40b from the persistent domain config.
Dec 06 12:48:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0a86fe94-933a-4e0d-8a65-4834c3d3e40b from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 12:48:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:48:30 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:48:30 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:48:30 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:48:30 user nova-compute[75247]:   <serial>b3c81dcf-076d-4330-aecd-a47fd48c4d92</serial>
Dec 06 12:48:30 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 06 12:48:30 user nova-compute[75247]: </disk>
Dec 06 12:48:30 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.network.neutron [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Updating instance_info_cache with network_info: [{"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Releasing lock "refresh_cache-a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:48:31 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Instance destroyed successfully.
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.objects.instance [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'resources' on Instance uuid a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0a86fe94-933a-4e0d-8a65-4834c3d3e40b {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.objects.base [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Object Instance<a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1942005817',display_name='tempest-AttachVolumeTestJSON-server-1942005817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1942005817',id=4,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGz+hJ0HTVL1CpIzjfndN5RB0FYKnfV0muFx2QzLM69CRA62Oly9Vvvkkj6Ccf/qOmS6iQUbmUmx8/zqty8k8DI7l9pqS+f/lxdpJZ0usxBwqzknFRlQwwi6Ig22Eo3VA==',key_name='tempest-keypair-21482804',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:40:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4f3aeaf6ffdb4cc0807d90e73e92fa7e',ramdisk_id='',reservation_id='r-wenfkxlt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-209684424',owner_user_name='tempest-AttachVolumeTestJSON-209684424-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:46:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cb0e32ba6094d1e8053787bc1979b65',uuid=a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Converting VIF {"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2f:c5,bridge_name='br-int',has_traffic_filtering=True,id=b7c5418b-5afb-45b5-af6c-c46f82ef72cc,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5418b-5a') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG os_vif [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2f:c5,bridge_name='br-int',has_traffic_filtering=True,id=b7c5418b-5afb-45b5-af6c-c46f82ef72cc,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5418b-5a') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7c5418b-5a, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5e7ec562-f4e5-4841-8189-9c78675a323c) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:31 user nova-compute[75247]: INFO os_vif [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2f:c5,bridge_name='br-int',has_traffic_filtering=True,id=b7c5418b-5afb-45b5-af6c-c46f82ef72cc,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5418b-5a')
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Start _get_guest_xml network_info=[{"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.objects.instance [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'numa_topology' on Instance uuid a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.objects.base [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Object Instance<a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:48:31 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:48:31 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.objects.instance [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'vcpu_model' on Instance uuid a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.objects.base [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Object Instance<a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1942005817',display_name='tempest-AttachVolumeTestJSON-server-1942005817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1942005817',id=4,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGz+hJ0HTVL1CpIzjfndN5RB0FYKnfV0muFx2QzLM69CRA62Oly9Vvvkkj6Ccf/qOmS6iQUbmUmx8/zqty8k8DI7l9pqS+f/lxdpJZ0usxBwqzknFRlQwwi6Ig22Eo3VA==',key_name='tempest-keypair-21482804',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:40:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4f3aeaf6ffdb4cc0807d90e73e92fa7e',ramdisk_id='',reservation_id='r-wenfkxlt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-209684424',owner_user_name='tempest-AttachVolumeTestJSON-209684424-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:46:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cb0e32ba6094d1e8053787bc1979b65',uuid=a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Converting VIF {"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2f:c5,bridge_name='br-int',has_traffic_filtering=True,id=b7c5418b-5afb-45b5-af6c-c46f82ef72cc,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5418b-5a') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.objects.instance [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'pci_devices' on Instance uuid a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.objects.base [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Object Instance<a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:48:31 user nova-compute[75247]:   <uuid>a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a</uuid>
Dec 06 12:48:31 user nova-compute[75247]:   <name>instance-00000004</name>
Dec 06 12:48:31 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:48:31 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:48:31 user nova-compute[75247]:   <metadata>
Dec 06 12:48:31 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:48:31 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:48:31 user nova-compute[75247]:       <nova:name>tempest-AttachVolumeTestJSON-server-1942005817</nova:name>
Dec 06 12:48:31 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:48:31</nova:creationTime>
Dec 06 12:48:31 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:48:31 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:48:31 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:48:31 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:48:31 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:48:31 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:48:31 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:48:31 user nova-compute[75247]:       <nova:owner>
Dec 06 12:48:31 user nova-compute[75247]:         <nova:user uuid="4cb0e32ba6094d1e8053787bc1979b65">tempest-AttachVolumeTestJSON-209684424-project-member</nova:user>
Dec 06 12:48:31 user nova-compute[75247]:         <nova:project uuid="4f3aeaf6ffdb4cc0807d90e73e92fa7e">tempest-AttachVolumeTestJSON-209684424</nova:project>
Dec 06 12:48:31 user nova-compute[75247]:       </nova:owner>
Dec 06 12:48:31 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:48:31 user nova-compute[75247]:       <nova:ports>
Dec 06 12:48:31 user nova-compute[75247]:         <nova:port uuid="b7c5418b-5afb-45b5-af6c-c46f82ef72cc">
Dec 06 12:48:31 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 06 12:48:31 user nova-compute[75247]:         </nova:port>
Dec 06 12:48:31 user nova-compute[75247]:       </nova:ports>
Dec 06 12:48:31 user nova-compute[75247]:     </nova:instance>
Dec 06 12:48:31 user nova-compute[75247]:   </metadata>
Dec 06 12:48:31 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:48:31 user nova-compute[75247]:     <system>
Dec 06 12:48:31 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:48:31 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:48:31 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:48:31 user nova-compute[75247]:       <entry name="serial">a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a</entry>
Dec 06 12:48:31 user nova-compute[75247]:       <entry name="uuid">a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a</entry>
Dec 06 12:48:31 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:48:31 user nova-compute[75247]:     </system>
Dec 06 12:48:31 user nova-compute[75247]:   </sysinfo>
Dec 06 12:48:31 user nova-compute[75247]:   <os>
Dec 06 12:48:31 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:48:31 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:48:31 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:48:31 user nova-compute[75247]:   </os>
Dec 06 12:48:31 user nova-compute[75247]:   <features>
Dec 06 12:48:31 user nova-compute[75247]:     <acpi/>
Dec 06 12:48:31 user nova-compute[75247]:     <apic/>
Dec 06 12:48:31 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:48:31 user nova-compute[75247]:   </features>
Dec 06 12:48:31 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:48:31 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:48:31 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:48:31 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:48:31 user nova-compute[75247]:   </clock>
Dec 06 12:48:31 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:48:31 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:48:31 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:48:31 user nova-compute[75247]:   </cpu>
Dec 06 12:48:31 user nova-compute[75247]:   <devices>
Dec 06 12:48:31 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:48:31 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:48:31 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk"/>
Dec 06 12:48:31 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:48:31 user nova-compute[75247]:     </disk>
Dec 06 12:48:31 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:48:31 user nova-compute[75247]:       <mac address="fa:16:3e:ae:2f:c5"/>
Dec 06 12:48:31 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:48:31 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:48:31 user nova-compute[75247]:       <target dev="tapb7c5418b-5a"/>
Dec 06 12:48:31 user nova-compute[75247]:     </interface>
Dec 06 12:48:31 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:48:31 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/console.log" append="off"/>
Dec 06 12:48:31 user nova-compute[75247]:     </serial>
Dec 06 12:48:31 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:48:31 user nova-compute[75247]:     <video>
Dec 06 12:48:31 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:48:31 user nova-compute[75247]:     </video>
Dec 06 12:48:31 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:48:31 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:48:31 user nova-compute[75247]:     </rng>
Dec 06 12:48:31 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:48:31 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:48:31 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:48:31 user nova-compute[75247]:     </memballoon>
Dec 06 12:48:31 user nova-compute[75247]:   </devices>
Dec 06 12:48:31 user nova-compute[75247]: </domain>
Dec 06 12:48:31 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.objects.instance [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'trusted_certs' on Instance uuid a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.objects.base [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Object Instance<a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.compute.manager [req-74697c16-2f81-4d46-a6b4-94b0e877a17b req-c77957e9-5bab-4b43-925f-d20f639af37c service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received event network-changed-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.compute.manager [req-74697c16-2f81-4d46-a6b4-94b0e877a17b req-c77957e9-5bab-4b43-925f-d20f639af37c service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Refreshing instance network info cache due to event network-changed-a8d5f682-76a1-4b39-8153-487fe53a127a. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-74697c16-2f81-4d46-a6b4-94b0e877a17b req-c77957e9-5bab-4b43-925f-d20f639af37c service nova] Acquiring lock "refresh_cache-0a86fe94-933a-4e0d-8a65-4834c3d3e40b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-74697c16-2f81-4d46-a6b4-94b0e877a17b req-c77957e9-5bab-4b43-925f-d20f639af37c service nova] Acquired lock "refresh_cache-0a86fe94-933a-4e0d-8a65-4834c3d3e40b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.network.neutron [req-74697c16-2f81-4d46-a6b4-94b0e877a17b req-c77957e9-5bab-4b43-925f-d20f639af37c service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Refreshing network info cache for port a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.180s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Cannot resize image /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:48:31 user nova-compute[75247]: DEBUG nova.objects.instance [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'migration_context' on Instance uuid a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:48:32 user nova-compute[75247]: DEBUG nova.objects.base [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Object Instance<a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:48:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1942005817',display_name='tempest-AttachVolumeTestJSON-server-1942005817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1942005817',id=4,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGz+hJ0HTVL1CpIzjfndN5RB0FYKnfV0muFx2QzLM69CRA62Oly9Vvvkkj6Ccf/qOmS6iQUbmUmx8/zqty8k8DI7l9pqS+f/lxdpJZ0usxBwqzknFRlQwwi6Ig22Eo3VA==',key_name='tempest-keypair-21482804',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:40:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='4f3aeaf6ffdb4cc0807d90e73e92fa7e',ramdisk_id='',reservation_id='r-wenfkxlt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-209684424',owner_user_name='tempest-AttachVolumeTestJSON-209684424-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:46:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cb0e32ba6094d1e8053787bc1979b65',uuid=a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:48:32 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Converting VIF {"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:48:32 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2f:c5,bridge_name='br-int',has_traffic_filtering=True,id=b7c5418b-5afb-45b5-af6c-c46f82ef72cc,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5418b-5a') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:48:32 user nova-compute[75247]: DEBUG os_vif [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2f:c5,bridge_name='br-int',has_traffic_filtering=True,id=b7c5418b-5afb-45b5-af6c-c46f82ef72cc,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5418b-5a') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:48:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:48:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:48:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '19928c8e-ba45-58a2-9df8-574e27ffb82c', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:48:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:48:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7c5418b-5a, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:48:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7c5418b-5a, col_values=(('qos', UUID('44740920-c0ea-49e3-9218-1c4d2d066e23')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:48:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7c5418b-5a, col_values=(('external_ids', {'iface-id': 'b7c5418b-5afb-45b5-af6c-c46f82ef72cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:2f:c5', 'vm-uuid': 'a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:48:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:48:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:32 user nova-compute[75247]: INFO os_vif [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2f:c5,bridge_name='br-int',has_traffic_filtering=True,id=b7c5418b-5afb-45b5-af6c-c46f82ef72cc,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5418b-5a')
Dec 06 12:48:32 user nova-compute[75247]: DEBUG nova.network.neutron [req-74697c16-2f81-4d46-a6b4-94b0e877a17b req-c77957e9-5bab-4b43-925f-d20f639af37c service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Updated VIF entry in instance network info cache for port a8d5f682-76a1-4b39-8153-487fe53a127a. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:48:32 user nova-compute[75247]: DEBUG nova.network.neutron [req-74697c16-2f81-4d46-a6b4-94b0e877a17b req-c77957e9-5bab-4b43-925f-d20f639af37c service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Updating instance_info_cache with network_info: [{"id": "a8d5f682-76a1-4b39-8153-487fe53a127a", "address": "fa:16:3e:a7:11:06", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d5f682-76", "ovs_interfaceid": "a8d5f682-76a1-4b39-8153-487fe53a127a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:48:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-74697c16-2f81-4d46-a6b4-94b0e877a17b req-c77957e9-5bab-4b43-925f-d20f639af37c service nova] Releasing lock "refresh_cache-0a86fe94-933a-4e0d-8a65-4834c3d3e40b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:48:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:33 user nova-compute[75247]: DEBUG nova.compute.manager [req-125473f3-a71a-458f-a656-052c6c96b64a req-775a79d4-3538-4749-b5cf-2bef1a6908e3 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received event network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:48:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-125473f3-a71a-458f-a656-052c6c96b64a req-775a79d4-3538-4749-b5cf-2bef1a6908e3 service nova] Acquiring lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:48:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-125473f3-a71a-458f-a656-052c6c96b64a req-775a79d4-3538-4749-b5cf-2bef1a6908e3 service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:48:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-125473f3-a71a-458f-a656-052c6c96b64a req-775a79d4-3538-4749-b5cf-2bef1a6908e3 service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:48:33 user nova-compute[75247]: DEBUG nova.compute.manager [req-125473f3-a71a-458f-a656-052c6c96b64a req-775a79d4-3538-4749-b5cf-2bef1a6908e3 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] No waiting events found dispatching network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:48:33 user nova-compute[75247]: WARNING nova.compute.manager [req-125473f3-a71a-458f-a656-052c6c96b64a req-775a79d4-3538-4749-b5cf-2bef1a6908e3 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received unexpected event network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc for instance with vm_state stopped and task_state powering-on.
Dec 06 12:48:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:35 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:48:35 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Instance rebooted successfully.
Dec 06 12:48:35 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7c3d8f6d-254b-47e5-9695-4b9779a4d72d tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:48:35 user nova-compute[75247]: DEBUG nova.compute.manager [req-61b15c14-3ee5-4aef-98f9-3c39c1e0bab7 req-c705198b-47d2-4227-bf74-1b3a10dfca9a service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received event network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:48:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-61b15c14-3ee5-4aef-98f9-3c39c1e0bab7 req-c705198b-47d2-4227-bf74-1b3a10dfca9a service nova] Acquiring lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:48:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-61b15c14-3ee5-4aef-98f9-3c39c1e0bab7 req-c705198b-47d2-4227-bf74-1b3a10dfca9a service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:48:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-61b15c14-3ee5-4aef-98f9-3c39c1e0bab7 req-c705198b-47d2-4227-bf74-1b3a10dfca9a service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:48:35 user nova-compute[75247]: DEBUG nova.compute.manager [req-61b15c14-3ee5-4aef-98f9-3c39c1e0bab7 req-c705198b-47d2-4227-bf74-1b3a10dfca9a service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] No waiting events found dispatching network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:48:35 user nova-compute[75247]: WARNING nova.compute.manager [req-61b15c14-3ee5-4aef-98f9-3c39c1e0bab7 req-c705198b-47d2-4227-bf74-1b3a10dfca9a service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received unexpected event network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc for instance with vm_state active and task_state None.
Dec 06 12:48:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:41 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ea75ba22-b4af-4454-93ed-cdfdc76a895b is timed out.
Dec 06 12:48:41 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Successfully detached device vdb from instance ea75ba22-b4af-4454-93ed-cdfdc76a895b from the live domain config.
Dec 06 12:48:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEyJusrd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:48:41 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:48:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bbe911-3f5b-4a40-8cb5-1198cf80735a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:48:41 user nova-compute[75247]: No targets found.
Dec 06 12:48:41 user nova-compute[75247]: iSNS:
Dec 06 12:48:41 user nova-compute[75247]: No targets found.
Dec 06 12:48:41 user nova-compute[75247]: STATIC:
Dec 06 12:48:41 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:48:41 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:48:41 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:48:41 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92
Dec 06 12:48:41 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:48:41 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:48:41 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732
Dec 06 12:48:41 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:48:41 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:48:41 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db
Dec 06 12:48:41 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:48:41 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:48:41 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579
Dec 06 12:48:41 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:48:41 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:48:41 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251
Dec 06 12:48:41 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:48:41 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:48:41 user nova-compute[75247]: FIRMWARE:
Dec 06 12:48:41 user nova-compute[75247]: No targets found.
Dec 06 12:48:41 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:48:41 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:48:41 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[64304e95-59c0-4838-8188-f307bc046044]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0128542b-f6be-4859-914c-a4908d3b0c58]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:48:41 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:48:41 user nova-compute[75247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:48:41 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:48:41 user nova-compute[75247]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 (non-flash)
Dec 06 12:48:41 user nova-compute[75247]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 (non-flash)
Dec 06 12:48:41 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:48:41 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:48:41 user nova-compute[75247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:48:41 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:48:41 user nova-compute[75247]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 (non-flash)
Dec 06 12:48:41 user nova-compute[75247]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 (non-flash)
Dec 06 12:48:41 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd7307e2dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251'): ({'sdc'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Removing single pathed devices sdc {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.123s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72881ad-a3de-4e11-bea5-07c38b417a1d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfa12f3-2675-413f-9799-29780f376a4e]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Flushing IO for device /dev/sdc {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[60054b61-4426-4543-8b07-7a16836f03e8]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e29c56-e668-49db-a63d-31423a2306d5]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] SCSI volumes sdc have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ced66db-be9b-4f7f-b2e7-0e7c32326246]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1169c11b-3b95-4c0e-b860-47331de5e0a7]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251, portal: 172.16.0.220,3260]
Dec 06 12:48:41 user nova-compute[75247]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251, portal: 172.16.0.220,3260] successful.
Dec 06 12:48:41 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec803e33-a7d5-4e87-bee6-9deea4f57251 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5168eb71-6181-4381-82f4-988676605297]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.487s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] <== disconnect_volume: return (489ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:48:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:48:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:42 user nova-compute[75247]: DEBUG nova.objects.instance [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lazy-loading 'flavor' on Instance uuid ea75ba22-b4af-4454-93ed-cdfdc76a895b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:48:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-47d2edec-1125-4d7f-b5c3-e1e6b6257e29 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.062s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:48:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:48:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:48:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:48:48 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:48:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:48:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:48:48 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:48:48 user nova-compute[75247]: INFO nova.compute.claims [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Claim successful on node user
Dec 06 12:48:49 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:48:49 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:48:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:48:49 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:48:49 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:48:49 user nova-compute[75247]: DEBUG nova.network.neutron [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:48:49 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:48:49 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:48:49 user nova-compute[75247]: DEBUG nova.policy [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0efa55fc4754d96a33d07d52342d8f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222da79e3583495d90d5442029996343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:48:49 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:48:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:48:49 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Creating image(s)
Dec 06 12:48:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "/opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:48:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "/opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:48:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "/opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:48:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.184s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:48:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:48:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.231s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk 1073741824" returned: 0 in 0.052s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:48:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:50 user nova-compute[75247]: DEBUG nova.network.neutron [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Successfully created port: 6ed7f42b-d2d5-4663-8943-e016c1acfe5c {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:48:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.214s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:50 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:48:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:50 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Cannot resize image /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:48:50 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:48:50 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Ensure instance console log exists: /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:48:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:48:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:48:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.network.neutron [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Successfully updated port: 6ed7f42b-d2d5-4663-8943-e016c1acfe5c {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "refresh_cache-08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquired lock "refresh_cache-08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.network.neutron [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:48:51 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0a86fe94-933a-4e0d-8a65-4834c3d3e40b is timed out.
Dec 06 12:48:51 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Successfully detached device vdb from instance 0a86fe94-933a-4e0d-8a65-4834c3d3e40b from the live domain config.
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.compute.manager [req-f9dd2761-735b-4f95-b30e-14c47529f8fc req-552cd9ae-3339-4891-827a-e7780e0ab65b service nova] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Received event network-changed-6ed7f42b-d2d5-4663-8943-e016c1acfe5c {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.compute.manager [req-f9dd2761-735b-4f95-b30e-14c47529f8fc req-552cd9ae-3339-4891-827a-e7780e0ab65b service nova] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Refreshing instance network info cache due to event network-changed-6ed7f42b-d2d5-4663-8943-e016c1acfe5c. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f9dd2761-735b-4f95-b30e-14c47529f8fc req-552cd9ae-3339-4891-827a-e7780e0ab65b service nova] Acquiring lock "refresh_cache-08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBzldZOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:48:51 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:48:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.network.neutron [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f934ae39-64cf-4240-bf24-7b25ddef3178]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:48:51 user nova-compute[75247]: No targets found.
Dec 06 12:48:51 user nova-compute[75247]: iSNS:
Dec 06 12:48:51 user nova-compute[75247]: No targets found.
Dec 06 12:48:51 user nova-compute[75247]: STATIC:
Dec 06 12:48:51 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:48:51 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:48:51 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:48:51 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92
Dec 06 12:48:51 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:48:51 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:48:51 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732
Dec 06 12:48:51 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:48:51 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:48:51 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db
Dec 06 12:48:51 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:48:51 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:48:51 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579
Dec 06 12:48:51 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:48:51 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:48:51 user nova-compute[75247]: FIRMWARE:
Dec 06 12:48:51 user nova-compute[75247]: No targets found.
Dec 06 12:48:51 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:48:51 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:48:51 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb7699c-e1bb-4193-864d-401623c7531f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d8b692-6fc9-4482-b105-38e312a6021d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:48:51 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:48:51 user nova-compute[75247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:48:51 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:48:51 user nova-compute[75247]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 (non-flash)
Dec 06 12:48:51 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:48:51 user nova-compute[75247]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 (non-flash)
Dec 06 12:48:51 user nova-compute[75247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:48:51 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:48:51 user nova-compute[75247]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 (non-flash)
Dec 06 12:48:51 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd7302f7be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92'): ({'sdb'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Removing single pathed devices sdb {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ace84d5-c029-4042-9540-2083bf506288]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b55f9ce-0426-43ee-bc9d-a882b97c806a]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Flushing IO for device /dev/sdb {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[98eeeeae-05a7-4a3f-8a74-7f8b8e3834d9]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f13687-871c-4404-919e-773a5dcb2e5a]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[311108cd-a176-4c4f-bedf-a000ea99db98]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.network.neutron [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Updating instance_info_cache with network_info: [{"id": "6ed7f42b-d2d5-4663-8943-e016c1acfe5c", "address": "fa:16:3e:30:47:63", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed7f42b-d2", "ovs_interfaceid": "6ed7f42b-d2d5-4663-8943-e016c1acfe5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d6bd01-188a-4df5-a3c9-d77d5fdc9933]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92, portal: 172.16.0.220,3260]
Dec 06 12:48:51 user nova-compute[75247]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92, portal: 172.16.0.220,3260] successful.
Dec 06 12:48:51 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Releasing lock "refresh_cache-08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Instance network_info: |[{"id": "6ed7f42b-d2d5-4663-8943-e016c1acfe5c", "address": "fa:16:3e:30:47:63", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed7f42b-d2", "ovs_interfaceid": "6ed7f42b-d2d5-4663-8943-e016c1acfe5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f9dd2761-735b-4f95-b30e-14c47529f8fc req-552cd9ae-3339-4891-827a-e7780e0ab65b service nova] Acquired lock "refresh_cache-08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.network.neutron [req-f9dd2761-735b-4f95-b30e-14c47529f8fc req-552cd9ae-3339-4891-827a-e7780e0ab65b service nova] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Refreshing network info cache for port 6ed7f42b-d2d5-4663-8943-e016c1acfe5c {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Start _get_guest_xml network_info=[{"id": "6ed7f42b-d2d5-4663-8943-e016c1acfe5c", "address": "fa:16:3e:30:47:63", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed7f42b-d2", "ovs_interfaceid": "6ed7f42b-d2d5-4663-8943-e016c1acfe5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3c81dcf-076d-4330-aecd-a47fd48c4d92 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[33224dea-a314-4291-a829-2b2acd8f9ece]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] <== disconnect_volume: return (369ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:48:51 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:48:51 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1325546850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1325546850',id=23,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='222da79e3583495d90d5442029996343',ramdisk_id='',reservation_id='r-9cv0o6lv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:48:50Z,user_data=None,user_id='d0efa55fc4754d96a33d07d52342d8f7',uuid=08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ed7f42b-d2d5-4663-8943-e016c1acfe5c", "address": "fa:16:3e:30:47:63", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed7f42b-d2", "ovs_interfaceid": "6ed7f42b-d2d5-4663-8943-e016c1acfe5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converting VIF {"id": "6ed7f42b-d2d5-4663-8943-e016c1acfe5c", "address": "fa:16:3e:30:47:63", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed7f42b-d2", "ovs_interfaceid": "6ed7f42b-d2d5-4663-8943-e016c1acfe5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:47:63,bridge_name='br-int',has_traffic_filtering=True,id=6ed7f42b-d2d5-4663-8943-e016c1acfe5c,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed7f42b-d2') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.objects.instance [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lazy-loading 'pci_devices' on Instance uuid 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:48:51 user nova-compute[75247]:   <uuid>08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9</uuid>
Dec 06 12:48:51 user nova-compute[75247]:   <name>instance-00000017</name>
Dec 06 12:48:51 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:48:51 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:48:51 user nova-compute[75247]:   <metadata>
Dec 06 12:48:51 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:48:51 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:48:51 user nova-compute[75247]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1325546850</nova:name>
Dec 06 12:48:51 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:48:51</nova:creationTime>
Dec 06 12:48:51 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:48:51 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:48:51 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:48:51 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:48:51 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:48:51 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:48:51 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:48:51 user nova-compute[75247]:       <nova:owner>
Dec 06 12:48:51 user nova-compute[75247]:         <nova:user uuid="d0efa55fc4754d96a33d07d52342d8f7">tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member</nova:user>
Dec 06 12:48:51 user nova-compute[75247]:         <nova:project uuid="222da79e3583495d90d5442029996343">tempest-ServerBootFromVolumeStableRescueTest-1200643969</nova:project>
Dec 06 12:48:51 user nova-compute[75247]:       </nova:owner>
Dec 06 12:48:51 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:48:51 user nova-compute[75247]:       <nova:ports>
Dec 06 12:48:51 user nova-compute[75247]:         <nova:port uuid="6ed7f42b-d2d5-4663-8943-e016c1acfe5c">
Dec 06 12:48:51 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 06 12:48:51 user nova-compute[75247]:         </nova:port>
Dec 06 12:48:51 user nova-compute[75247]:       </nova:ports>
Dec 06 12:48:51 user nova-compute[75247]:     </nova:instance>
Dec 06 12:48:51 user nova-compute[75247]:   </metadata>
Dec 06 12:48:51 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:48:51 user nova-compute[75247]:     <system>
Dec 06 12:48:51 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:48:51 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:48:51 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:48:51 user nova-compute[75247]:       <entry name="serial">08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9</entry>
Dec 06 12:48:51 user nova-compute[75247]:       <entry name="uuid">08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9</entry>
Dec 06 12:48:51 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:48:51 user nova-compute[75247]:     </system>
Dec 06 12:48:51 user nova-compute[75247]:   </sysinfo>
Dec 06 12:48:51 user nova-compute[75247]:   <os>
Dec 06 12:48:51 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:48:51 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:48:51 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:48:51 user nova-compute[75247]:   </os>
Dec 06 12:48:51 user nova-compute[75247]:   <features>
Dec 06 12:48:51 user nova-compute[75247]:     <acpi/>
Dec 06 12:48:51 user nova-compute[75247]:     <apic/>
Dec 06 12:48:51 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:48:51 user nova-compute[75247]:   </features>
Dec 06 12:48:51 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:48:51 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:48:51 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:48:51 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:48:51 user nova-compute[75247]:   </clock>
Dec 06 12:48:51 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:48:51 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:48:51 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:48:51 user nova-compute[75247]:   </cpu>
Dec 06 12:48:51 user nova-compute[75247]:   <devices>
Dec 06 12:48:51 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:48:51 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:48:51 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk"/>
Dec 06 12:48:51 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:48:51 user nova-compute[75247]:     </disk>
Dec 06 12:48:51 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:48:51 user nova-compute[75247]:       <mac address="fa:16:3e:30:47:63"/>
Dec 06 12:48:51 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:48:51 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:48:51 user nova-compute[75247]:       <target dev="tap6ed7f42b-d2"/>
Dec 06 12:48:51 user nova-compute[75247]:     </interface>
Dec 06 12:48:51 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:48:51 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/console.log" append="off"/>
Dec 06 12:48:51 user nova-compute[75247]:     </serial>
Dec 06 12:48:51 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:48:51 user nova-compute[75247]:     <video>
Dec 06 12:48:51 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:48:51 user nova-compute[75247]:     </video>
Dec 06 12:48:51 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:48:51 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:48:51 user nova-compute[75247]:     </rng>
Dec 06 12:48:51 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:48:51 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:48:51 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:48:51 user nova-compute[75247]:     </memballoon>
Dec 06 12:48:51 user nova-compute[75247]:   </devices>
Dec 06 12:48:51 user nova-compute[75247]: </domain>
Dec 06 12:48:51 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1325546850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1325546850',id=23,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='222da79e3583495d90d5442029996343',ramdisk_id='',reservation_id='r-9cv0o6lv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:48:50Z,user_data=None,user_id='d0efa55fc4754d96a33d07d52342d8f7',uuid=08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ed7f42b-d2d5-4663-8943-e016c1acfe5c", "address": "fa:16:3e:30:47:63", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed7f42b-d2", "ovs_interfaceid": "6ed7f42b-d2d5-4663-8943-e016c1acfe5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converting VIF {"id": "6ed7f42b-d2d5-4663-8943-e016c1acfe5c", "address": "fa:16:3e:30:47:63", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed7f42b-d2", "ovs_interfaceid": "6ed7f42b-d2d5-4663-8943-e016c1acfe5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:47:63,bridge_name='br-int',has_traffic_filtering=True,id=6ed7f42b-d2d5-4663-8943-e016c1acfe5c,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed7f42b-d2') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG os_vif [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:47:63,bridge_name='br-int',has_traffic_filtering=True,id=6ed7f42b-d2d5-4663-8943-e016c1acfe5c,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed7f42b-d2') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15d3a0eb-3ccd-50d3-99a6-322e4f2820e8', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ed7f42b-d2, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ed7f42b-d2, col_values=(('qos', UUID('7cfbe178-d207-4ebd-8893-039dc345a51b')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ed7f42b-d2, col_values=(('external_ids', {'iface-id': '6ed7f42b-d2d5-4663-8943-e016c1acfe5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:47:63', 'vm-uuid': '08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:51 user nova-compute[75247]: INFO os_vif [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:47:63,bridge_name='br-int',has_traffic_filtering=True,id=6ed7f42b-d2d5-4663-8943-e016c1acfe5c,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed7f42b-d2')
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:48:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] No VIF found with MAC fa:16:3e:30:47:63, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:48:52 user nova-compute[75247]: DEBUG nova.network.neutron [req-f9dd2761-735b-4f95-b30e-14c47529f8fc req-552cd9ae-3339-4891-827a-e7780e0ab65b service nova] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Updated VIF entry in instance network info cache for port 6ed7f42b-d2d5-4663-8943-e016c1acfe5c. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:48:52 user nova-compute[75247]: DEBUG nova.network.neutron [req-f9dd2761-735b-4f95-b30e-14c47529f8fc req-552cd9ae-3339-4891-827a-e7780e0ab65b service nova] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Updating instance_info_cache with network_info: [{"id": "6ed7f42b-d2d5-4663-8943-e016c1acfe5c", "address": "fa:16:3e:30:47:63", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed7f42b-d2", "ovs_interfaceid": "6ed7f42b-d2d5-4663-8943-e016c1acfe5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:48:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f9dd2761-735b-4f95-b30e-14c47529f8fc req-552cd9ae-3339-4891-827a-e7780e0ab65b service nova] Releasing lock "refresh_cache-08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:48:52 user nova-compute[75247]: DEBUG nova.compute.manager [req-63bab5b7-480e-4a2c-86bf-b55ff97fb9b6 req-e89b2da6-1b66-40d4-b307-3e3f23e2d28e service nova] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Received event network-changed-23d45868-6be3-4f57-8579-243f11b02597 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:48:52 user nova-compute[75247]: DEBUG nova.compute.manager [req-63bab5b7-480e-4a2c-86bf-b55ff97fb9b6 req-e89b2da6-1b66-40d4-b307-3e3f23e2d28e service nova] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Refreshing instance network info cache due to event network-changed-23d45868-6be3-4f57-8579-243f11b02597. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:48:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-63bab5b7-480e-4a2c-86bf-b55ff97fb9b6 req-e89b2da6-1b66-40d4-b307-3e3f23e2d28e service nova] Acquiring lock "refresh_cache-a7113836-350f-4ef2-a64e-418c34e2446f" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:48:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-63bab5b7-480e-4a2c-86bf-b55ff97fb9b6 req-e89b2da6-1b66-40d4-b307-3e3f23e2d28e service nova] Acquired lock "refresh_cache-a7113836-350f-4ef2-a64e-418c34e2446f" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:48:52 user nova-compute[75247]: DEBUG nova.network.neutron [req-63bab5b7-480e-4a2c-86bf-b55ff97fb9b6 req-e89b2da6-1b66-40d4-b307-3e3f23e2d28e service nova] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Refreshing network info cache for port 23d45868-6be3-4f57-8579-243f11b02597 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:48:52 user nova-compute[75247]: DEBUG nova.objects.instance [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lazy-loading 'flavor' on Instance uuid 0a86fe94-933a-4e0d-8a65-4834c3d3e40b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:48:52 user nova-compute[75247]: DEBUG nova.network.neutron [req-63bab5b7-480e-4a2c-86bf-b55ff97fb9b6 req-e89b2da6-1b66-40d4-b307-3e3f23e2d28e service nova] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Updated VIF entry in instance network info cache for port 23d45868-6be3-4f57-8579-243f11b02597. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:48:52 user nova-compute[75247]: DEBUG nova.network.neutron [req-63bab5b7-480e-4a2c-86bf-b55ff97fb9b6 req-e89b2da6-1b66-40d4-b307-3e3f23e2d28e service nova] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Updating instance_info_cache with network_info: [{"id": "23d45868-6be3-4f57-8579-243f11b02597", "address": "fa:16:3e:44:69:6b", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d45868-6b", "ovs_interfaceid": "23d45868-6be3-4f57-8579-243f11b02597", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:48:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ae85f3f9-474a-46be-a816-d380785deeac tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.246s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:48:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-63bab5b7-480e-4a2c-86bf-b55ff97fb9b6 req-e89b2da6-1b66-40d4-b307-3e3f23e2d28e service nova] Releasing lock "refresh_cache-a7113836-350f-4ef2-a64e-418c34e2446f" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:48:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "97d1f646-bc64-40e2-9418-c89a87473640" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:48:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "97d1f646-bc64-40e2-9418-c89a87473640" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:48:54 user nova-compute[75247]: INFO nova.compute.manager [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Detaching volume 8cced015-e2df-4f38-ba42-6c2c09257732
Dec 06 12:48:54 user nova-compute[75247]: INFO nova.virt.block_device [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Attempting to driver detach volume 8cced015-e2df-4f38-ba42-6c2c09257732 from mountpoint /dev/vdb
Dec 06 12:48:54 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Attempting to detach device vdb from instance 97d1f646-bc64-40e2-9418-c89a87473640 from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 12:48:54 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:48:54 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:48:54 user nova-compute[75247]:   <source dev="/dev/sdf"/>
Dec 06 12:48:54 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:48:54 user nova-compute[75247]:   <serial>8cced015-e2df-4f38-ba42-6c2c09257732</serial>
Dec 06 12:48:54 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:48:54 user nova-compute[75247]: </disk>
Dec 06 12:48:54 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:48:54 user nova-compute[75247]: DEBUG nova.compute.manager [req-15d5812b-1fd8-414c-b83f-ad75d7bc5a59 req-341d163d-ae63-4db9-bdf6-60f623fc54fc service nova] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Received event network-vif-plugged-6ed7f42b-d2d5-4663-8943-e016c1acfe5c {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:48:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-15d5812b-1fd8-414c-b83f-ad75d7bc5a59 req-341d163d-ae63-4db9-bdf6-60f623fc54fc service nova] Acquiring lock "08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:48:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-15d5812b-1fd8-414c-b83f-ad75d7bc5a59 req-341d163d-ae63-4db9-bdf6-60f623fc54fc service nova] Lock "08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:48:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-15d5812b-1fd8-414c-b83f-ad75d7bc5a59 req-341d163d-ae63-4db9-bdf6-60f623fc54fc service nova] Lock "08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:48:54 user nova-compute[75247]: DEBUG nova.compute.manager [req-15d5812b-1fd8-414c-b83f-ad75d7bc5a59 req-341d163d-ae63-4db9-bdf6-60f623fc54fc service nova] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] No waiting events found dispatching network-vif-plugged-6ed7f42b-d2d5-4663-8943-e016c1acfe5c {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:48:54 user nova-compute[75247]: WARNING nova.compute.manager [req-15d5812b-1fd8-414c-b83f-ad75d7bc5a59 req-341d163d-ae63-4db9-bdf6-60f623fc54fc service nova] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Received unexpected event network-vif-plugged-6ed7f42b-d2d5-4663-8943-e016c1acfe5c for instance with vm_state building and task_state spawning.
Dec 06 12:48:54 user nova-compute[75247]: DEBUG nova.compute.manager [req-15d5812b-1fd8-414c-b83f-ad75d7bc5a59 req-341d163d-ae63-4db9-bdf6-60f623fc54fc service nova] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Received event network-vif-plugged-6ed7f42b-d2d5-4663-8943-e016c1acfe5c {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:48:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-15d5812b-1fd8-414c-b83f-ad75d7bc5a59 req-341d163d-ae63-4db9-bdf6-60f623fc54fc service nova] Acquiring lock "08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:48:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-15d5812b-1fd8-414c-b83f-ad75d7bc5a59 req-341d163d-ae63-4db9-bdf6-60f623fc54fc service nova] Lock "08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:48:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-15d5812b-1fd8-414c-b83f-ad75d7bc5a59 req-341d163d-ae63-4db9-bdf6-60f623fc54fc service nova] Lock "08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:48:54 user nova-compute[75247]: DEBUG nova.compute.manager [req-15d5812b-1fd8-414c-b83f-ad75d7bc5a59 req-341d163d-ae63-4db9-bdf6-60f623fc54fc service nova] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] No waiting events found dispatching network-vif-plugged-6ed7f42b-d2d5-4663-8943-e016c1acfe5c {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:48:54 user nova-compute[75247]: WARNING nova.compute.manager [req-15d5812b-1fd8-414c-b83f-ad75d7bc5a59 req-341d163d-ae63-4db9-bdf6-60f623fc54fc service nova] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Received unexpected event network-vif-plugged-6ed7f42b-d2d5-4663-8943-e016c1acfe5c for instance with vm_state building and task_state spawning.
Dec 06 12:48:54 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Successfully detached device vdb from instance 97d1f646-bc64-40e2-9418-c89a87473640 from the persistent domain config.
Dec 06 12:48:54 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 97d1f646-bc64-40e2-9418-c89a87473640 from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 12:48:54 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:48:54 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:48:54 user nova-compute[75247]:   <source dev="/dev/sdf"/>
Dec 06 12:48:54 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:48:54 user nova-compute[75247]:   <serial>8cced015-e2df-4f38-ba42-6c2c09257732</serial>
Dec 06 12:48:54 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:48:54 user nova-compute[75247]: </disk>
Dec 06 12:48:54 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:48:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "97d1f646-bc64-40e2-9418-c89a87473640" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:48:54 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 97d1f646-bc64-40e2-9418-c89a87473640 {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 12:48:55 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:48:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:48:55 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Instance spawned successfully.
Dec 06 12:48:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:48:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:48:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:48:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:48:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:48:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:48:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:48:55 user nova-compute[75247]: INFO nova.compute.manager [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Took 6.08 seconds to spawn the instance on the hypervisor.
Dec 06 12:48:55 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:48:55 user nova-compute[75247]: INFO nova.compute.manager [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Took 7.02 seconds to build instance.
Dec 06 12:48:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f7e84558-2e1a-4b62-9077-7aa16d905314 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.140s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "a7113836-350f-4ef2-a64e-418c34e2446f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "a7113836-350f-4ef2-a64e-418c34e2446f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG nova.objects.instance [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lazy-loading 'flavor' on Instance uuid a7113836-350f-4ef2-a64e-418c34e2446f {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "a7113836-350f-4ef2-a64e-418c34e2446f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "a7113836-350f-4ef2-a64e-418c34e2446f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "a7113836-350f-4ef2-a64e-418c34e2446f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:48:56 user nova-compute[75247]: INFO nova.compute.manager [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Attaching volume e78a51d4-9cef-471f-8af7-22504a7e913a to /dev/vdb
Dec 06 12:48:56 user nova-compute[75247]: DEBUG os_brick.utils [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e236a979-82aa-4a62-be39-2c9749ec340b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba40d6e-c191-43f8-aeef-5ad5d29da837]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3a4bc2-5bfb-41d4-911d-200d58992c62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fa3ac1-650d-406d-bbf1-a17a45712968]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:48:56 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:48:56 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[16aaeb54-d0b0-4b1f-bdfb-a6a55ec453a2]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG os_brick.utils [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Updating existing volume attachment record: b3bdd4eb-efe4-4d47-b68d-9041cac94f68 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:48:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:48:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:03 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:49:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "4531bf11-b948-4d57-bf55-f33563815e26" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "4531bf11-b948-4d57-bf55-f33563815e26" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "4531bf11-b948-4d57-bf55-f33563815e26-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:05 user nova-compute[75247]: INFO nova.compute.manager [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Terminating instance
Dec 06 12:49:05 user nova-compute[75247]: DEBUG nova.compute.manager [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:49:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG nova.compute.manager [req-6a40afbe-5baf-4ebd-aa23-9831839b8b1d req-949b3a6a-e80b-4365-a3c4-65726b339fab service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received event network-vif-unplugged-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6a40afbe-5baf-4ebd-aa23-9831839b8b1d req-949b3a6a-e80b-4365-a3c4-65726b339fab service nova] Acquiring lock "4531bf11-b948-4d57-bf55-f33563815e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6a40afbe-5baf-4ebd-aa23-9831839b8b1d req-949b3a6a-e80b-4365-a3c4-65726b339fab service nova] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6a40afbe-5baf-4ebd-aa23-9831839b8b1d req-949b3a6a-e80b-4365-a3c4-65726b339fab service nova] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG nova.compute.manager [req-6a40afbe-5baf-4ebd-aa23-9831839b8b1d req-949b3a6a-e80b-4365-a3c4-65726b339fab service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] No waiting events found dispatching network-vif-unplugged-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG nova.compute.manager [req-6a40afbe-5baf-4ebd-aa23-9831839b8b1d req-949b3a6a-e80b-4365-a3c4-65726b339fab service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received event network-vif-unplugged-348d8e54-a814-4893-8636-de9e795794a2 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:49:06 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Instance destroyed successfully.
Dec 06 12:49:06 user nova-compute[75247]: DEBUG nova.objects.instance [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lazy-loading 'resources' on Instance uuid 4531bf11-b948-4d57-bf55-f33563815e26 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1307258181',display_name='tempest-ServerActionsTestOtherB-server-1307258181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1307258181',id=5,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXd4LdKL4pG7XKtcC6TX8wMNmPTD7z6hx6EQTzh/vLbbeocUHdpJ42qGTjwVyD4AThWLqebjjgjZMtQsvJgysEhbuskpjq8ZyizdS/bi/KghYHYkKPwpNCJccaNThNvgg==',key_name='tempest-keypair-1971386181',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:46:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57ba4e5fa37f4fd29d6712069230d3e6',ramdisk_id='',reservation_id='r-wbn2uy0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-472154126',owner_user_name='tempest-ServerActionsTestOtherB-472154126-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:46:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd4165666a1426aa1134c2889214b0f',uuid=4531bf11-b948-4d57-bf55-f33563815e26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Converting VIF {"id": "348d8e54-a814-4893-8636-de9e795794a2", "address": "fa:16:3e:7d:fe:f6", "network": {"id": "7d8127bc-30f6-40e2-9bd3-2054440440d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124684059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57ba4e5fa37f4fd29d6712069230d3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348d8e54-a8", "ovs_interfaceid": "348d8e54-a814-4893-8636-de9e795794a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=348d8e54-a814-4893-8636-de9e795794a2,network=Network(7d8127bc-30f6-40e2-9bd3-2054440440d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348d8e54-a8') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG os_vif [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=348d8e54-a814-4893-8636-de9e795794a2,network=Network(7d8127bc-30f6-40e2-9bd3-2054440440d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348d8e54-a8') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap348d8e54-a8, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40b47a7a-37c1-4d0a-ac8b-fffd356675e1) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:49:06 user nova-compute[75247]: INFO os_vif [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=348d8e54-a814-4893-8636-de9e795794a2,network=Network(7d8127bc-30f6-40e2-9bd3-2054440440d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348d8e54-a8')
Dec 06 12:49:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YiAyasdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:49:06 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:49:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[18636719-84af-40ef-b6a0-dd51ddc43d23]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:49:06 user nova-compute[75247]: No targets found.
Dec 06 12:49:06 user nova-compute[75247]: iSNS:
Dec 06 12:49:06 user nova-compute[75247]: No targets found.
Dec 06 12:49:06 user nova-compute[75247]: STATIC:
Dec 06 12:49:06 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:49:06 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:49:06 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:49:06 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732
Dec 06 12:49:06 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:49:06 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:49:06 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db
Dec 06 12:49:06 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:49:06 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:49:06 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579
Dec 06 12:49:06 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:49:06 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:49:06 user nova-compute[75247]: FIRMWARE:
Dec 06 12:49:06 user nova-compute[75247]: No targets found.
Dec 06 12:49:06 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:49:06 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:49:06 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e44562-91a9-41b4-91ca-c33f0bc04432]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[77598578-9190-4481-82b4-bad8f6e91084]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:49:06 user nova-compute[75247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:49:06 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:49:06 user nova-compute[75247]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 (non-flash)
Dec 06 12:49:06 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:49:06 user nova-compute[75247]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db (non-flash)
Dec 06 12:49:06 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:49:06 user nova-compute[75247]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 (non-flash)
Dec 06 12:49:06 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd7304cf370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db'): ({'sde'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Removing single pathed devices sde {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05d81c9-0a3a-474d-bd08-f6ea1467da78]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43eb07d-95cc-4f13-a5f6-5037153fc31e]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Flushing IO for device /dev/sde {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[95426e02-c5f0-4bb2-a38d-f56adcca3e88]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e868258-2ce1-45e7-871a-934559dda15a]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] SCSI volumes sde have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5c6bd2-0423-46a4-8075-dcf23e1bc270]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10f8225-bc3f-477b-bcf2-f52f9a7fab80]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db, portal: 172.16.0.220,3260]
Dec 06 12:49:06 user nova-compute[75247]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db, portal: 172.16.0.220,3260] successful.
Dec 06 12:49:06 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6492a8c0-e442-4b99-867a-e95fa38234db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf972e75-f300-4d7f-a081-3de1753e2e07]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] <== disconnect_volume: return (339ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:49:07 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Deleting instance files /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26_del
Dec 06 12:49:07 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Deletion of /opt/stack/data/nova/instances/4531bf11-b948-4d57-bf55-f33563815e26_del complete
Dec 06 12:49:07 user nova-compute[75247]: INFO nova.compute.manager [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Took 1.43 seconds to destroy the instance on the hypervisor.
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FIvwdrzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:49:07 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:49:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:49:07 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:49:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:49:07 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a4a9af-1bfd-43c6-9617-f99ea53a8259]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:49:07 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36f24fa-3ed0-49bc-8c2f-36ed10a914a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a] added
Dec 06 12:49:07 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f407840e-57b4-4f4c-b238-f094f3872ed5]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.086s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b569ef-3fb4-42d5-8245-4f4310bd6829]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FIvwdrzc {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FIvwdrzc" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac7b628-48c0-4241-85ec-09b594f52eb8]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FIvwdrzc'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd480d18-d1ba-451f-b638-524251a6cf92]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[614d90ba-b1c5-45f2-b4b0-d9add07a3f04]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:49:07 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:49:07 user nova-compute[75247]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 (non-flash)
Dec 06 12:49:07 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:49:07 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:49:07 user nova-compute[75247]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 (non-flash)
Dec 06 12:49:07 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3119016d-4a7d-44ba-b7ab-9f049be5d16b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a, portal: 172.16.0.220,3260]
Dec 06 12:49:07 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a, portal: 172.16.0.220,3260] successful.
Dec 06 12:49:07 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cafdad-3fb1-4859-8bfe-0b7d410200b8]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[743ac2e8-0dc8-4d3e-84e4-d9e07fbd5c8b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:49:07 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:49:07 user nova-compute[75247]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 (non-flash)
Dec 06 12:49:07 user nova-compute[75247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a (non-flash)
Dec 06 12:49:07 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:49:07 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:49:07 user nova-compute[75247]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 (non-flash)
Dec 06 12:49:07 user nova-compute[75247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a (non-flash)
Dec 06 12:49:07 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.407s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7256bef8-f192-4b8e-a353-1de20c72401e]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FIvwdrzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:49:07 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:49:08 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:49:08 user nova-compute[75247]: DEBUG nova.compute.manager [req-d87a5682-3780-4105-bfad-2d9d0cb0a9b2 req-866bb362-6172-4d78-84b6-c5b756bf63f5 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received event network-vif-deleted-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:49:08 user nova-compute[75247]: INFO nova.compute.manager [req-d87a5682-3780-4105-bfad-2d9d0cb0a9b2 req-866bb362-6172-4d78-84b6-c5b756bf63f5 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Neutron deleted interface 348d8e54-a814-4893-8636-de9e795794a2; detaching it from the instance and deleting it from the info cache
Dec 06 12:49:08 user nova-compute[75247]: DEBUG nova.network.neutron [req-d87a5682-3780-4105-bfad-2d9d0cb0a9b2 req-866bb362-6172-4d78-84b6-c5b756bf63f5 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:49:08 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Took 1.01 seconds to deallocate network for instance.
Dec 06 12:49:08 user nova-compute[75247]: DEBUG nova.compute.manager [req-d87a5682-3780-4105-bfad-2d9d0cb0a9b2 req-866bb362-6172-4d78-84b6-c5b756bf63f5 service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Detach interface failed, port_id=348d8e54-a814-4893-8636-de9e795794a2, reason: Instance 4531bf11-b948-4d57-bf55-f33563815e26 could not be found. {{(pid=75247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 12:49:08 user nova-compute[75247]: DEBUG nova.compute.manager [req-a7381af3-9170-4ce8-91f4-82a72431cf3b req-e106adad-f3f7-4cd6-919a-b56f1d9fbfda service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received event network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:49:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a7381af3-9170-4ce8-91f4-82a72431cf3b req-e106adad-f3f7-4cd6-919a-b56f1d9fbfda service nova] Acquiring lock "4531bf11-b948-4d57-bf55-f33563815e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a7381af3-9170-4ce8-91f4-82a72431cf3b req-e106adad-f3f7-4cd6-919a-b56f1d9fbfda service nova] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a7381af3-9170-4ce8-91f4-82a72431cf3b req-e106adad-f3f7-4cd6-919a-b56f1d9fbfda service nova] Lock "4531bf11-b948-4d57-bf55-f33563815e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:08 user nova-compute[75247]: DEBUG nova.compute.manager [req-a7381af3-9170-4ce8-91f4-82a72431cf3b req-e106adad-f3f7-4cd6-919a-b56f1d9fbfda service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] No waiting events found dispatching network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:49:08 user nova-compute[75247]: WARNING nova.compute.manager [req-a7381af3-9170-4ce8-91f4-82a72431cf3b req-e106adad-f3f7-4cd6-919a-b56f1d9fbfda service nova] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Received unexpected event network-vif-plugged-348d8e54-a814-4893-8636-de9e795794a2 for instance with vm_state active and task_state deleting.
Dec 06 12:49:08 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.441s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:49:08 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '23934626337383135', 'path': '/dev/sdb'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:49:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934626337383135', 'path': '/dev/sdb'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:49:08 user nova-compute[75247]: DEBUG nova.objects.instance [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lazy-loading 'flavor' on Instance uuid a7113836-350f-4ef2-a64e-418c34e2446f {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:49:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 12:49:08 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:49:08 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:49:08 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:49:08 user nova-compute[75247]:   <serial>e78a51d4-9cef-471f-8af7-22504a7e913a</serial>
Dec 06 12:49:08 user nova-compute[75247]: </disk>
Dec 06 12:49:08 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 12:49:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:09 user nova-compute[75247]: INFO nova.compute.manager [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] [instance: 4531bf11-b948-4d57-bf55-f33563815e26] Took 1.05 seconds to detach 1 volumes for instance.
Dec 06 12:49:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:49:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:49:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] No VIF found with MAC fa:16:3e:44:69:6b, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:49:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ba03bf7-4b79-46c4-9ebe-f42847430bc2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "a7113836-350f-4ef2-a64e-418c34e2446f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.276s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:09 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:49:09 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:49:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.572s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:09 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:49:09 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Deleted allocations for instance 4531bf11-b948-4d57-bf55-f33563815e26
Dec 06 12:49:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3c91548a-8d58-4c8d-aae1-4d9471f1c8cd tempest-ServerActionsTestOtherB-472154126 tempest-ServerActionsTestOtherB-472154126-project-member] Lock "4531bf11-b948-4d57-bf55-f33563815e26" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.471s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "a7113836-350f-4ef2-a64e-418c34e2446f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "a7113836-350f-4ef2-a64e-418c34e2446f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:10 user nova-compute[75247]: INFO nova.compute.manager [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Detaching volume e78a51d4-9cef-471f-8af7-22504a7e913a
Dec 06 12:49:11 user nova-compute[75247]: INFO nova.virt.block_device [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Attempting to driver detach volume e78a51d4-9cef-471f-8af7-22504a7e913a from mountpoint /dev/vdb
Dec 06 12:49:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Attempting to detach device vdb from instance a7113836-350f-4ef2-a64e-418c34e2446f from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 12:49:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:49:11 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:49:11 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:49:11 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:49:11 user nova-compute[75247]:   <serial>e78a51d4-9cef-471f-8af7-22504a7e913a</serial>
Dec 06 12:49:11 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:49:11 user nova-compute[75247]: </disk>
Dec 06 12:49:11 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:49:11 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Successfully detached device vdb from instance a7113836-350f-4ef2-a64e-418c34e2446f from the persistent domain config.
Dec 06 12:49:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a7113836-350f-4ef2-a64e-418c34e2446f from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 12:49:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:49:11 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:49:11 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:49:11 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:49:11 user nova-compute[75247]:   <serial>e78a51d4-9cef-471f-8af7-22504a7e913a</serial>
Dec 06 12:49:11 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:49:11 user nova-compute[75247]: </disk>
Dec 06 12:49:11 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:49:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a7113836-350f-4ef2-a64e-418c34e2446f {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 12:49:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:11 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:49:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:11 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 12:49:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Acquiring lock "9b042a8f-4f9c-4704-8b48-f9eba4f8014b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "9b042a8f-4f9c-4704-8b48-f9eba4f8014b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:12 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:49:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:12 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:49:12 user nova-compute[75247]: INFO nova.compute.claims [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Claim successful on node user
Dec 06 12:49:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:13 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:49:13 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:49:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.640s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:13 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:49:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97d1f646-bc64-40e2-9418-c89a87473640/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:13 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:49:13 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:49:13 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:49:13 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:49:13 user nova-compute[75247]: DEBUG nova.policy [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf32752c9f2d404b8ee4819e72e1b516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4efbc08c0354cb28d4d62be836f5e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:49:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97d1f646-bc64-40e2-9418-c89a87473640/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97d1f646-bc64-40e2-9418-c89a87473640/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:13 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:49:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:49:13 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Creating image(s)
Dec 06 12:49:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b042a8f-4f9c-4704-8b48-f9eba4f8014b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "/opt/stack/data/nova/instances/9b042a8f-4f9c-4704-8b48-f9eba4f8014b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "/opt/stack/data/nova/instances/9b042a8f-4f9c-4704-8b48-f9eba4f8014b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97d1f646-bc64-40e2-9418-c89a87473640/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.179s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.198s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/9b042a8f-4f9c-4704-8b48-f9eba4f8014b/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Successfully created port: afacb60d-782e-47e5-9eb3-64b3ad760da0 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/9b042a8f-4f9c-4704-8b48-f9eba4f8014b/disk 1073741824" returned: 0 in 0.054s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.196s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b042a8f-4f9c-4704-8b48-f9eba4f8014b/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b042a8f-4f9c-4704-8b48-f9eba4f8014b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b042a8f-4f9c-4704-8b48-f9eba4f8014b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Cannot resize image /opt/stack/data/nova/instances/9b042a8f-4f9c-4704-8b48-f9eba4f8014b/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Ensure instance console log exists: /opt/stack/data/nova/instances/9b042a8f-4f9c-4704-8b48-f9eba4f8014b/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7113836-350f-4ef2-a64e-418c34e2446f/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:14 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 97d1f646-bc64-40e2-9418-c89a87473640 is timed out.
Dec 06 12:49:14 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Successfully detached device vdb from instance 97d1f646-bc64-40e2-9418-c89a87473640 from the live domain config.
Dec 06 12:49:14 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDiZelgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:49:14 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:49:14 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd96d31b-38c8-4ab8-bf10-a10d3ce796c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:49:14 user nova-compute[75247]: No targets found.
Dec 06 12:49:14 user nova-compute[75247]: iSNS:
Dec 06 12:49:14 user nova-compute[75247]: No targets found.
Dec 06 12:49:14 user nova-compute[75247]: STATIC:
Dec 06 12:49:14 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:49:14 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:49:14 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:49:14 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732
Dec 06 12:49:14 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:49:14 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:49:14 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579
Dec 06 12:49:14 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:49:14 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:49:14 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a
Dec 06 12:49:14 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:49:14 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:49:14 user nova-compute[75247]: FIRMWARE:
Dec 06 12:49:14 user nova-compute[75247]: No targets found.
Dec 06 12:49:14 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:49:14 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:49:14 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3b796d-737e-479a-8311-77e4b7fd604b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdf6a7e-ee4b-4267-b7ee-ecfa61fefdf1]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:49:14 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:49:14 user nova-compute[75247]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 (non-flash)
Dec 06 12:49:14 user nova-compute[75247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a (non-flash)
Dec 06 12:49:14 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:49:14 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:49:14 user nova-compute[75247]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 (non-flash)
Dec 06 12:49:14 user nova-compute[75247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a (non-flash)
Dec 06 12:49:14 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c68b880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732'): ({'sdf'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Removing single pathed devices sdf {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7113836-350f-4ef2-a64e-418c34e2446f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7113836-350f-4ef2-a64e-418c34e2446f/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f82cd0-2b46-48fe-9f7b-2da1f3231650]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e2017a-df84-47fd-ad05-d07ab2d4e918]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Flushing IO for device /dev/sdf {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d08dca-ca3b-4a23-9420-ae0699342bc4]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.057s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[020e48f4-ccf3-4782-a8d7-4032c1b3f050]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] SCSI volumes sdf have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:49:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47e7d28-cbb3-4e5d-ac4d-a7780863b2ba]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7113836-350f-4ef2-a64e-418c34e2446f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a10519-bd85-4516-9dc5-c7711f978bce]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732, portal: 172.16.0.220,3260]
Dec 06 12:49:15 user nova-compute[75247]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732, portal: 172.16.0.220,3260] successful.
Dec 06 12:49:15 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[921853eb-2c9b-48e0-87fc-add9b375384b]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] <== disconnect_volume: return (382ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Successfully updated port: afacb60d-782e-47e5-9eb3-64b3ad760da0 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Acquiring lock "refresh_cache-9b042a8f-4f9c-4704-8b48-f9eba4f8014b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Acquired lock "refresh_cache-9b042a8f-4f9c-4704-8b48-f9eba4f8014b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG nova.compute.manager [req-4d060ec1-5b18-42f4-a224-3c557fa4a2d2 req-4716ec64-0c87-4cc6-90b5-51e991a2bbde service nova] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Received event network-changed-afacb60d-782e-47e5-9eb3-64b3ad760da0 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG nova.compute.manager [req-4d060ec1-5b18-42f4-a224-3c557fa4a2d2 req-4716ec64-0c87-4cc6-90b5-51e991a2bbde service nova] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Refreshing instance network info cache due to event network-changed-afacb60d-782e-47e5-9eb3-64b3ad760da0. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4d060ec1-5b18-42f4-a224-3c557fa4a2d2 req-4716ec64-0c87-4cc6-90b5-51e991a2bbde service nova] Acquiring lock "refresh_cache-9b042a8f-4f9c-4704-8b48-f9eba4f8014b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG nova.compute.manager [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:49:15 user nova-compute[75247]: INFO nova.compute.claims [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Claim successful on node user
Dec 06 12:49:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:15 user nova-compute[75247]: DEBUG nova.objects.instance [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lazy-loading 'flavor' on Instance uuid 97d1f646-bc64-40e2-9418-c89a87473640 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-da240bec-d176-4749-a98c-cf6b90d73628 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "97d1f646-bc64-40e2-9418-c89a87473640" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.843s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "97d1f646-bc64-40e2-9418-c89a87473640" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.706s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "97d1f646-bc64-40e2-9418-c89a87473640-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "97d1f646-bc64-40e2-9418-c89a87473640-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "97d1f646-bc64-40e2-9418-c89a87473640-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:16 user nova-compute[75247]: INFO nova.compute.manager [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Terminating instance
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.compute.manager [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Updating instance_info_cache with network_info: [{"id": "afacb60d-782e-47e5-9eb3-64b3ad760da0", "address": "fa:16:3e:cc:f8:8a", "network": {"id": "783b08eb-3a13-4dea-a30d-94ce21434b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-358384266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4efbc08c0354cb28d4d62be836f5e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafacb60d-78", "ovs_interfaceid": "afacb60d-782e-47e5-9eb3-64b3ad760da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Releasing lock "refresh_cache-9b042a8f-4f9c-4704-8b48-f9eba4f8014b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Instance network_info: |[{"id": "afacb60d-782e-47e5-9eb3-64b3ad760da0", "address": "fa:16:3e:cc:f8:8a", "network": {"id": "783b08eb-3a13-4dea-a30d-94ce21434b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-358384266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4efbc08c0354cb28d4d62be836f5e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafacb60d-78", "ovs_interfaceid": "afacb60d-782e-47e5-9eb3-64b3ad760da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4d060ec1-5b18-42f4-a224-3c557fa4a2d2 req-4716ec64-0c87-4cc6-90b5-51e991a2bbde service nova] Acquired lock "refresh_cache-9b042a8f-4f9c-4704-8b48-f9eba4f8014b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.network.neutron [req-4d060ec1-5b18-42f4-a224-3c557fa4a2d2 req-4716ec64-0c87-4cc6-90b5-51e991a2bbde service nova] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Refreshing network info cache for port afacb60d-782e-47e5-9eb3-64b3ad760da0 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Start _get_guest_xml network_info=[{"id": "afacb60d-782e-47e5-9eb3-64b3ad760da0", "address": "fa:16:3e:cc:f8:8a", "network": {"id": "783b08eb-3a13-4dea-a30d-94ce21434b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-358384266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4efbc08c0354cb28d4d62be836f5e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafacb60d-78", "ovs_interfaceid": "afacb60d-782e-47e5-9eb3-64b3ad760da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:49:16 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:49:16 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:49:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1125904575',display_name='tempest-VolumesAdminNegativeTest-server-1125904575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1125904575',id=24,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4efbc08c0354cb28d4d62be836f5e6f',ramdisk_id='',reservation_id='r-2rjank0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2088368587',owner_user_name='tempest-VolumesAdminNegativeTest-2088368587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:49:14Z,user_data=None,user_id='bf32752c9f2d404b8ee4819e72e1b516',uuid=9b042a8f-4f9c-4704-8b48-f9eba4f8014b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afacb60d-782e-47e5-9eb3-64b3ad760da0", "address": "fa:16:3e:cc:f8:8a", "network": {"id": "783b08eb-3a13-4dea-a30d-94ce21434b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-358384266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4efbc08c0354cb28d4d62be836f5e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafacb60d-78", "ovs_interfaceid": "afacb60d-782e-47e5-9eb3-64b3ad760da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Converting VIF {"id": "afacb60d-782e-47e5-9eb3-64b3ad760da0", "address": "fa:16:3e:cc:f8:8a", "network": {"id": "783b08eb-3a13-4dea-a30d-94ce21434b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-358384266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4efbc08c0354cb28d4d62be836f5e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafacb60d-78", "ovs_interfaceid": "afacb60d-782e-47e5-9eb3-64b3ad760da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f8:8a,bridge_name='br-int',has_traffic_filtering=True,id=afacb60d-782e-47e5-9eb3-64b3ad760da0,network=Network(783b08eb-3a13-4dea-a30d-94ce21434b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafacb60d-78') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.objects.instance [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b042a8f-4f9c-4704-8b48-f9eba4f8014b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:49:16 user nova-compute[75247]:   <uuid>9b042a8f-4f9c-4704-8b48-f9eba4f8014b</uuid>
Dec 06 12:49:16 user nova-compute[75247]:   <name>instance-00000018</name>
Dec 06 12:49:16 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:49:16 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:49:16 user nova-compute[75247]:   <metadata>
Dec 06 12:49:16 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:49:16 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:49:16 user nova-compute[75247]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1125904575</nova:name>
Dec 06 12:49:16 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:49:16</nova:creationTime>
Dec 06 12:49:16 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:49:16 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:49:16 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:49:16 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:49:16 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:49:16 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:49:16 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:49:16 user nova-compute[75247]:       <nova:owner>
Dec 06 12:49:16 user nova-compute[75247]:         <nova:user uuid="bf32752c9f2d404b8ee4819e72e1b516">tempest-VolumesAdminNegativeTest-2088368587-project-member</nova:user>
Dec 06 12:49:16 user nova-compute[75247]:         <nova:project uuid="e4efbc08c0354cb28d4d62be836f5e6f">tempest-VolumesAdminNegativeTest-2088368587</nova:project>
Dec 06 12:49:16 user nova-compute[75247]:       </nova:owner>
Dec 06 12:49:16 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:49:16 user nova-compute[75247]:       <nova:ports>
Dec 06 12:49:16 user nova-compute[75247]:         <nova:port uuid="afacb60d-782e-47e5-9eb3-64b3ad760da0">
Dec 06 12:49:16 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 12:49:16 user nova-compute[75247]:         </nova:port>
Dec 06 12:49:16 user nova-compute[75247]:       </nova:ports>
Dec 06 12:49:16 user nova-compute[75247]:     </nova:instance>
Dec 06 12:49:16 user nova-compute[75247]:   </metadata>
Dec 06 12:49:16 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:49:16 user nova-compute[75247]:     <system>
Dec 06 12:49:16 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:49:16 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:49:16 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:49:16 user nova-compute[75247]:       <entry name="serial">9b042a8f-4f9c-4704-8b48-f9eba4f8014b</entry>
Dec 06 12:49:16 user nova-compute[75247]:       <entry name="uuid">9b042a8f-4f9c-4704-8b48-f9eba4f8014b</entry>
Dec 06 12:49:16 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:49:16 user nova-compute[75247]:     </system>
Dec 06 12:49:16 user nova-compute[75247]:   </sysinfo>
Dec 06 12:49:16 user nova-compute[75247]:   <os>
Dec 06 12:49:16 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:49:16 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:49:16 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:49:16 user nova-compute[75247]:   </os>
Dec 06 12:49:16 user nova-compute[75247]:   <features>
Dec 06 12:49:16 user nova-compute[75247]:     <acpi/>
Dec 06 12:49:16 user nova-compute[75247]:     <apic/>
Dec 06 12:49:16 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:49:16 user nova-compute[75247]:   </features>
Dec 06 12:49:16 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:49:16 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:49:16 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:49:16 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:49:16 user nova-compute[75247]:   </clock>
Dec 06 12:49:16 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:49:16 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:49:16 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:49:16 user nova-compute[75247]:   </cpu>
Dec 06 12:49:16 user nova-compute[75247]:   <devices>
Dec 06 12:49:16 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:49:16 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:49:16 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/9b042a8f-4f9c-4704-8b48-f9eba4f8014b/disk"/>
Dec 06 12:49:16 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:49:16 user nova-compute[75247]:     </disk>
Dec 06 12:49:16 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:49:16 user nova-compute[75247]:       <mac address="fa:16:3e:cc:f8:8a"/>
Dec 06 12:49:16 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:49:16 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:49:16 user nova-compute[75247]:       <target dev="tapafacb60d-78"/>
Dec 06 12:49:16 user nova-compute[75247]:     </interface>
Dec 06 12:49:16 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:49:16 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/9b042a8f-4f9c-4704-8b48-f9eba4f8014b/console.log" append="off"/>
Dec 06 12:49:16 user nova-compute[75247]:     </serial>
Dec 06 12:49:16 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:49:16 user nova-compute[75247]:     <video>
Dec 06 12:49:16 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:49:16 user nova-compute[75247]:     </video>
Dec 06 12:49:16 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:49:16 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:49:16 user nova-compute[75247]:     </rng>
Dec 06 12:49:16 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:49:16 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:49:16 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:49:16 user nova-compute[75247]:     </memballoon>
Dec 06 12:49:16 user nova-compute[75247]:   </devices>
Dec 06 12:49:16 user nova-compute[75247]: </domain>
Dec 06 12:49:16 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:49:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1125904575',display_name='tempest-VolumesAdminNegativeTest-server-1125904575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1125904575',id=24,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4efbc08c0354cb28d4d62be836f5e6f',ramdisk_id='',reservation_id='r-2rjank0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2088368587',owner_user_name='tempest-VolumesAdminNegativeTest-2088368587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:49:14Z,user_data=None,user_id='bf32752c9f2d404b8ee4819e72e1b516',uuid=9b042a8f-4f9c-4704-8b48-f9eba4f8014b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afacb60d-782e-47e5-9eb3-64b3ad760da0", "address": "fa:16:3e:cc:f8:8a", "network": {"id": "783b08eb-3a13-4dea-a30d-94ce21434b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-358384266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4efbc08c0354cb28d4d62be836f5e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafacb60d-78", "ovs_interfaceid": "afacb60d-782e-47e5-9eb3-64b3ad760da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Converting VIF {"id": "afacb60d-782e-47e5-9eb3-64b3ad760da0", "address": "fa:16:3e:cc:f8:8a", "network": {"id": "783b08eb-3a13-4dea-a30d-94ce21434b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-358384266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4efbc08c0354cb28d4d62be836f5e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafacb60d-78", "ovs_interfaceid": "afacb60d-782e-47e5-9eb3-64b3ad760da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f8:8a,bridge_name='br-int',has_traffic_filtering=True,id=afacb60d-782e-47e5-9eb3-64b3ad760da0,network=Network(783b08eb-3a13-4dea-a30d-94ce21434b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafacb60d-78') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG os_vif [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f8:8a,bridge_name='br-int',has_traffic_filtering=True,id=afacb60d-782e-47e5-9eb3-64b3ad760da0,network=Network(783b08eb-3a13-4dea-a30d-94ce21434b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafacb60d-78') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44a1125e-c87c-5575-9ffa-810ff54bdf67', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapafacb60d-78, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapafacb60d-78, col_values=(('qos', UUID('0ec2c23f-2127-45ec-81ad-b0c4663cdb50')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapafacb60d-78, col_values=(('external_ids', {'iface-id': 'afacb60d-782e-47e5-9eb3-64b3ad760da0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:f8:8a', 'vm-uuid': '9b042a8f-4f9c-4704-8b48-f9eba4f8014b'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:16 user nova-compute[75247]: INFO os_vif [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f8:8a,bridge_name='br-int',has_traffic_filtering=True,id=afacb60d-782e-47e5-9eb3-64b3ad760da0,network=Network(783b08eb-3a13-4dea-a30d-94ce21434b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafacb60d-78')
Dec 06 12:49:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:49:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] No VIF found with MAC fa:16:3e:cc:f8:8a, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-43d20ff5-d646-4ea8-bc9c-371480143067 req-434d2d03-907d-45cf-af72-586803e50a7c service nova] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Received event network-vif-plugged-afacb60d-782e-47e5-9eb3-64b3ad760da0 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-43d20ff5-d646-4ea8-bc9c-371480143067 req-434d2d03-907d-45cf-af72-586803e50a7c service nova] Acquiring lock "9b042a8f-4f9c-4704-8b48-f9eba4f8014b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-43d20ff5-d646-4ea8-bc9c-371480143067 req-434d2d03-907d-45cf-af72-586803e50a7c service nova] Lock "9b042a8f-4f9c-4704-8b48-f9eba4f8014b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-43d20ff5-d646-4ea8-bc9c-371480143067 req-434d2d03-907d-45cf-af72-586803e50a7c service nova] Lock "9b042a8f-4f9c-4704-8b48-f9eba4f8014b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-43d20ff5-d646-4ea8-bc9c-371480143067 req-434d2d03-907d-45cf-af72-586803e50a7c service nova] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] No waiting events found dispatching network-vif-plugged-afacb60d-782e-47e5-9eb3-64b3ad760da0 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:49:20 user nova-compute[75247]: WARNING nova.compute.manager [req-43d20ff5-d646-4ea8-bc9c-371480143067 req-434d2d03-907d-45cf-af72-586803e50a7c service nova] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Received unexpected event network-vif-plugged-afacb60d-782e-47e5-9eb3-64b3ad760da0 for instance with vm_state building and task_state spawning.
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-b860b936-d206-4874-9e50-ca2bae883e7a req-c4487a9c-c476-42f9-aed5-ab5690525e7a service nova] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Received event network-vif-unplugged-85ce649b-cff1-4ab2-b9f8-c187f9124936 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b860b936-d206-4874-9e50-ca2bae883e7a req-c4487a9c-c476-42f9-aed5-ab5690525e7a service nova] Acquiring lock "97d1f646-bc64-40e2-9418-c89a87473640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b860b936-d206-4874-9e50-ca2bae883e7a req-c4487a9c-c476-42f9-aed5-ab5690525e7a service nova] Lock "97d1f646-bc64-40e2-9418-c89a87473640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b860b936-d206-4874-9e50-ca2bae883e7a req-c4487a9c-c476-42f9-aed5-ab5690525e7a service nova] Lock "97d1f646-bc64-40e2-9418-c89a87473640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-b860b936-d206-4874-9e50-ca2bae883e7a req-c4487a9c-c476-42f9-aed5-ab5690525e7a service nova] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] No waiting events found dispatching network-vif-unplugged-85ce649b-cff1-4ab2-b9f8-c187f9124936 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-b860b936-d206-4874-9e50-ca2bae883e7a req-c4487a9c-c476-42f9-aed5-ab5690525e7a service nova] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Received event network-vif-unplugged-85ce649b-cff1-4ab2-b9f8-c187f9124936 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-92fd4ef6-4089-4568-aee3-f7a3d150f7f7 req-fb6cdd23-f06d-45ba-874d-3e3ed13a452a service nova] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Received event network-vif-plugged-afacb60d-782e-47e5-9eb3-64b3ad760da0 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-92fd4ef6-4089-4568-aee3-f7a3d150f7f7 req-fb6cdd23-f06d-45ba-874d-3e3ed13a452a service nova] Acquiring lock "9b042a8f-4f9c-4704-8b48-f9eba4f8014b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-92fd4ef6-4089-4568-aee3-f7a3d150f7f7 req-fb6cdd23-f06d-45ba-874d-3e3ed13a452a service nova] Lock "9b042a8f-4f9c-4704-8b48-f9eba4f8014b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-92fd4ef6-4089-4568-aee3-f7a3d150f7f7 req-fb6cdd23-f06d-45ba-874d-3e3ed13a452a service nova] Lock "9b042a8f-4f9c-4704-8b48-f9eba4f8014b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-92fd4ef6-4089-4568-aee3-f7a3d150f7f7 req-fb6cdd23-f06d-45ba-874d-3e3ed13a452a service nova] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] No waiting events found dispatching network-vif-plugged-afacb60d-782e-47e5-9eb3-64b3ad760da0 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:49:20 user nova-compute[75247]: WARNING nova.compute.manager [req-92fd4ef6-4089-4568-aee3-f7a3d150f7f7 req-fb6cdd23-f06d-45ba-874d-3e3ed13a452a service nova] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Received unexpected event network-vif-plugged-afacb60d-782e-47e5-9eb3-64b3ad760da0 for instance with vm_state building and task_state spawning.
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "530cfb75-7aa8-4e57-b282-8f7a21401b34" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "530cfb75-7aa8-4e57-b282-8f7a21401b34" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:20 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Instance destroyed successfully.
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.objects.instance [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lazy-loading 'resources' on Instance uuid 97d1f646-bc64-40e2-9418-c89a87473640 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:49:20 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:49:20 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=7439MB free_disk=25.096046447753906GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:20 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Instance spawned successfully.
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:46:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1690776951',display_name='tempest-VolumesSnapshotTestJSON-instance-1690776951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1690776951',id=21,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGSUSj/rjsjkVcF/pjDxNa+MmNtbMAUkZGikxUw+KQreaFx1LKMvOD4eWcnFo81T2a+CHSxdJEqlLOQTRFnsfc6lWlGCJKzxld4ExdcxsicBRvwrPwj4KV6LFB36g9Dcg==',key_name='tempest-keypair-502750157',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:46:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b58ba64f48e946098b72d7061d354ef3',ramdisk_id='',reservation_id='r-uuu23vg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1940428801',owner_user_name='tempest-VolumesSnapshotTestJSON-1940428801-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35d1ce8c369941aab5effd18633a73b0',uuid=97d1f646-bc64-40e2-9418-c89a87473640,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85ce649b-cff1-4ab2-b9f8-c187f9124936", "address": "fa:16:3e:f8:f7:bd", "network": {"id": "24492570-dfe5-49d1-944e-7435cc85d347", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145359804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58ba64f48e946098b72d7061d354ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ce649b-cf", "ovs_interfaceid": "85ce649b-cff1-4ab2-b9f8-c187f9124936", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Converting VIF {"id": "85ce649b-cff1-4ab2-b9f8-c187f9124936", "address": "fa:16:3e:f8:f7:bd", "network": {"id": "24492570-dfe5-49d1-944e-7435cc85d347", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145359804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58ba64f48e946098b72d7061d354ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ce649b-cf", "ovs_interfaceid": "85ce649b-cff1-4ab2-b9f8-c187f9124936", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:f7:bd,bridge_name='br-int',has_traffic_filtering=True,id=85ce649b-cff1-4ab2-b9f8-c187f9124936,network=Network(24492570-dfe5-49d1-944e-7435cc85d347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ce649b-cf') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG os_vif [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:f7:bd,bridge_name='br-int',has_traffic_filtering=True,id=85ce649b-cff1-4ab2-b9f8-c187f9124936,network=Network(24492570-dfe5-49d1-944e-7435cc85d347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ce649b-cf') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85ce649b-cf, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:49:20 user nova-compute[75247]: INFO nova.compute.manager [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Detaching volume 4933a54b-1240-4fda-8beb-b2d5cb8ed579
Dec 06 12:49:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f08ebb5-5216-49e5-be11-22522ecb5cd2) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:20 user nova-compute[75247]: INFO os_vif [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:f7:bd,bridge_name='br-int',has_traffic_filtering=True,id=85ce649b-cff1-4ab2-b9f8-c187f9124936,network=Network(24492570-dfe5-49d1-944e-7435cc85d347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ce649b-cf')
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDiZelgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:49:20 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:49:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebb11d0-d3ac-4fb7-ba9a-45b5bf2d9331]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:49:20 user nova-compute[75247]: No targets found.
Dec 06 12:49:20 user nova-compute[75247]: iSNS:
Dec 06 12:49:20 user nova-compute[75247]: No targets found.
Dec 06 12:49:20 user nova-compute[75247]: STATIC:
Dec 06 12:49:20 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:49:20 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:49:20 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:49:20 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579
Dec 06 12:49:20 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:49:20 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:49:20 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a
Dec 06 12:49:20 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:49:20 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:49:20 user nova-compute[75247]: FIRMWARE:
Dec 06 12:49:20 user nova-compute[75247]: No targets found.
Dec 06 12:49:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:49:20 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:49:20 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cced015-e2df-4f38-ba42-6c2c09257732', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:20 user nova-compute[75247]: INFO nova.virt.block_device [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Attempting to driver detach volume 4933a54b-1240-4fda-8beb-b2d5cb8ed579 from mountpoint /dev/vdb
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9fc2de-4227-48b6-a684-f1e37d3d262e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:20 user nova-compute[75247]: INFO nova.compute.manager [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Took 6.89 seconds to spawn the instance on the hypervisor.
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Attempting to detach device vdb from instance cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:49:20 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:49:20 user nova-compute[75247]:   <source dev="/dev/sdh"/>
Dec 06 12:49:20 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:49:20 user nova-compute[75247]:   <serial>4933a54b-1240-4fda-8beb-b2d5cb8ed579</serial>
Dec 06 12:49:20 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 06 12:49:20 user nova-compute[75247]: </disk>
Dec 06 12:49:20 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8651b32-2748-4c1c-a235-394a1ff7d25c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 4.694s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.manager [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:49:20 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:49:20 user nova-compute[75247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a (non-flash)
Dec 06 12:49:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:49:20 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:49:20 user nova-compute[75247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a (non-flash)
Dec 06 12:49:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd7307e2950>, {}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Disconnecting from: [] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.093s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] <== disconnect_volume: return (95ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:49:20 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Deleting instance files /opt/stack/data/nova/instances/97d1f646-bc64-40e2-9418-c89a87473640_del
Dec 06 12:49:20 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Deletion of /opt/stack/data/nova/instances/97d1f646-bc64-40e2-9418-c89a87473640_del complete
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.207s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:20 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Successfully detached device vdb from instance cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b from the persistent domain config.
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:49:20 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:49:20 user nova-compute[75247]:   <source dev="/dev/sdh"/>
Dec 06 12:49:20 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:49:20 user nova-compute[75247]:   <serial>4933a54b-1240-4fda-8beb-b2d5cb8ed579</serial>
Dec 06 12:49:20 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 06 12:49:20 user nova-compute[75247]: </disk>
Dec 06 12:49:20 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:49:20 user nova-compute[75247]: INFO nova.compute.manager [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Took 8.04 seconds to build instance.
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.manager [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.network.neutron [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e1f6310b-6a10-47a6-be1a-4101f45cbc3b tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "9b042a8f-4f9c-4704-8b48-f9eba4f8014b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.230s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:20 user nova-compute[75247]: INFO nova.compute.manager [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Took 4.70 seconds to destroy the instance on the hypervisor.
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:49:20 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.manager [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 70c4664e-ae7a-47de-bba7-18300391d209 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 782289e2-91cd-4aee-9a08-eadfb2a5965b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 3e1b5197-dc38-48a5-b9f9-e053be499433 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 0a86fe94-933a-4e0d-8a65-4834c3d3e40b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance db837c7a-c52d-469b-abf7-cea107454c60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance ea75ba22-b4af-4454-93ed-cdfdc76a895b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 97d1f646-bc64-40e2-9418-c89a87473640 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance a7113836-350f-4ef2-a64e-418c34e2446f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 9b042a8f-4f9c-4704-8b48-f9eba4f8014b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance bc3ddb40-b05f-4170-b269-d44dec6ecdaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.network.neutron [req-4d060ec1-5b18-42f4-a224-3c557fa4a2d2 req-4716ec64-0c87-4cc6-90b5-51e991a2bbde service nova] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Updated VIF entry in instance network info cache for port afacb60d-782e-47e5-9eb3-64b3ad760da0. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.network.neutron [req-4d060ec1-5b18-42f4-a224-3c557fa4a2d2 req-4716ec64-0c87-4cc6-90b5-51e991a2bbde service nova] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Updating instance_info_cache with network_info: [{"id": "afacb60d-782e-47e5-9eb3-64b3ad760da0", "address": "fa:16:3e:cc:f8:8a", "network": {"id": "783b08eb-3a13-4dea-a30d-94ce21434b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-358384266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4efbc08c0354cb28d4d62be836f5e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafacb60d-78", "ovs_interfaceid": "afacb60d-782e-47e5-9eb3-64b3ad760da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4d060ec1-5b18-42f4-a224-3c557fa4a2d2 req-4716ec64-0c87-4cc6-90b5-51e991a2bbde service nova] Releasing lock "refresh_cache-9b042a8f-4f9c-4704-8b48-f9eba4f8014b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 530cfb75-7aa8-4e57-b282-8f7a21401b34 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1764}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.policy [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'deac43cb03b440ff9de75801065ec9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b253fd3ef3284dd885d3a0efc1ec07d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.compute.manager [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:49:20 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Creating image(s)
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "/opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "/opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.227s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 12:49:21 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:49:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.251s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:21 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:49:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk 1073741824" returned: 0 in 0.081s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.337s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 12:49:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.980s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.068s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:49:21 user nova-compute[75247]: INFO nova.compute.claims [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Claim successful on node user
Dec 06 12:49:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.277s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:21 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:49:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-ab7e977f-616d-4c9e-86a4-b096cfd3332c req-d6dbe256-1055-4fed-9f61-bc3a6c27ced4 service nova] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Received event network-vif-plugged-85ce649b-cff1-4ab2-b9f8-c187f9124936 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:49:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ab7e977f-616d-4c9e-86a4-b096cfd3332c req-d6dbe256-1055-4fed-9f61-bc3a6c27ced4 service nova] Acquiring lock "97d1f646-bc64-40e2-9418-c89a87473640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ab7e977f-616d-4c9e-86a4-b096cfd3332c req-d6dbe256-1055-4fed-9f61-bc3a6c27ced4 service nova] Lock "97d1f646-bc64-40e2-9418-c89a87473640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ab7e977f-616d-4c9e-86a4-b096cfd3332c req-d6dbe256-1055-4fed-9f61-bc3a6c27ced4 service nova] Lock "97d1f646-bc64-40e2-9418-c89a87473640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-ab7e977f-616d-4c9e-86a4-b096cfd3332c req-d6dbe256-1055-4fed-9f61-bc3a6c27ced4 service nova] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] No waiting events found dispatching network-vif-plugged-85ce649b-cff1-4ab2-b9f8-c187f9124936 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:49:21 user nova-compute[75247]: WARNING nova.compute.manager [req-ab7e977f-616d-4c9e-86a4-b096cfd3332c req-d6dbe256-1055-4fed-9f61-bc3a6c27ced4 service nova] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Received unexpected event network-vif-plugged-85ce649b-cff1-4ab2-b9f8-c187f9124936 for instance with vm_state active and task_state deleting.
Dec 06 12:49:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Cannot resize image /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Ensure instance console log exists: /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG nova.network.neutron [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Successfully created port: 4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:49:22 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Took 1.49 seconds to deallocate network for instance.
Dec 06 12:49:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-b49ff221-3545-4c47-a8cd-62f77e512d06 req-4e5cfb3b-7d0e-4a31-a78f-b9db6641cee9 service nova] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Received event network-vif-deleted-85ce649b-cff1-4ab2-b9f8-c187f9124936 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:49:22 user nova-compute[75247]: INFO nova.compute.manager [req-b49ff221-3545-4c47-a8cd-62f77e512d06 req-4e5cfb3b-7d0e-4a31-a78f-b9db6641cee9 service nova] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Neutron deleted interface 85ce649b-cff1-4ab2-b9f8-c187f9124936; detaching it from the instance and deleting it from the info cache
Dec 06 12:49:22 user nova-compute[75247]: DEBUG nova.network.neutron [req-b49ff221-3545-4c47-a8cd-62f77e512d06 req-4e5cfb3b-7d0e-4a31-a78f-b9db6641cee9 service nova] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:49:22 user nova-compute[75247]: WARNING nova.volume.cinder [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Attachment f695745f-1245-4ef9-a4ad-c2c3e0aebc5a does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = f695745f-1245-4ef9-a4ad-c2c3e0aebc5a. (HTTP 404) (Request-ID: req-fafb4bba-a26e-4f2b-90ff-fab886b55f8e)
Dec 06 12:49:22 user nova-compute[75247]: INFO nova.compute.manager [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Took 0.04 seconds to detach 1 volumes for instance.
Dec 06 12:49:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-b49ff221-3545-4c47-a8cd-62f77e512d06 req-4e5cfb3b-7d0e-4a31-a78f-b9db6641cee9 service nova] [instance: 97d1f646-bc64-40e2-9418-c89a87473640] Detach interface failed, port_id=85ce649b-cff1-4ab2-b9f8-c187f9124936, reason: Instance 97d1f646-bc64-40e2-9418-c89a87473640 could not be found. {{(pid=75247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.859s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.099s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG nova.network.neutron [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:49:22 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:49:22 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:49:22 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Creating image(s)
Dec 06 12:49:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "/opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "/opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "/opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG nova.policy [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'deac43cb03b440ff9de75801065ec9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b253fd3ef3284dd885d3a0efc1ec07d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:49:22 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.226s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.204s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk 1073741824" returned: 0 in 0.058s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.845s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:23 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Deleted allocations for instance 97d1f646-bc64-40e2-9418-c89a87473640
Dec 06 12:49:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.202s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Checking if we can resize image /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0ec91db9-71c0-44f4-9480-bc18aac0357a tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "97d1f646-bc64-40e2-9418-c89a87473640" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.507s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Cannot resize image /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Ensure instance console log exists: /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG nova.network.neutron [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Successfully updated port: 4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "refresh_cache-bc3ddb40-b05f-4170-b269-d44dec6ecdaf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquired lock "refresh_cache-bc3ddb40-b05f-4170-b269-d44dec6ecdaf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG nova.network.neutron [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:49:23 user nova-compute[75247]: DEBUG nova.network.neutron [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Updating instance_info_cache with network_info: [{"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.compute.manager [req-a5bb06af-a0a3-4599-a4d1-72db993a8c6a req-c63810ea-8942-4527-970f-6d119710687d service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received event network-changed-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.compute.manager [req-a5bb06af-a0a3-4599-a4d1-72db993a8c6a req-c63810ea-8942-4527-970f-6d119710687d service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Refreshing instance network info cache due to event network-changed-4e66d0f0-cc12-4e3a-8626-59f8a73862e8. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a5bb06af-a0a3-4599-a4d1-72db993a8c6a req-c63810ea-8942-4527-970f-6d119710687d service nova] Acquiring lock "refresh_cache-bc3ddb40-b05f-4170-b269-d44dec6ecdaf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.network.neutron [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Updating instance_info_cache with network_info: [{"id": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "address": "fa:16:3e:d5:71:f5", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e66d0f0-cc", "ovs_interfaceid": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Releasing lock "refresh_cache-bc3ddb40-b05f-4170-b269-d44dec6ecdaf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.compute.manager [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Instance network_info: |[{"id": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "address": "fa:16:3e:d5:71:f5", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e66d0f0-cc", "ovs_interfaceid": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a5bb06af-a0a3-4599-a4d1-72db993a8c6a req-c63810ea-8942-4527-970f-6d119710687d service nova] Acquired lock "refresh_cache-bc3ddb40-b05f-4170-b269-d44dec6ecdaf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.network.neutron [req-a5bb06af-a0a3-4599-a4d1-72db993a8c6a req-c63810ea-8942-4527-970f-6d119710687d service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Refreshing network info cache for port 4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Start _get_guest_xml network_info=[{"id": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "address": "fa:16:3e:d5:71:f5", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e66d0f0-cc", "ovs_interfaceid": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.network.neutron [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Successfully created port: d924dd21-056e-413d-8fc1-493933e7e7e6 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:49:24 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:49:24 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:49:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-404265289',display_name='tempest-ServerRescueNegativeTestJSON-server-404265289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-404265289',id=25,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b253fd3ef3284dd885d3a0efc1ec07d7',ramdisk_id='',reservation_id='r-66f8wdqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-295230580',owner_user_name='tempest-ServerRescueNegativeTestJSON-295230580-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:49:21Z,user_data=None,user_id='deac43cb03b440ff9de75801065ec9af',uuid=bc3ddb40-b05f-4170-b269-d44dec6ecdaf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "address": "fa:16:3e:d5:71:f5", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e66d0f0-cc", "ovs_interfaceid": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Converting VIF {"id": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "address": "fa:16:3e:d5:71:f5", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e66d0f0-cc", "ovs_interfaceid": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:71:f5,bridge_name='br-int',has_traffic_filtering=True,id=4e66d0f0-cc12-4e3a-8626-59f8a73862e8,network=Network(579972e2-9933-47d9-b56b-f64b5650d611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e66d0f0-cc') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.objects.instance [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'pci_devices' on Instance uuid bc3ddb40-b05f-4170-b269-d44dec6ecdaf {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:49:24 user nova-compute[75247]:   <uuid>bc3ddb40-b05f-4170-b269-d44dec6ecdaf</uuid>
Dec 06 12:49:24 user nova-compute[75247]:   <name>instance-00000019</name>
Dec 06 12:49:24 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:49:24 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:49:24 user nova-compute[75247]:   <metadata>
Dec 06 12:49:24 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:49:24 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:49:24 user nova-compute[75247]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-404265289</nova:name>
Dec 06 12:49:24 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:49:24</nova:creationTime>
Dec 06 12:49:24 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:49:24 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:49:24 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:49:24 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:49:24 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:49:24 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:49:24 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:49:24 user nova-compute[75247]:       <nova:owner>
Dec 06 12:49:24 user nova-compute[75247]:         <nova:user uuid="deac43cb03b440ff9de75801065ec9af">tempest-ServerRescueNegativeTestJSON-295230580-project-member</nova:user>
Dec 06 12:49:24 user nova-compute[75247]:         <nova:project uuid="b253fd3ef3284dd885d3a0efc1ec07d7">tempest-ServerRescueNegativeTestJSON-295230580</nova:project>
Dec 06 12:49:24 user nova-compute[75247]:       </nova:owner>
Dec 06 12:49:24 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:49:24 user nova-compute[75247]:       <nova:ports>
Dec 06 12:49:24 user nova-compute[75247]:         <nova:port uuid="4e66d0f0-cc12-4e3a-8626-59f8a73862e8">
Dec 06 12:49:24 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 12:49:24 user nova-compute[75247]:         </nova:port>
Dec 06 12:49:24 user nova-compute[75247]:       </nova:ports>
Dec 06 12:49:24 user nova-compute[75247]:     </nova:instance>
Dec 06 12:49:24 user nova-compute[75247]:   </metadata>
Dec 06 12:49:24 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:49:24 user nova-compute[75247]:     <system>
Dec 06 12:49:24 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:49:24 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:49:24 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:49:24 user nova-compute[75247]:       <entry name="serial">bc3ddb40-b05f-4170-b269-d44dec6ecdaf</entry>
Dec 06 12:49:24 user nova-compute[75247]:       <entry name="uuid">bc3ddb40-b05f-4170-b269-d44dec6ecdaf</entry>
Dec 06 12:49:24 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:49:24 user nova-compute[75247]:     </system>
Dec 06 12:49:24 user nova-compute[75247]:   </sysinfo>
Dec 06 12:49:24 user nova-compute[75247]:   <os>
Dec 06 12:49:24 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:49:24 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:49:24 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:49:24 user nova-compute[75247]:   </os>
Dec 06 12:49:24 user nova-compute[75247]:   <features>
Dec 06 12:49:24 user nova-compute[75247]:     <acpi/>
Dec 06 12:49:24 user nova-compute[75247]:     <apic/>
Dec 06 12:49:24 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:49:24 user nova-compute[75247]:   </features>
Dec 06 12:49:24 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:49:24 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:49:24 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:49:24 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:49:24 user nova-compute[75247]:   </clock>
Dec 06 12:49:24 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:49:24 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:49:24 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:49:24 user nova-compute[75247]:   </cpu>
Dec 06 12:49:24 user nova-compute[75247]:   <devices>
Dec 06 12:49:24 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:49:24 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:49:24 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk"/>
Dec 06 12:49:24 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:49:24 user nova-compute[75247]:     </disk>
Dec 06 12:49:24 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:49:24 user nova-compute[75247]:       <mac address="fa:16:3e:d5:71:f5"/>
Dec 06 12:49:24 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:49:24 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:49:24 user nova-compute[75247]:       <target dev="tap4e66d0f0-cc"/>
Dec 06 12:49:24 user nova-compute[75247]:     </interface>
Dec 06 12:49:24 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:49:24 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/console.log" append="off"/>
Dec 06 12:49:24 user nova-compute[75247]:     </serial>
Dec 06 12:49:24 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:49:24 user nova-compute[75247]:     <video>
Dec 06 12:49:24 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:49:24 user nova-compute[75247]:     </video>
Dec 06 12:49:24 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:49:24 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:49:24 user nova-compute[75247]:     </rng>
Dec 06 12:49:24 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:49:24 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:49:24 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:49:24 user nova-compute[75247]:     </memballoon>
Dec 06 12:49:24 user nova-compute[75247]:   </devices>
Dec 06 12:49:24 user nova-compute[75247]: </domain>
Dec 06 12:49:24 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:49:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-404265289',display_name='tempest-ServerRescueNegativeTestJSON-server-404265289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-404265289',id=25,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b253fd3ef3284dd885d3a0efc1ec07d7',ramdisk_id='',reservation_id='r-66f8wdqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-295230580',owner_user_name='tempest-ServerRescueNegativeTestJSON-295230580-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:49:21Z,user_data=None,user_id='deac43cb03b440ff9de75801065ec9af',uuid=bc3ddb40-b05f-4170-b269-d44dec6ecdaf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "address": "fa:16:3e:d5:71:f5", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e66d0f0-cc", "ovs_interfaceid": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Converting VIF {"id": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "address": "fa:16:3e:d5:71:f5", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e66d0f0-cc", "ovs_interfaceid": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:71:f5,bridge_name='br-int',has_traffic_filtering=True,id=4e66d0f0-cc12-4e3a-8626-59f8a73862e8,network=Network(579972e2-9933-47d9-b56b-f64b5650d611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e66d0f0-cc') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG os_vif [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:71:f5,bridge_name='br-int',has_traffic_filtering=True,id=4e66d0f0-cc12-4e3a-8626-59f8a73862e8,network=Network(579972e2-9933-47d9-b56b-f64b5650d611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e66d0f0-cc') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ceea229-a447-5d04-b328-82dfa0dc2572', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e66d0f0-cc, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e66d0f0-cc, col_values=(('qos', UUID('0911b218-b5d6-4281-a022-c41d5c64d2e4')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e66d0f0-cc, col_values=(('external_ids', {'iface-id': '4e66d0f0-cc12-4e3a-8626-59f8a73862e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:71:f5', 'vm-uuid': 'bc3ddb40-b05f-4170-b269-d44dec6ecdaf'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:24 user nova-compute[75247]: INFO os_vif [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:71:f5,bridge_name='br-int',has_traffic_filtering=True,id=4e66d0f0-cc12-4e3a-8626-59f8a73862e8,network=Network(579972e2-9933-47d9-b56b-f64b5650d611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e66d0f0-cc')
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:49:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] No VIF found with MAC fa:16:3e:d5:71:f5, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:49:25 user nova-compute[75247]: DEBUG nova.network.neutron [req-a5bb06af-a0a3-4599-a4d1-72db993a8c6a req-c63810ea-8942-4527-970f-6d119710687d service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Updated VIF entry in instance network info cache for port 4e66d0f0-cc12-4e3a-8626-59f8a73862e8. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:49:25 user nova-compute[75247]: DEBUG nova.network.neutron [req-a5bb06af-a0a3-4599-a4d1-72db993a8c6a req-c63810ea-8942-4527-970f-6d119710687d service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Updating instance_info_cache with network_info: [{"id": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "address": "fa:16:3e:d5:71:f5", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e66d0f0-cc", "ovs_interfaceid": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:49:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a5bb06af-a0a3-4599-a4d1-72db993a8c6a req-c63810ea-8942-4527-970f-6d119710687d service nova] Releasing lock "refresh_cache-bc3ddb40-b05f-4170-b269-d44dec6ecdaf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:49:25 user nova-compute[75247]: DEBUG nova.network.neutron [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Successfully updated port: d924dd21-056e-413d-8fc1-493933e7e7e6 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:49:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "refresh_cache-530cfb75-7aa8-4e57-b282-8f7a21401b34" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:49:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquired lock "refresh_cache-530cfb75-7aa8-4e57-b282-8f7a21401b34" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:49:25 user nova-compute[75247]: DEBUG nova.network.neutron [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:49:25 user nova-compute[75247]: DEBUG nova.network.neutron [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:49:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:25 user nova-compute[75247]: DEBUG nova.network.neutron [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Updating instance_info_cache with network_info: [{"id": "d924dd21-056e-413d-8fc1-493933e7e7e6", "address": "fa:16:3e:76:c7:97", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd924dd21-05", "ovs_interfaceid": "d924dd21-056e-413d-8fc1-493933e7e7e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Releasing lock "refresh_cache-530cfb75-7aa8-4e57-b282-8f7a21401b34" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Instance network_info: |[{"id": "d924dd21-056e-413d-8fc1-493933e7e7e6", "address": "fa:16:3e:76:c7:97", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd924dd21-05", "ovs_interfaceid": "d924dd21-056e-413d-8fc1-493933e7e7e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Start _get_guest_xml network_info=[{"id": "d924dd21-056e-413d-8fc1-493933e7e7e6", "address": "fa:16:3e:76:c7:97", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd924dd21-05", "ovs_interfaceid": "d924dd21-056e-413d-8fc1-493933e7e7e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:49:26 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:49:26 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:49:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1228817559',display_name='tempest-ServerRescueNegativeTestJSON-server-1228817559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1228817559',id=26,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b253fd3ef3284dd885d3a0efc1ec07d7',ramdisk_id='',reservation_id='r-7yrk1w0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-295230580',owner_user_name='tempest-ServerRescueNegativeTestJSON-295230580-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:49:23Z,user_data=None,user_id='deac43cb03b440ff9de75801065ec9af',uuid=530cfb75-7aa8-4e57-b282-8f7a21401b34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d924dd21-056e-413d-8fc1-493933e7e7e6", "address": "fa:16:3e:76:c7:97", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd924dd21-05", "ovs_interfaceid": "d924dd21-056e-413d-8fc1-493933e7e7e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Converting VIF {"id": "d924dd21-056e-413d-8fc1-493933e7e7e6", "address": "fa:16:3e:76:c7:97", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd924dd21-05", "ovs_interfaceid": "d924dd21-056e-413d-8fc1-493933e7e7e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:c7:97,bridge_name='br-int',has_traffic_filtering=True,id=d924dd21-056e-413d-8fc1-493933e7e7e6,network=Network(579972e2-9933-47d9-b56b-f64b5650d611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd924dd21-05') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.objects.instance [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'pci_devices' on Instance uuid 530cfb75-7aa8-4e57-b282-8f7a21401b34 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:49:26 user nova-compute[75247]:   <uuid>530cfb75-7aa8-4e57-b282-8f7a21401b34</uuid>
Dec 06 12:49:26 user nova-compute[75247]:   <name>instance-0000001a</name>
Dec 06 12:49:26 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:49:26 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:49:26 user nova-compute[75247]:   <metadata>
Dec 06 12:49:26 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:49:26 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:49:26 user nova-compute[75247]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1228817559</nova:name>
Dec 06 12:49:26 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:49:26</nova:creationTime>
Dec 06 12:49:26 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:49:26 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:49:26 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:49:26 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:49:26 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:49:26 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:49:26 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:49:26 user nova-compute[75247]:       <nova:owner>
Dec 06 12:49:26 user nova-compute[75247]:         <nova:user uuid="deac43cb03b440ff9de75801065ec9af">tempest-ServerRescueNegativeTestJSON-295230580-project-member</nova:user>
Dec 06 12:49:26 user nova-compute[75247]:         <nova:project uuid="b253fd3ef3284dd885d3a0efc1ec07d7">tempest-ServerRescueNegativeTestJSON-295230580</nova:project>
Dec 06 12:49:26 user nova-compute[75247]:       </nova:owner>
Dec 06 12:49:26 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:49:26 user nova-compute[75247]:       <nova:ports>
Dec 06 12:49:26 user nova-compute[75247]:         <nova:port uuid="d924dd21-056e-413d-8fc1-493933e7e7e6">
Dec 06 12:49:26 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 06 12:49:26 user nova-compute[75247]:         </nova:port>
Dec 06 12:49:26 user nova-compute[75247]:       </nova:ports>
Dec 06 12:49:26 user nova-compute[75247]:     </nova:instance>
Dec 06 12:49:26 user nova-compute[75247]:   </metadata>
Dec 06 12:49:26 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:49:26 user nova-compute[75247]:     <system>
Dec 06 12:49:26 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:49:26 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:49:26 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:49:26 user nova-compute[75247]:       <entry name="serial">530cfb75-7aa8-4e57-b282-8f7a21401b34</entry>
Dec 06 12:49:26 user nova-compute[75247]:       <entry name="uuid">530cfb75-7aa8-4e57-b282-8f7a21401b34</entry>
Dec 06 12:49:26 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:49:26 user nova-compute[75247]:     </system>
Dec 06 12:49:26 user nova-compute[75247]:   </sysinfo>
Dec 06 12:49:26 user nova-compute[75247]:   <os>
Dec 06 12:49:26 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:49:26 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:49:26 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:49:26 user nova-compute[75247]:   </os>
Dec 06 12:49:26 user nova-compute[75247]:   <features>
Dec 06 12:49:26 user nova-compute[75247]:     <acpi/>
Dec 06 12:49:26 user nova-compute[75247]:     <apic/>
Dec 06 12:49:26 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:49:26 user nova-compute[75247]:   </features>
Dec 06 12:49:26 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:49:26 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:49:26 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:49:26 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:49:26 user nova-compute[75247]:   </clock>
Dec 06 12:49:26 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:49:26 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:49:26 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:49:26 user nova-compute[75247]:   </cpu>
Dec 06 12:49:26 user nova-compute[75247]:   <devices>
Dec 06 12:49:26 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:49:26 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:49:26 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk"/>
Dec 06 12:49:26 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:49:26 user nova-compute[75247]:     </disk>
Dec 06 12:49:26 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:49:26 user nova-compute[75247]:       <mac address="fa:16:3e:76:c7:97"/>
Dec 06 12:49:26 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:49:26 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:49:26 user nova-compute[75247]:       <target dev="tapd924dd21-05"/>
Dec 06 12:49:26 user nova-compute[75247]:     </interface>
Dec 06 12:49:26 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:49:26 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/console.log" append="off"/>
Dec 06 12:49:26 user nova-compute[75247]:     </serial>
Dec 06 12:49:26 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:49:26 user nova-compute[75247]:     <video>
Dec 06 12:49:26 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:49:26 user nova-compute[75247]:     </video>
Dec 06 12:49:26 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:49:26 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:49:26 user nova-compute[75247]:     </rng>
Dec 06 12:49:26 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:49:26 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:49:26 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:49:26 user nova-compute[75247]:     </memballoon>
Dec 06 12:49:26 user nova-compute[75247]:   </devices>
Dec 06 12:49:26 user nova-compute[75247]: </domain>
Dec 06 12:49:26 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:49:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1228817559',display_name='tempest-ServerRescueNegativeTestJSON-server-1228817559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1228817559',id=26,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b253fd3ef3284dd885d3a0efc1ec07d7',ramdisk_id='',reservation_id='r-7yrk1w0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-295230580',owner_user_name='tempest-ServerRescueNegativeTestJSON-295230580-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:49:23Z,user_data=None,user_id='deac43cb03b440ff9de75801065ec9af',uuid=530cfb75-7aa8-4e57-b282-8f7a21401b34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d924dd21-056e-413d-8fc1-493933e7e7e6", "address": "fa:16:3e:76:c7:97", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd924dd21-05", "ovs_interfaceid": "d924dd21-056e-413d-8fc1-493933e7e7e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Converting VIF {"id": "d924dd21-056e-413d-8fc1-493933e7e7e6", "address": "fa:16:3e:76:c7:97", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd924dd21-05", "ovs_interfaceid": "d924dd21-056e-413d-8fc1-493933e7e7e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:c7:97,bridge_name='br-int',has_traffic_filtering=True,id=d924dd21-056e-413d-8fc1-493933e7e7e6,network=Network(579972e2-9933-47d9-b56b-f64b5650d611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd924dd21-05') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG os_vif [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:c7:97,bridge_name='br-int',has_traffic_filtering=True,id=d924dd21-056e-413d-8fc1-493933e7e7e6,network=Network(579972e2-9933-47d9-b56b-f64b5650d611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd924dd21-05') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '432bd865-786d-5477-b6a3-f5f407ed8e67', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd924dd21-05, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd924dd21-05, col_values=(('qos', UUID('e60529d2-b1fd-470a-bddc-832e84f419c7')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd924dd21-05, col_values=(('external_ids', {'iface-id': 'd924dd21-056e-413d-8fc1-493933e7e7e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:c7:97', 'vm-uuid': '530cfb75-7aa8-4e57-b282-8f7a21401b34'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:26 user nova-compute[75247]: INFO os_vif [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:c7:97,bridge_name='br-int',has_traffic_filtering=True,id=d924dd21-056e-413d-8fc1-493933e7e7e6,network=Network(579972e2-9933-47d9-b56b-f64b5650d611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd924dd21-05')
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] No VIF found with MAC fa:16:3e:76:c7:97, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-1c271d70-8cb1-4b79-bd69-8108a629bb9c req-a4840776-801e-4a69-b5f7-f532f7042f61 service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received event network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1c271d70-8cb1-4b79-bd69-8108a629bb9c req-a4840776-801e-4a69-b5f7-f532f7042f61 service nova] Acquiring lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1c271d70-8cb1-4b79-bd69-8108a629bb9c req-a4840776-801e-4a69-b5f7-f532f7042f61 service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1c271d70-8cb1-4b79-bd69-8108a629bb9c req-a4840776-801e-4a69-b5f7-f532f7042f61 service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-1c271d70-8cb1-4b79-bd69-8108a629bb9c req-a4840776-801e-4a69-b5f7-f532f7042f61 service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] No waiting events found dispatching network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:49:26 user nova-compute[75247]: WARNING nova.compute.manager [req-1c271d70-8cb1-4b79-bd69-8108a629bb9c req-a4840776-801e-4a69-b5f7-f532f7042f61 service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received unexpected event network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 for instance with vm_state building and task_state spawning.
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-0ba0d639-d91b-498b-bda8-e9a62d6ed47d req-0b53edda-cbbf-4a17-aa70-2f324c043b87 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Received event network-changed-d924dd21-056e-413d-8fc1-493933e7e7e6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-0ba0d639-d91b-498b-bda8-e9a62d6ed47d req-0b53edda-cbbf-4a17-aa70-2f324c043b87 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Refreshing instance network info cache due to event network-changed-d924dd21-056e-413d-8fc1-493933e7e7e6. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0ba0d639-d91b-498b-bda8-e9a62d6ed47d req-0b53edda-cbbf-4a17-aa70-2f324c043b87 service nova] Acquiring lock "refresh_cache-530cfb75-7aa8-4e57-b282-8f7a21401b34" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0ba0d639-d91b-498b-bda8-e9a62d6ed47d req-0b53edda-cbbf-4a17-aa70-2f324c043b87 service nova] Acquired lock "refresh_cache-530cfb75-7aa8-4e57-b282-8f7a21401b34" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.network.neutron [req-0ba0d639-d91b-498b-bda8-e9a62d6ed47d req-0b53edda-cbbf-4a17-aa70-2f324c043b87 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Refreshing network info cache for port d924dd21-056e-413d-8fc1-493933e7e7e6 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ea1c9acf-0d03-43a2-a493-5efb5087344d tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ea1c9acf-0d03-43a2-a493-5efb5087344d tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ea1c9acf-0d03-43a2-a493-5efb5087344d tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ea1c9acf-0d03-43a2-a493-5efb5087344d tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ea1c9acf-0d03-43a2-a493-5efb5087344d tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:26 user nova-compute[75247]: INFO nova.compute.manager [None req-ea1c9acf-0d03-43a2-a493-5efb5087344d tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Terminating instance
Dec 06 12:49:26 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ea1c9acf-0d03-43a2-a493-5efb5087344d tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:27 user nova-compute[75247]: DEBUG nova.network.neutron [req-0ba0d639-d91b-498b-bda8-e9a62d6ed47d req-0b53edda-cbbf-4a17-aa70-2f324c043b87 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Updated VIF entry in instance network info cache for port d924dd21-056e-413d-8fc1-493933e7e7e6. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:49:27 user nova-compute[75247]: DEBUG nova.network.neutron [req-0ba0d639-d91b-498b-bda8-e9a62d6ed47d req-0b53edda-cbbf-4a17-aa70-2f324c043b87 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Updating instance_info_cache with network_info: [{"id": "d924dd21-056e-413d-8fc1-493933e7e7e6", "address": "fa:16:3e:76:c7:97", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd924dd21-05", "ovs_interfaceid": "d924dd21-056e-413d-8fc1-493933e7e7e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:49:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0ba0d639-d91b-498b-bda8-e9a62d6ed47d req-0b53edda-cbbf-4a17-aa70-2f324c043b87 service nova] Releasing lock "refresh_cache-530cfb75-7aa8-4e57-b282-8f7a21401b34" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:49:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:28 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Instance destroyed successfully.
Dec 06 12:49:28 user nova-compute[75247]: DEBUG nova.objects.instance [None req-ea1c9acf-0d03-43a2-a493-5efb5087344d tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lazy-loading 'resources' on Instance uuid 0a86fe94-933a-4e0d-8a65-4834c3d3e40b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-ea1c9acf-0d03-43a2-a493-5efb5087344d tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2121046985',display_name='tempest-TestMinimumBasicScenario-server-2121046985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2121046985',id=15,image_ref='a4449aa0-dc9e-4135-81a7-803ee3d8f136',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENALU6V+1C8Yive07KA1tVNytMgJkyJ7zBITPFD/k7QX/C53xnZxG7Nj3ga2MhNQdhymkiPaD/Qm+Y3zch0QuL7UEl+iGb5BUzeR0Hi6d88zrxWSGsr13B14Fl5cFNYSA==',key_name='tempest-TestMinimumBasicScenario-1562390602',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:44:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df4c40ccbb8a410aa0e65c1f5897de97',ramdisk_id='',reservation_id='r-4am3hdod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a4449aa0-dc9e-4135-81a7-803ee3d8f136',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1052287778',owner_user_name='tempest-TestMinimumBasicScenario-1052287778-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:46:47Z,user_data=None,user_id='4548c5d3575e45d787758e52fbf274d6',uuid=0a86fe94-933a-4e0d-8a65-4834c3d3e40b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8d5f682-76a1-4b39-8153-487fe53a127a", "address": "fa:16:3e:a7:11:06", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d5f682-76", "ovs_interfaceid": "a8d5f682-76a1-4b39-8153-487fe53a127a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-ea1c9acf-0d03-43a2-a493-5efb5087344d tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Converting VIF {"id": "a8d5f682-76a1-4b39-8153-487fe53a127a", "address": "fa:16:3e:a7:11:06", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d5f682-76", "ovs_interfaceid": "a8d5f682-76a1-4b39-8153-487fe53a127a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-ea1c9acf-0d03-43a2-a493-5efb5087344d tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:11:06,bridge_name='br-int',has_traffic_filtering=True,id=a8d5f682-76a1-4b39-8153-487fe53a127a,network=Network(56756e7a-b384-43a0-88dc-bab3b11e5f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d5f682-76') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG os_vif [None req-ea1c9acf-0d03-43a2-a493-5efb5087344d tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:11:06,bridge_name='br-int',has_traffic_filtering=True,id=a8d5f682-76a1-4b39-8153-487fe53a127a,network=Network(56756e7a-b384-43a0-88dc-bab3b11e5f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d5f682-76') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8d5f682-76, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ebf1f23-5749-408b-83c0-7911d3279b42) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:28 user nova-compute[75247]: INFO os_vif [None req-ea1c9acf-0d03-43a2-a493-5efb5087344d tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:11:06,bridge_name='br-int',has_traffic_filtering=True,id=a8d5f682-76a1-4b39-8153-487fe53a127a,network=Network(56756e7a-b384-43a0-88dc-bab3b11e5f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d5f682-76')
Dec 06 12:49:28 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-ea1c9acf-0d03-43a2-a493-5efb5087344d tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Deleting instance files /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b_del
Dec 06 12:49:28 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-ea1c9acf-0d03-43a2-a493-5efb5087344d tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Deletion of /opt/stack/data/nova/instances/0a86fe94-933a-4e0d-8a65-4834c3d3e40b_del complete
Dec 06 12:49:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-a023c77a-c6b5-46a1-9724-33081b25076f req-d7fcaffe-88f4-4642-b5d9-8479ca1f0514 service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received event network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a023c77a-c6b5-46a1-9724-33081b25076f req-d7fcaffe-88f4-4642-b5d9-8479ca1f0514 service nova] Acquiring lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a023c77a-c6b5-46a1-9724-33081b25076f req-d7fcaffe-88f4-4642-b5d9-8479ca1f0514 service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a023c77a-c6b5-46a1-9724-33081b25076f req-d7fcaffe-88f4-4642-b5d9-8479ca1f0514 service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-a023c77a-c6b5-46a1-9724-33081b25076f req-d7fcaffe-88f4-4642-b5d9-8479ca1f0514 service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] No waiting events found dispatching network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:49:28 user nova-compute[75247]: WARNING nova.compute.manager [req-a023c77a-c6b5-46a1-9724-33081b25076f req-d7fcaffe-88f4-4642-b5d9-8479ca1f0514 service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received unexpected event network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 for instance with vm_state building and task_state spawning.
Dec 06 12:49:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-a023c77a-c6b5-46a1-9724-33081b25076f req-d7fcaffe-88f4-4642-b5d9-8479ca1f0514 service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received event network-vif-unplugged-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a023c77a-c6b5-46a1-9724-33081b25076f req-d7fcaffe-88f4-4642-b5d9-8479ca1f0514 service nova] Acquiring lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a023c77a-c6b5-46a1-9724-33081b25076f req-d7fcaffe-88f4-4642-b5d9-8479ca1f0514 service nova] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a023c77a-c6b5-46a1-9724-33081b25076f req-d7fcaffe-88f4-4642-b5d9-8479ca1f0514 service nova] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-a023c77a-c6b5-46a1-9724-33081b25076f req-d7fcaffe-88f4-4642-b5d9-8479ca1f0514 service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] No waiting events found dispatching network-vif-unplugged-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-a023c77a-c6b5-46a1-9724-33081b25076f req-d7fcaffe-88f4-4642-b5d9-8479ca1f0514 service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received event network-vif-unplugged-a8d5f682-76a1-4b39-8153-487fe53a127a for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-a023c77a-c6b5-46a1-9724-33081b25076f req-d7fcaffe-88f4-4642-b5d9-8479ca1f0514 service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received event network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a023c77a-c6b5-46a1-9724-33081b25076f req-d7fcaffe-88f4-4642-b5d9-8479ca1f0514 service nova] Acquiring lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a023c77a-c6b5-46a1-9724-33081b25076f req-d7fcaffe-88f4-4642-b5d9-8479ca1f0514 service nova] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a023c77a-c6b5-46a1-9724-33081b25076f req-d7fcaffe-88f4-4642-b5d9-8479ca1f0514 service nova] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-a023c77a-c6b5-46a1-9724-33081b25076f req-d7fcaffe-88f4-4642-b5d9-8479ca1f0514 service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] No waiting events found dispatching network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:49:28 user nova-compute[75247]: WARNING nova.compute.manager [req-a023c77a-c6b5-46a1-9724-33081b25076f req-d7fcaffe-88f4-4642-b5d9-8479ca1f0514 service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received unexpected event network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a for instance with vm_state active and task_state deleting.
Dec 06 12:49:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-a023c77a-c6b5-46a1-9724-33081b25076f req-d7fcaffe-88f4-4642-b5d9-8479ca1f0514 service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received event network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a023c77a-c6b5-46a1-9724-33081b25076f req-d7fcaffe-88f4-4642-b5d9-8479ca1f0514 service nova] Acquiring lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a023c77a-c6b5-46a1-9724-33081b25076f req-d7fcaffe-88f4-4642-b5d9-8479ca1f0514 service nova] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a023c77a-c6b5-46a1-9724-33081b25076f req-d7fcaffe-88f4-4642-b5d9-8479ca1f0514 service nova] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-a023c77a-c6b5-46a1-9724-33081b25076f req-d7fcaffe-88f4-4642-b5d9-8479ca1f0514 service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] No waiting events found dispatching network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:49:28 user nova-compute[75247]: WARNING nova.compute.manager [req-a023c77a-c6b5-46a1-9724-33081b25076f req-d7fcaffe-88f4-4642-b5d9-8479ca1f0514 service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received unexpected event network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a for instance with vm_state active and task_state deleting.
Dec 06 12:49:28 user nova-compute[75247]: INFO nova.compute.manager [None req-ea1c9acf-0d03-43a2-a493-5efb5087344d tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Took 1.76 seconds to destroy the instance on the hypervisor.
Dec 06 12:49:28 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-ea1c9acf-0d03-43a2-a493-5efb5087344d tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-37313995-ce9c-4e7f-9cba-25e9c99a5375 req-00776ed1-aed1-4e04-a94e-c358c0301b50 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Received event network-vif-plugged-d924dd21-056e-413d-8fc1-493933e7e7e6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-37313995-ce9c-4e7f-9cba-25e9c99a5375 req-00776ed1-aed1-4e04-a94e-c358c0301b50 service nova] Acquiring lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-37313995-ce9c-4e7f-9cba-25e9c99a5375 req-00776ed1-aed1-4e04-a94e-c358c0301b50 service nova] Lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-37313995-ce9c-4e7f-9cba-25e9c99a5375 req-00776ed1-aed1-4e04-a94e-c358c0301b50 service nova] Lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-37313995-ce9c-4e7f-9cba-25e9c99a5375 req-00776ed1-aed1-4e04-a94e-c358c0301b50 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] No waiting events found dispatching network-vif-plugged-d924dd21-056e-413d-8fc1-493933e7e7e6 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:49:28 user nova-compute[75247]: WARNING nova.compute.manager [req-37313995-ce9c-4e7f-9cba-25e9c99a5375 req-00776ed1-aed1-4e04-a94e-c358c0301b50 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Received unexpected event network-vif-plugged-d924dd21-056e-413d-8fc1-493933e7e7e6 for instance with vm_state building and task_state spawning.
Dec 06 12:49:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:29 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:49:29 user nova-compute[75247]: DEBUG nova.compute.manager [req-51d0c0a0-8698-429e-b6c4-4769ef5599d8 req-85f82a98-67be-497c-9d1b-5f275fcd8e99 service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received event network-vif-deleted-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:49:29 user nova-compute[75247]: INFO nova.compute.manager [req-51d0c0a0-8698-429e-b6c4-4769ef5599d8 req-85f82a98-67be-497c-9d1b-5f275fcd8e99 service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Neutron deleted interface a8d5f682-76a1-4b39-8153-487fe53a127a; detaching it from the instance and deleting it from the info cache
Dec 06 12:49:29 user nova-compute[75247]: DEBUG nova.network.neutron [req-51d0c0a0-8698-429e-b6c4-4769ef5599d8 req-85f82a98-67be-497c-9d1b-5f275fcd8e99 service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:49:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:29 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Took 0.73 seconds to deallocate network for instance.
Dec 06 12:49:29 user nova-compute[75247]: DEBUG nova.compute.manager [req-51d0c0a0-8698-429e-b6c4-4769ef5599d8 req-85f82a98-67be-497c-9d1b-5f275fcd8e99 service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Detach interface failed, port_id=a8d5f682-76a1-4b39-8153-487fe53a127a, reason: Instance 0a86fe94-933a-4e0d-8a65-4834c3d3e40b could not be found. {{(pid=75247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 12:49:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ea1c9acf-0d03-43a2-a493-5efb5087344d tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ea1c9acf-0d03-43a2-a493-5efb5087344d tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:29 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-ea1c9acf-0d03-43a2-a493-5efb5087344d tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:49:29 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-ea1c9acf-0d03-43a2-a493-5efb5087344d tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:49:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ea1c9acf-0d03-43a2-a493-5efb5087344d tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.513s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:29 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-ea1c9acf-0d03-43a2-a493-5efb5087344d tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Deleted allocations for instance 0a86fe94-933a-4e0d-8a65-4834c3d3e40b
Dec 06 12:49:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ea1c9acf-0d03-43a2-a493-5efb5087344d tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.250s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.compute.manager [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:49:30 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Instance spawned successfully.
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:49:30 user nova-compute[75247]: INFO nova.compute.manager [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Took 9.46 seconds to spawn the instance on the hypervisor.
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.compute.manager [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:49:30 user nova-compute[75247]: INFO nova.compute.manager [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Took 14.64 seconds to build instance.
Dec 06 12:49:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-01ef5973-d0e4-4f1d-b5ff-d14acee4698d tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.768s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.compute.manager [req-0269022e-0f5b-48f0-9e34-482cd12b8f07 req-0d86641c-af9f-46ae-ac6e-356c6e9945bd service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received event network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0269022e-0f5b-48f0-9e34-482cd12b8f07 req-0d86641c-af9f-46ae-ac6e-356c6e9945bd service nova] Acquiring lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0269022e-0f5b-48f0-9e34-482cd12b8f07 req-0d86641c-af9f-46ae-ac6e-356c6e9945bd service nova] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0269022e-0f5b-48f0-9e34-482cd12b8f07 req-0d86641c-af9f-46ae-ac6e-356c6e9945bd service nova] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.compute.manager [req-0269022e-0f5b-48f0-9e34-482cd12b8f07 req-0d86641c-af9f-46ae-ac6e-356c6e9945bd service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] No waiting events found dispatching network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:49:30 user nova-compute[75247]: WARNING nova.compute.manager [req-0269022e-0f5b-48f0-9e34-482cd12b8f07 req-0d86641c-af9f-46ae-ac6e-356c6e9945bd service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received unexpected event network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a for instance with vm_state deleted and task_state None.
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.compute.manager [req-0269022e-0f5b-48f0-9e34-482cd12b8f07 req-0d86641c-af9f-46ae-ac6e-356c6e9945bd service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received event network-vif-unplugged-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0269022e-0f5b-48f0-9e34-482cd12b8f07 req-0d86641c-af9f-46ae-ac6e-356c6e9945bd service nova] Acquiring lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0269022e-0f5b-48f0-9e34-482cd12b8f07 req-0d86641c-af9f-46ae-ac6e-356c6e9945bd service nova] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0269022e-0f5b-48f0-9e34-482cd12b8f07 req-0d86641c-af9f-46ae-ac6e-356c6e9945bd service nova] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.compute.manager [req-0269022e-0f5b-48f0-9e34-482cd12b8f07 req-0d86641c-af9f-46ae-ac6e-356c6e9945bd service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] No waiting events found dispatching network-vif-unplugged-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:49:30 user nova-compute[75247]: WARNING nova.compute.manager [req-0269022e-0f5b-48f0-9e34-482cd12b8f07 req-0d86641c-af9f-46ae-ac6e-356c6e9945bd service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received unexpected event network-vif-unplugged-a8d5f682-76a1-4b39-8153-487fe53a127a for instance with vm_state deleted and task_state None.
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.compute.manager [req-0269022e-0f5b-48f0-9e34-482cd12b8f07 req-0d86641c-af9f-46ae-ac6e-356c6e9945bd service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received event network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0269022e-0f5b-48f0-9e34-482cd12b8f07 req-0d86641c-af9f-46ae-ac6e-356c6e9945bd service nova] Acquiring lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0269022e-0f5b-48f0-9e34-482cd12b8f07 req-0d86641c-af9f-46ae-ac6e-356c6e9945bd service nova] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0269022e-0f5b-48f0-9e34-482cd12b8f07 req-0d86641c-af9f-46ae-ac6e-356c6e9945bd service nova] Lock "0a86fe94-933a-4e0d-8a65-4834c3d3e40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.compute.manager [req-0269022e-0f5b-48f0-9e34-482cd12b8f07 req-0d86641c-af9f-46ae-ac6e-356c6e9945bd service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] No waiting events found dispatching network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:49:30 user nova-compute[75247]: WARNING nova.compute.manager [req-0269022e-0f5b-48f0-9e34-482cd12b8f07 req-0d86641c-af9f-46ae-ac6e-356c6e9945bd service nova] [instance: 0a86fe94-933a-4e0d-8a65-4834c3d3e40b] Received unexpected event network-vif-plugged-a8d5f682-76a1-4b39-8153-487fe53a127a for instance with vm_state deleted and task_state None.
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.compute.manager [req-b345460a-7c9b-4cc0-be8c-477cdb4e85dc req-077bbbbc-cf79-4d2a-93bf-9d527fc66ee0 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Received event network-vif-plugged-d924dd21-056e-413d-8fc1-493933e7e7e6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b345460a-7c9b-4cc0-be8c-477cdb4e85dc req-077bbbbc-cf79-4d2a-93bf-9d527fc66ee0 service nova] Acquiring lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b345460a-7c9b-4cc0-be8c-477cdb4e85dc req-077bbbbc-cf79-4d2a-93bf-9d527fc66ee0 service nova] Lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b345460a-7c9b-4cc0-be8c-477cdb4e85dc req-077bbbbc-cf79-4d2a-93bf-9d527fc66ee0 service nova] Lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.compute.manager [req-b345460a-7c9b-4cc0-be8c-477cdb4e85dc req-077bbbbc-cf79-4d2a-93bf-9d527fc66ee0 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] No waiting events found dispatching network-vif-plugged-d924dd21-056e-413d-8fc1-493933e7e7e6 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:49:30 user nova-compute[75247]: WARNING nova.compute.manager [req-b345460a-7c9b-4cc0-be8c-477cdb4e85dc req-077bbbbc-cf79-4d2a-93bf-9d527fc66ee0 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Received unexpected event network-vif-plugged-d924dd21-056e-413d-8fc1-493933e7e7e6 for instance with vm_state building and task_state spawning.
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:49:30 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Instance spawned successfully.
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:49:30 user nova-compute[75247]: INFO nova.compute.manager [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Took 8.07 seconds to spawn the instance on the hypervisor.
Dec 06 12:49:30 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:49:30 user nova-compute[75247]: INFO nova.compute.manager [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Took 10.42 seconds to build instance.
Dec 06 12:49:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6add1011-d5ed-4eee-8a9c-2322093cd3ea tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "530cfb75-7aa8-4e57-b282-8f7a21401b34" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.547s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:31 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a7113836-350f-4ef2-a64e-418c34e2446f is timed out.
Dec 06 12:49:31 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Successfully detached device vdb from instance a7113836-350f-4ef2-a64e-418c34e2446f from the live domain config.
Dec 06 12:49:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FIvwdrzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:49:31 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:49:31 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[306880b1-f3a4-48c0-b248-840b705931e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:49:31 user nova-compute[75247]: No targets found.
Dec 06 12:49:31 user nova-compute[75247]: iSNS:
Dec 06 12:49:31 user nova-compute[75247]: No targets found.
Dec 06 12:49:31 user nova-compute[75247]: STATIC:
Dec 06 12:49:31 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:49:31 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:49:31 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:49:31 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579
Dec 06 12:49:31 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:49:31 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:49:31 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a
Dec 06 12:49:31 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:49:31 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:49:31 user nova-compute[75247]: FIRMWARE:
Dec 06 12:49:31 user nova-compute[75247]: No targets found.
Dec 06 12:49:31 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:49:31 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:49:31 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93d8bcd-ded7-433c-a51e-a64d33ee881a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f5f4f9-b939-4026-81a5-84652fdb7ff4]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:49:31 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:49:31 user nova-compute[75247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a (non-flash)
Dec 06 12:49:31 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:49:31 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:49:31 user nova-compute[75247]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a (non-flash)
Dec 06 12:49:31 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c6131c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a'): ({'sdb'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Removing single pathed devices sdb {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b8b8ac-c178-4dda-8fea-28d145068197]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cced6c00-5ead-4d4e-a245-f98460680ae4]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Flushing IO for device /dev/sdb {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa34512-7f87-4d8b-818a-749ac0310fc4]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb2167a-fbc3-461e-a50f-ffff750bf88c]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9ae84a-e0d9-4581-8c5d-234d748b4151]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[07665b52-51b4-48a6-80ef-168df833ea89]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a, portal: 172.16.0.220,3260]
Dec 06 12:49:31 user nova-compute[75247]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a, portal: 172.16.0.220,3260] successful.
Dec 06 12:49:31 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e78a51d4-9cef-471f-8af7-22504a7e913a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[94323287-22be-4aca-9e9e-7c3d4c47d9eb]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] <== disconnect_volume: return (358ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:49:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:49:32 user nova-compute[75247]: DEBUG nova.objects.instance [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lazy-loading 'flavor' on Instance uuid a7113836-350f-4ef2-a64e-418c34e2446f {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:49:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b3a66e19-0679-481d-a027-ace361dd6b3e tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "a7113836-350f-4ef2-a64e-418c34e2446f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.970s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:41 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b is timed out.
Dec 06 12:49:41 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Successfully detached device vdb from instance cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b from the live domain config.
Dec 06 12:49:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sfnVXxkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:49:41 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:49:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad59d4d-28bf-448c-b830-8bcb272929f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:49:41 user nova-compute[75247]: No targets found.
Dec 06 12:49:41 user nova-compute[75247]: iSNS:
Dec 06 12:49:41 user nova-compute[75247]: No targets found.
Dec 06 12:49:41 user nova-compute[75247]: STATIC:
Dec 06 12:49:41 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:49:41 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:49:41 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:49:41 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579
Dec 06 12:49:41 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:49:41 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:49:41 user nova-compute[75247]: FIRMWARE:
Dec 06 12:49:41 user nova-compute[75247]: No targets found.
Dec 06 12:49:41 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:49:41 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:49:41 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dae9047-42bd-4262-b93c-cd6efc3221c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e02e74-2858-4113-92f4-eda51fa026a3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:49:41 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:49:41 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:49:41 user nova-compute[75247]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 (non-flash)
Dec 06 12:49:41 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c689bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579'): ({'sdh'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Removing single pathed devices sdh {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fd1b47-fb92-42f2-9105-b543c701654f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5187297a-98fb-4deb-aa55-f52bfd3aadcf]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Flushing IO for device /dev/sdh {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5792b7dc-755b-49f9-857c-69bdd01024eb]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[df97898d-7174-46d0-9d47-0b5193b5ce24]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] SCSI volumes sdh have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1fa1d3-1cca-4e35-a045-8a8860c2831c]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c71fd0-4428-4962-b9a7-466df26f8fc9]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579, portal: 172.16.0.220,3260]
Dec 06 12:49:41 user nova-compute[75247]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579, portal: 172.16.0.220,3260] successful.
Dec 06 12:49:41 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4933a54b-1240-4fda-8beb-b2d5cb8ed579 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce2cde9-2e63-4c64-9225-f0fddcd6f651]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] <== disconnect_volume: return (342ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:49:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:49:42 user nova-compute[75247]: DEBUG nova.objects.instance [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lazy-loading 'flavor' on Instance uuid cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:49:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f128a165-6149-4893-bb61-386e8c652115 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.166s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Acquiring lock "db837c7a-c52d-469b-abf7-cea107454c60" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "db837c7a-c52d-469b-abf7-cea107454c60" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:43 user nova-compute[75247]: DEBUG nova.objects.instance [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lazy-loading 'flavor' on Instance uuid db837c7a-c52d-469b-abf7-cea107454c60 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:49:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "db837c7a-c52d-469b-abf7-cea107454c60" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Acquiring lock "db837c7a-c52d-469b-abf7-cea107454c60" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "db837c7a-c52d-469b-abf7-cea107454c60" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:43 user nova-compute[75247]: INFO nova.compute.manager [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Attaching volume 0262f2d3-7689-4ed3-90cd-aa4535135c65 to /dev/vdb
Dec 06 12:49:44 user nova-compute[75247]: DEBUG os_brick.utils [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:49:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:44 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f61265c-5881-45e8-8af8-aabd12ce34b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:44 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a83dd5-aa3c-4fff-ac74-ed98040723f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:44 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[427f1dc3-c93e-4e93-82be-3148ec74d870]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:44 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[366ebee1-cc60-4cba-b070-49d68abb7c6b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:49:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:49:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:49:44 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:49:44 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[23efd50d-451d-4cd1-9459-b0590839d5cf]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:49:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:49:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:49:44 user nova-compute[75247]: DEBUG os_brick.utils [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:49:44 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Updating existing volume attachment record: eeb86412-acef-4f13-9b7b-337f5a7cfe79 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:49:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:49:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDLdVmPj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:49:53 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:49:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:49:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:49:53 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:49:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:49:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:49:53 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:49:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:53 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97343a8-2e37-4777-9072-8a0f692beb9f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:49:53 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:53 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[361bd814-9967-40b8-b629-50ff7bc1f595]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65] added
Dec 06 12:49:53 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:53 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c147bdab-6498-4efb-824f-78bcbc3d2d33]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:53 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[95179eb4-822c-443a-ba6d-3992b735d048]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDLdVmPj {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDLdVmPj" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:53 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7ff32b-23b0-496a-b121-e6c8ff27b9c0]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qDLdVmPj'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70b5175-7c76-4b26-a24b-1d1c66ffe169]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fc1f52-7f48-497e-9512-879722d883cc]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:49:54 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:49:54 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[397a34e2-98e9-4b3c-a92e-a1768859de36]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65, portal: 172.16.0.220,3260]
Dec 06 12:49:54 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65, portal: 172.16.0.220,3260] successful.
Dec 06 12:49:54 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b468bdee-65ad-45be-b9c7-439f9b4c8fb3]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9bb6a7-526c-47fd-90d0-78b85ce35c85]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:49:54 user nova-compute[75247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)
Dec 06 12:49:54 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:49:54 user nova-compute[75247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)
Dec 06 12:49:54 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc3b02a-1c1f-48b7-90e1-992c96b1a152]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:49:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDLdVmPj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:49:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:49:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23265666630616434', 'path': '/dev/sdb'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:49:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265666630616434', 'path': '/dev/sdb'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:49:55 user nova-compute[75247]: DEBUG nova.objects.instance [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lazy-loading 'flavor' on Instance uuid db837c7a-c52d-469b-abf7-cea107454c60 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:49:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 12:49:55 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:49:55 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:49:55 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:49:55 user nova-compute[75247]:   <serial>0262f2d3-7689-4ed3-90cd-aa4535135c65</serial>
Dec 06 12:49:55 user nova-compute[75247]: </disk>
Dec 06 12:49:55 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 12:49:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:49:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:49:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] No VIF found with MAC fa:16:3e:eb:bc:82, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:49:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7b85b29b-a3c2-4199-9b36-f42d3cf1e219 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "db837c7a-c52d-469b-abf7-cea107454c60" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.869s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:57 user nova-compute[75247]: INFO nova.compute.manager [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Rescuing
Dec 06 12:49:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Acquiring lock "refresh_cache-db837c7a-c52d-469b-abf7-cea107454c60" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:49:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Acquired lock "refresh_cache-db837c7a-c52d-469b-abf7-cea107454c60" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:49:57 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:49:57 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Updating instance_info_cache with network_info: [{"id": "861bfd56-2888-46b4-b583-08526d05bcd6", "address": "fa:16:3e:eb:bc:82", "network": {"id": "52a97bc9-88b7-430a-80c8-3d6210441943", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1761062078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8f578ae9d44706b68eaac234ae6d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861bfd56-28", "ovs_interfaceid": "861bfd56-2888-46b4-b583-08526d05bcd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:49:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Releasing lock "refresh_cache-db837c7a-c52d-469b-abf7-cea107454c60" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:49:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:58 user nova-compute[75247]: DEBUG nova.compute.manager [req-19e0f9a8-a136-4fff-9122-d22c3b97abfb req-9cc4a36f-9ca1-4c82-a7df-7cf526a053e2 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received event network-vif-unplugged-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:49:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-19e0f9a8-a136-4fff-9122-d22c3b97abfb req-9cc4a36f-9ca1-4c82-a7df-7cf526a053e2 service nova] Acquiring lock "db837c7a-c52d-469b-abf7-cea107454c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-19e0f9a8-a136-4fff-9122-d22c3b97abfb req-9cc4a36f-9ca1-4c82-a7df-7cf526a053e2 service nova] Lock "db837c7a-c52d-469b-abf7-cea107454c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-19e0f9a8-a136-4fff-9122-d22c3b97abfb req-9cc4a36f-9ca1-4c82-a7df-7cf526a053e2 service nova] Lock "db837c7a-c52d-469b-abf7-cea107454c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:58 user nova-compute[75247]: DEBUG nova.compute.manager [req-19e0f9a8-a136-4fff-9122-d22c3b97abfb req-9cc4a36f-9ca1-4c82-a7df-7cf526a053e2 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] No waiting events found dispatching network-vif-unplugged-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:49:58 user nova-compute[75247]: WARNING nova.compute.manager [req-19e0f9a8-a136-4fff-9122-d22c3b97abfb req-9cc4a36f-9ca1-4c82-a7df-7cf526a053e2 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received unexpected event network-vif-unplugged-861bfd56-2888-46b4-b583-08526d05bcd6 for instance with vm_state active and task_state rescuing.
Dec 06 12:49:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:58 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Instance destroyed successfully.
Dec 06 12:49:58 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Attempting a stable device rescue
Dec 06 12:49:58 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75247) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 06 12:49:58 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Instance directory exists: not creating {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 06 12:49:58 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Creating image(s)
Dec 06 12:49:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Acquiring lock "/opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "/opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "/opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:49:58 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lazy-loading 'trusted_certs' on Instance uuid db837c7a-c52d-469b-abf7-cea107454c60 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:49:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Acquiring lock "f8fe714629c0306419dd2e75262b1e2b9b7272f2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:49:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "f8fe714629c0306419dd2e75262b1e2b9b7272f2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:49:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8fe714629c0306419dd2e75262b1e2b9b7272f2.part --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:49:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:49:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8fe714629c0306419dd2e75262b1e2b9b7272f2.part --force-share --output=json" returned: 0 in 0.244s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:49:59 user nova-compute[75247]: DEBUG nova.virt.images [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] 595a1cdd-2909-48bc-a35c-273ac8a0b97f was qcow2, converting to raw {{(pid=75247) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 12:49:59 user nova-compute[75247]: DEBUG nova.privsep.utils [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 12:49:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f8fe714629c0306419dd2e75262b1e2b9b7272f2.part /opt/stack/data/nova/instances/_base/f8fe714629c0306419dd2e75262b1e2b9b7272f2.converted {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f8fe714629c0306419dd2e75262b1e2b9b7272f2.part /opt/stack/data/nova/instances/_base/f8fe714629c0306419dd2e75262b1e2b9b7272f2.converted" returned: 0 in 0.245s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8fe714629c0306419dd2e75262b1e2b9b7272f2.converted --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.compute.manager [req-7633b312-4246-41d0-87e8-5650186ad685 req-390b8a61-ee29-4216-b333-db9d210874b4 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received event network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7633b312-4246-41d0-87e8-5650186ad685 req-390b8a61-ee29-4216-b333-db9d210874b4 service nova] Acquiring lock "db837c7a-c52d-469b-abf7-cea107454c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7633b312-4246-41d0-87e8-5650186ad685 req-390b8a61-ee29-4216-b333-db9d210874b4 service nova] Lock "db837c7a-c52d-469b-abf7-cea107454c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7633b312-4246-41d0-87e8-5650186ad685 req-390b8a61-ee29-4216-b333-db9d210874b4 service nova] Lock "db837c7a-c52d-469b-abf7-cea107454c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.compute.manager [req-7633b312-4246-41d0-87e8-5650186ad685 req-390b8a61-ee29-4216-b333-db9d210874b4 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] No waiting events found dispatching network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:50:00 user nova-compute[75247]: WARNING nova.compute.manager [req-7633b312-4246-41d0-87e8-5650186ad685 req-390b8a61-ee29-4216-b333-db9d210874b4 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received unexpected event network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 for instance with vm_state active and task_state rescuing.
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8fe714629c0306419dd2e75262b1e2b9b7272f2.converted --force-share --output=json" returned: 0 in 0.218s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "f8fe714629c0306419dd2e75262b1e2b9b7272f2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.572s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Acquiring lock "f8fe714629c0306419dd2e75262b1e2b9b7272f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "f8fe714629c0306419dd2e75262b1e2b9b7272f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8fe714629c0306419dd2e75262b1e2b9b7272f2 --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8fe714629c0306419dd2e75262b1e2b9b7272f2 --force-share --output=json" returned: 0 in 0.176s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f8fe714629c0306419dd2e75262b1e2b9b7272f2,backing_fmt=raw /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk.rescue {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f8fe714629c0306419dd2e75262b1e2b9b7272f2,backing_fmt=raw /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk.rescue" returned: 0 in 0.051s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "f8fe714629c0306419dd2e75262b1e2b9b7272f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lazy-loading 'migration_context' on Instance uuid db837c7a-c52d-469b-abf7-cea107454c60 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.objects.base [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Object Instance<db837c7a-c52d-469b-abf7-cea107454c60> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Start _get_guest_xml network_info=[{"id": "861bfd56-2888-46b4-b583-08526d05bcd6", "address": "fa:16:3e:eb:bc:82", "network": {"id": "52a97bc9-88b7-430a-80c8-3d6210441943", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1761062078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1761062078-network", "vif_mac": "fa:16:3e:eb:bc:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8f578ae9d44706b68eaac234ae6d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861bfd56-28", "ovs_interfaceid": "861bfd56-2888-46b4-b583-08526d05bcd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '595a1cdd-2909-48bc-a35c-273ac8a0b97f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'eeb86412-acef-4f13-9b7b-337f5a7cfe79', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDLdVmPj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'db837c7a-c52d-469b-abf7-cea107454c60', 'attached_at': '', 'detached_at': '', 'volume_id': '0262f2d3-7689-4ed3-90cd-aa4535135c65', 'serial': '0262f2d3-7689-4ed3-90cd-aa4535135c65'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lazy-loading 'resources' on Instance uuid db837c7a-c52d-469b-abf7-cea107454c60 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.objects.base [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Object Instance<db837c7a-c52d-469b-abf7-cea107454c60> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lazy-loading 'numa_topology' on Instance uuid db837c7a-c52d-469b-abf7-cea107454c60 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.objects.base [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Object Instance<db837c7a-c52d-469b-abf7-cea107454c60> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:50:00 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:50:00 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lazy-loading 'vcpu_model' on Instance uuid db837c7a-c52d-469b-abf7-cea107454c60 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.objects.base [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Object Instance<db837c7a-c52d-469b-abf7-cea107454c60> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDLdVmPj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:50:00 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:50:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:50:00 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:50:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:50:00 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd34760-28c6-4b61-95af-d1e4f0d45b67]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = qDLdVmPj\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 06 12:50:00 user nova-compute[75247]: node.name = iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65
Dec 06 12:50:00 user nova-compute[75247]: node.tpgt = -1
Dec 06 12:50:00 user nova-compute[75247]: node.startup = automatic
Dec 06 12:50:00 user nova-compute[75247]: node.leading_login = No
Dec 06 12:50:00 user nova-compute[75247]: iface.iscsi_ifacename = default
Dec 06 12:50:00 user nova-compute[75247]: iface.net_ifacename = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.ipaddress = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.prefix_len = 0
Dec 06 12:50:00 user nova-compute[75247]: iface.hwaddress = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.transport_name = tcp
Dec 06 12:50:00 user nova-compute[75247]: iface.initiatorname = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.state = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.vlan_id = 0
Dec 06 12:50:00 user nova-compute[75247]: iface.vlan_priority = 0
Dec 06 12:50:00 user nova-compute[75247]: iface.vlan_state = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.iface_num = 0
Dec 06 12:50:00 user nova-compute[75247]: iface.mtu = 0
Dec 06 12:50:00 user nova-compute[75247]: iface.port = 0
Dec 06 12:50:00 user nova-compute[75247]: iface.bootproto = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.subnet_mask = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.gateway = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.dhcp_alt_client_id_state = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.dhcp_alt_client_id = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.dhcp_dns = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.dhcp_learn_iqn = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.dhcp_req_vendor_id_state = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.dhcp_vendor_id_state = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.dhcp_vendor_id = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.dhcp_slp_da = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.fragmentation = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.gratuitous_arp = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.incoming_forwarding = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.tos_state = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.tos = 0
Dec 06 12:50:00 user nova-compute[75247]: iface.ttl = 0
Dec 06 12:50:00 user nova-compute[75247]: iface.delayed_ack = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.tcp_nagle = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.tcp_wsf_state = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.tcp_wsf = 0
Dec 06 12:50:00 user nova-compute[75247]: iface.tcp_timer_scale = 0
Dec 06 12:50:00 user nova-compute[75247]: iface.tcp_timestamp = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.redirect = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.def_task_mgmt_timeout = 0
Dec 06 12:50:00 user nova-compute[75247]: iface.header_digest = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.data_digest = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.immediate_data = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.initial_r2t = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.data_seq_inorder = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.data_pdu_inorder = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.erl = 0
Dec 06 12:50:00 user nova-compute[75247]: iface.max_receive_data_len = 0
Dec 06 12:50:00 user nova-compute[75247]: iface.first_burst_len = 0
Dec 06 12:50:00 user nova-compute[75247]: iface.max_outstanding_r2t = 0
Dec 06 12:50:00 user nova-compute[75247]: iface.max_burst_len = 0
Dec 06 12:50:00 user nova-compute[75247]: iface.chap_auth = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.bidi_chap = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.strict_login_compliance = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.discovery_auth = <empty>
Dec 06 12:50:00 user nova-compute[75247]: iface.discovery_logout = <empty>
Dec 06 12:50:00 user nova-compute[75247]: node.discovery_address = <empty>
Dec 06 12:50:00 user nova-compute[75247]: node.discovery_port = 0
Dec 06 12:50:00 user nova-compute[75247]: node.discovery_type = static
Dec 06 12:50:00 user nova-compute[75247]: node.session.initial_cmdsn = 0
Dec 06 12:50:00 user nova-compute[75247]: node.session.initial_login_retry_max = 8
Dec 06 12:50:00 user nova-compute[75247]: node.session.xmit_thread_priority = -20
Dec 06 12:50:00 user nova-compute[75247]: node.session.cmds_max = 128
Dec 06 12:50:00 user nova-compute[75247]: node.session.queue_depth = 32
Dec 06 12:50:00 user nova-compute[75247]: node.session.nr_sessions = 1
Dec 06 12:50:00 user nova-compute[75247]: node.session.auth.authmethod = CHAP
Dec 06 12:50:00 user nova-compute[75247]: node.session.auth.username = qDLdVmPj
Dec 06 12:50:00 user nova-compute[75247]: node.session.auth.password = ***
Dec 06 12:50:00 user nova-compute[75247]: node.session.auth.username_in = <empty>
Dec 06 12:50:00 user nova-compute[75247]: node.session.auth.password_in = <empty>
Dec 06 12:50:00 user nova-compute[75247]: node.session.auth.chap_algs = MD5
Dec 06 12:50:00 user nova-compute[75247]: node.session.timeo.replacement_timeout = 120
Dec 06 12:50:00 user nova-compute[75247]: node.session.err_timeo.abort_timeout = 15
Dec 06 12:50:00 user nova-compute[75247]: node.session.err_timeo.lu_reset_timeout = 30
Dec 06 12:50:00 user nova-compute[75247]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 06 12:50:00 user nova-compute[75247]: node.session.err_timeo.host_reset_timeout = 60
Dec 06 12:50:00 user nova-compute[75247]: node.session.iscsi.FastAbort = Yes
Dec 06 12:50:00 user nova-compute[75247]: node.session.iscsi.InitialR2T = No
Dec 06 12:50:00 user nova-compute[75247]: node.session.iscsi.ImmediateData = Yes
Dec 06 12:50:00 user nova-compute[75247]: node.session.iscsi.FirstBurstLength = 262144
Dec 06 12:50:00 user nova-compute[75247]: node.session.iscsi.MaxBurstLength = 16776192
Dec 06 12:50:00 user nova-compute[75247]: node.session.iscsi.DefaultTime2Retain = 0
Dec 06 12:50:00 user nova-compute[75247]: node.session.iscsi.DefaultTime2Wait = 2
Dec 06 12:50:00 user nova-compute[75247]: node.session.iscsi.MaxConnections = 1
Dec 06 12:50:00 user nova-compute[75247]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 06 12:50:00 user nova-compute[75247]: node.session.iscsi.ERL = 0
Dec 06 12:50:00 user nova-compute[75247]: node.session.scan = manual
Dec 06 12:50:00 user nova-compute[75247]: node.session.reopen_max = 0
Dec 06 12:50:00 user nova-compute[75247]: node.conn[0].address = 172.16.0.220
Dec 06 12:50:00 user nova-compute[75247]: node.conn[0].port = 3260
Dec 06 12:50:00 user nova-compute[75247]: node.conn[0].startup = manual
Dec 06 12:50:00 user nova-compute[75247]: node.conn[0].tcp.window_size = 524288
Dec 06 12:50:00 user nova-compute[75247]: node.conn[0].tcp.type_of_service = 0
Dec 06 12:50:00 user nova-compute[75247]: node.conn[0].timeo.logout_timeout = 15
Dec 06 12:50:00 user nova-compute[75247]: node.conn[0].timeo.login_timeout = 15
Dec 06 12:50:00 user nova-compute[75247]: node.conn[0].timeo.auth_timeout = 45
Dec 06 12:50:00 user nova-compute[75247]: node.conn[0].timeo.noop_out_interval = 5
Dec 06 12:50:00 user nova-compute[75247]: node.conn[0].timeo.noop_out_timeout = 5
Dec 06 12:50:00 user nova-compute[75247]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 06 12:50:00 user nova-compute[75247]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 06 12:50:00 user nova-compute[75247]: node.conn[0].iscsi.HeaderDigest = None
Dec 06 12:50:00 user nova-compute[75247]: node.conn[0].iscsi.DataDigest = None
Dec 06 12:50:00 user nova-compute[75247]: node.conn[0].iscsi.IFMarker = No
Dec 06 12:50:00 user nova-compute[75247]: node.conn[0].iscsi.OFMarker = No
Dec 06 12:50:00 user nova-compute[75247]: # END RECORD
Dec 06 12:50:00 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfdd1a4-9b2c-4ae4-960d-4dab610a0301]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7657e524-befc-4429-bd9a-843af1b6df6c]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDLdVmPj {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDLdVmPj" returned: 0 in 0.031s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15f15a0-c86e-471c-b65d-e321f4806d13]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qDLdVmPj'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3d7402-3962-4407-ae89-625b396d5303]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ecc748-d2fe-4a17-9987-e11ed09035de]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:50:00 user nova-compute[75247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)
Dec 06 12:50:00 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:50:00 user nova-compute[75247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)
Dec 06 12:50:00 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.168s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] HCTL ('33', '0', '0', 0) found on session 32 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6c514f-ede7-4f60-ad18-fc625d8592ed]: (4, ('0 0 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Searching for a device in session 32 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDLdVmPj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.194s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] <== connect_volume: return (195ms) {'type': 'block', 'scsi_wwn': '23265666630616434', 'path': '/dev/sdb'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265666630616434', 'path': '/dev/sdb'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:45:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1896743252',display_name='tempest-ServerStableDeviceRescueTest-server-1896743252',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1896743252',id=19,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvhU73cJfUZBM75WAXDtUdapcw/hxet4znGmOMjhn8KYsa3efoegt+QlsaxBfHHhjJbHGSMnEJuDsqMQgNWlux0I/2LXEwJscpwT1hYARyfH0pcXijK2MYWQok7t1Mf2Q==',key_name='tempest-keypair-203231955',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:46:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e8f578ae9d44706b68eaac234ae6d65',ramdisk_id='',reservation_id='r-1s4hdg20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-374729134',owner_user_name='tempest-ServerStableDeviceRescueTest-374729134-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:47:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4741ba4fd4f48d9a91b5c9d31b7a3ac',uuid=db837c7a-c52d-469b-abf7-cea107454c60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "861bfd56-2888-46b4-b583-08526d05bcd6", "address": "fa:16:3e:eb:bc:82", "network": {"id": "52a97bc9-88b7-430a-80c8-3d6210441943", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1761062078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1761062078-network", "vif_mac": "fa:16:3e:eb:bc:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8f578ae9d44706b68eaac234ae6d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861bfd56-28", "ovs_interfaceid": "861bfd56-2888-46b4-b583-08526d05bcd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Converting VIF {"id": "861bfd56-2888-46b4-b583-08526d05bcd6", "address": "fa:16:3e:eb:bc:82", "network": {"id": "52a97bc9-88b7-430a-80c8-3d6210441943", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1761062078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1761062078-network", "vif_mac": "fa:16:3e:eb:bc:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8f578ae9d44706b68eaac234ae6d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861bfd56-28", "ovs_interfaceid": "861bfd56-2888-46b4-b583-08526d05bcd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:bc:82,bridge_name='br-int',has_traffic_filtering=True,id=861bfd56-2888-46b4-b583-08526d05bcd6,network=Network(52a97bc9-88b7-430a-80c8-3d6210441943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap861bfd56-28') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lazy-loading 'pci_devices' on Instance uuid db837c7a-c52d-469b-abf7-cea107454c60 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.objects.base [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Object Instance<db837c7a-c52d-469b-abf7-cea107454c60> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:50:00 user nova-compute[75247]:   <uuid>db837c7a-c52d-469b-abf7-cea107454c60</uuid>
Dec 06 12:50:00 user nova-compute[75247]:   <name>instance-00000013</name>
Dec 06 12:50:00 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:50:00 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:50:00 user nova-compute[75247]:   <metadata>
Dec 06 12:50:00 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:50:00 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:50:00 user nova-compute[75247]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1896743252</nova:name>
Dec 06 12:50:00 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:50:00</nova:creationTime>
Dec 06 12:50:00 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:50:00 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:50:00 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:50:00 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:50:00 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:50:00 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:50:00 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:50:00 user nova-compute[75247]:       <nova:owner>
Dec 06 12:50:00 user nova-compute[75247]:         <nova:user uuid="c4741ba4fd4f48d9a91b5c9d31b7a3ac">tempest-ServerStableDeviceRescueTest-374729134-project-member</nova:user>
Dec 06 12:50:00 user nova-compute[75247]:         <nova:project uuid="3e8f578ae9d44706b68eaac234ae6d65">tempest-ServerStableDeviceRescueTest-374729134</nova:project>
Dec 06 12:50:00 user nova-compute[75247]:       </nova:owner>
Dec 06 12:50:00 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:50:00 user nova-compute[75247]:       <nova:ports>
Dec 06 12:50:00 user nova-compute[75247]:         <nova:port uuid="861bfd56-2888-46b4-b583-08526d05bcd6">
Dec 06 12:50:00 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 06 12:50:00 user nova-compute[75247]:         </nova:port>
Dec 06 12:50:00 user nova-compute[75247]:       </nova:ports>
Dec 06 12:50:00 user nova-compute[75247]:     </nova:instance>
Dec 06 12:50:00 user nova-compute[75247]:   </metadata>
Dec 06 12:50:00 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:50:00 user nova-compute[75247]:     <system>
Dec 06 12:50:00 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:50:00 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:50:00 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:50:00 user nova-compute[75247]:       <entry name="serial">db837c7a-c52d-469b-abf7-cea107454c60</entry>
Dec 06 12:50:00 user nova-compute[75247]:       <entry name="uuid">db837c7a-c52d-469b-abf7-cea107454c60</entry>
Dec 06 12:50:00 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:50:00 user nova-compute[75247]:     </system>
Dec 06 12:50:00 user nova-compute[75247]:   </sysinfo>
Dec 06 12:50:00 user nova-compute[75247]:   <os>
Dec 06 12:50:00 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:50:00 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:50:00 user nova-compute[75247]:   </os>
Dec 06 12:50:00 user nova-compute[75247]:   <features>
Dec 06 12:50:00 user nova-compute[75247]:     <acpi/>
Dec 06 12:50:00 user nova-compute[75247]:     <apic/>
Dec 06 12:50:00 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:50:00 user nova-compute[75247]:   </features>
Dec 06 12:50:00 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:50:00 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:50:00 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:50:00 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:50:00 user nova-compute[75247]:   </clock>
Dec 06 12:50:00 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:50:00 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:50:00 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:50:00 user nova-compute[75247]:   </cpu>
Dec 06 12:50:00 user nova-compute[75247]:   <devices>
Dec 06 12:50:00 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:50:00 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:50:00 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk"/>
Dec 06 12:50:00 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:50:00 user nova-compute[75247]:     </disk>
Dec 06 12:50:00 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 12:50:00 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:50:00 user nova-compute[75247]:       <source dev="/dev/sdb"/>
Dec 06 12:50:00 user nova-compute[75247]:       <target dev="vdb" bus="virtio"/>
Dec 06 12:50:00 user nova-compute[75247]:       <serial>0262f2d3-7689-4ed3-90cd-aa4535135c65</serial>
Dec 06 12:50:00 user nova-compute[75247]:     </disk>
Dec 06 12:50:00 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:50:00 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:50:00 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk.rescue"/>
Dec 06 12:50:00 user nova-compute[75247]:       <target dev="vdc" bus="virtio"/>
Dec 06 12:50:00 user nova-compute[75247]:       <boot order="1"/>
Dec 06 12:50:00 user nova-compute[75247]:     </disk>
Dec 06 12:50:00 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:50:00 user nova-compute[75247]:       <mac address="fa:16:3e:eb:bc:82"/>
Dec 06 12:50:00 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:50:00 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:50:00 user nova-compute[75247]:       <target dev="tap861bfd56-28"/>
Dec 06 12:50:00 user nova-compute[75247]:     </interface>
Dec 06 12:50:00 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:50:00 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/console.log" append="off"/>
Dec 06 12:50:00 user nova-compute[75247]:     </serial>
Dec 06 12:50:00 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:50:00 user nova-compute[75247]:     <video>
Dec 06 12:50:00 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:50:00 user nova-compute[75247]:     </video>
Dec 06 12:50:00 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:50:00 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:50:00 user nova-compute[75247]:     </rng>
Dec 06 12:50:00 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:50:00 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:50:00 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:50:00 user nova-compute[75247]:     </memballoon>
Dec 06 12:50:00 user nova-compute[75247]:   </devices>
Dec 06 12:50:00 user nova-compute[75247]: </domain>
Dec 06 12:50:00 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:50:00 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Instance destroyed successfully.
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:50:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] No VIF found with MAC fa:16:3e:eb:bc:82, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:50:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4624b55f-fa2e-4fd1-9444-a6eeb3f8bbe2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "a7113836-350f-4ef2-a64e-418c34e2446f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4624b55f-fa2e-4fd1-9444-a6eeb3f8bbe2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "a7113836-350f-4ef2-a64e-418c34e2446f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4624b55f-fa2e-4fd1-9444-a6eeb3f8bbe2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "a7113836-350f-4ef2-a64e-418c34e2446f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4624b55f-fa2e-4fd1-9444-a6eeb3f8bbe2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "a7113836-350f-4ef2-a64e-418c34e2446f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4624b55f-fa2e-4fd1-9444-a6eeb3f8bbe2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "a7113836-350f-4ef2-a64e-418c34e2446f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:01 user nova-compute[75247]: INFO nova.compute.manager [None req-4624b55f-fa2e-4fd1-9444-a6eeb3f8bbe2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Terminating instance
Dec 06 12:50:01 user nova-compute[75247]: DEBUG nova.compute.manager [None req-4624b55f-fa2e-4fd1-9444-a6eeb3f8bbe2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:50:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:01 user nova-compute[75247]: DEBUG nova.compute.manager [req-7bee32b1-4b5d-409a-aac5-70cb409ccb2c req-8192cd7d-33b6-40ee-984b-30641d14ecdf service nova] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Received event network-vif-unplugged-23d45868-6be3-4f57-8579-243f11b02597 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:50:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7bee32b1-4b5d-409a-aac5-70cb409ccb2c req-8192cd7d-33b6-40ee-984b-30641d14ecdf service nova] Acquiring lock "a7113836-350f-4ef2-a64e-418c34e2446f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7bee32b1-4b5d-409a-aac5-70cb409ccb2c req-8192cd7d-33b6-40ee-984b-30641d14ecdf service nova] Lock "a7113836-350f-4ef2-a64e-418c34e2446f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7bee32b1-4b5d-409a-aac5-70cb409ccb2c req-8192cd7d-33b6-40ee-984b-30641d14ecdf service nova] Lock "a7113836-350f-4ef2-a64e-418c34e2446f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:01 user nova-compute[75247]: DEBUG nova.compute.manager [req-7bee32b1-4b5d-409a-aac5-70cb409ccb2c req-8192cd7d-33b6-40ee-984b-30641d14ecdf service nova] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] No waiting events found dispatching network-vif-unplugged-23d45868-6be3-4f57-8579-243f11b02597 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:50:01 user nova-compute[75247]: DEBUG nova.compute.manager [req-7bee32b1-4b5d-409a-aac5-70cb409ccb2c req-8192cd7d-33b6-40ee-984b-30641d14ecdf service nova] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Received event network-vif-unplugged-23d45868-6be3-4f57-8579-243f11b02597 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:50:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:02 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Instance destroyed successfully.
Dec 06 12:50:02 user nova-compute[75247]: DEBUG nova.objects.instance [None req-4624b55f-fa2e-4fd1-9444-a6eeb3f8bbe2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lazy-loading 'resources' on Instance uuid a7113836-350f-4ef2-a64e-418c34e2446f {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:50:02 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-4624b55f-fa2e-4fd1-9444-a6eeb3f8bbe2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1299360918',display_name='tempest-AttachVolumeNegativeTest-server-1299360918',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1299360918',id=22,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHB05nkIgRjgJM3Lm5cUUVaQJnLpkIwP2H3SKCTlnE5d1PtMJs736XxTowim1eosP/BaYDzis1F8dvoMv0Fjgu7Vrl6JhpBZluK2TQyUg5AO8jfC9Ed6rtmrK4//wA4wjg==',key_name='tempest-keypair-1695380448',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:47:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a6b077946334f1c8fd16d091a7738e1',ramdisk_id='',reservation_id='r-pd6phllj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2136789566',owner_user_name='tempest-AttachVolumeNegativeTest-2136789566-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:47:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d7becd4d5734bc2b652e6f37492eb5e',uuid=a7113836-350f-4ef2-a64e-418c34e2446f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23d45868-6be3-4f57-8579-243f11b02597", "address": "fa:16:3e:44:69:6b", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d45868-6b", "ovs_interfaceid": "23d45868-6be3-4f57-8579-243f11b02597", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:50:02 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-4624b55f-fa2e-4fd1-9444-a6eeb3f8bbe2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Converting VIF {"id": "23d45868-6be3-4f57-8579-243f11b02597", "address": "fa:16:3e:44:69:6b", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d45868-6b", "ovs_interfaceid": "23d45868-6be3-4f57-8579-243f11b02597", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:50:02 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-4624b55f-fa2e-4fd1-9444-a6eeb3f8bbe2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:69:6b,bridge_name='br-int',has_traffic_filtering=True,id=23d45868-6be3-4f57-8579-243f11b02597,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23d45868-6b') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:50:02 user nova-compute[75247]: DEBUG os_vif [None req-4624b55f-fa2e-4fd1-9444-a6eeb3f8bbe2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:69:6b,bridge_name='br-int',has_traffic_filtering=True,id=23d45868-6be3-4f57-8579-243f11b02597,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23d45868-6b') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:50:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23d45868-6b, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:50:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:50:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97378075-fcb1-42b1-9880-65627fcfea5d) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:50:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:02 user nova-compute[75247]: INFO os_vif [None req-4624b55f-fa2e-4fd1-9444-a6eeb3f8bbe2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:69:6b,bridge_name='br-int',has_traffic_filtering=True,id=23d45868-6be3-4f57-8579-243f11b02597,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23d45868-6b')
Dec 06 12:50:02 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-4624b55f-fa2e-4fd1-9444-a6eeb3f8bbe2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Deleting instance files /opt/stack/data/nova/instances/a7113836-350f-4ef2-a64e-418c34e2446f_del
Dec 06 12:50:02 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-4624b55f-fa2e-4fd1-9444-a6eeb3f8bbe2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Deletion of /opt/stack/data/nova/instances/a7113836-350f-4ef2-a64e-418c34e2446f_del complete
Dec 06 12:50:02 user nova-compute[75247]: INFO nova.compute.manager [None req-4624b55f-fa2e-4fd1-9444-a6eeb3f8bbe2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Took 1.67 seconds to destroy the instance on the hypervisor.
Dec 06 12:50:02 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-4624b55f-fa2e-4fd1-9444-a6eeb3f8bbe2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:50:02 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:50:02 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:50:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-077bece9-c3c3-486f-8b71-d164070894b7 req-99afcc91-fbc0-41c1-9d68-d608c55225fe service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received event network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:50:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-077bece9-c3c3-486f-8b71-d164070894b7 req-99afcc91-fbc0-41c1-9d68-d608c55225fe service nova] Acquiring lock "db837c7a-c52d-469b-abf7-cea107454c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-077bece9-c3c3-486f-8b71-d164070894b7 req-99afcc91-fbc0-41c1-9d68-d608c55225fe service nova] Lock "db837c7a-c52d-469b-abf7-cea107454c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-077bece9-c3c3-486f-8b71-d164070894b7 req-99afcc91-fbc0-41c1-9d68-d608c55225fe service nova] Lock "db837c7a-c52d-469b-abf7-cea107454c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-077bece9-c3c3-486f-8b71-d164070894b7 req-99afcc91-fbc0-41c1-9d68-d608c55225fe service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] No waiting events found dispatching network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:50:03 user nova-compute[75247]: WARNING nova.compute.manager [req-077bece9-c3c3-486f-8b71-d164070894b7 req-99afcc91-fbc0-41c1-9d68-d608c55225fe service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received unexpected event network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 for instance with vm_state active and task_state rescuing.
Dec 06 12:50:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-b4a52a1b-095d-4dd9-912a-356f26db9410 req-af8039f8-abc5-416f-b8d9-023f87e641e0 service nova] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Received event network-vif-plugged-23d45868-6be3-4f57-8579-243f11b02597 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:50:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b4a52a1b-095d-4dd9-912a-356f26db9410 req-af8039f8-abc5-416f-b8d9-023f87e641e0 service nova] Acquiring lock "a7113836-350f-4ef2-a64e-418c34e2446f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b4a52a1b-095d-4dd9-912a-356f26db9410 req-af8039f8-abc5-416f-b8d9-023f87e641e0 service nova] Lock "a7113836-350f-4ef2-a64e-418c34e2446f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b4a52a1b-095d-4dd9-912a-356f26db9410 req-af8039f8-abc5-416f-b8d9-023f87e641e0 service nova] Lock "a7113836-350f-4ef2-a64e-418c34e2446f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-b4a52a1b-095d-4dd9-912a-356f26db9410 req-af8039f8-abc5-416f-b8d9-023f87e641e0 service nova] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] No waiting events found dispatching network-vif-plugged-23d45868-6be3-4f57-8579-243f11b02597 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:50:03 user nova-compute[75247]: WARNING nova.compute.manager [req-b4a52a1b-095d-4dd9-912a-356f26db9410 req-af8039f8-abc5-416f-b8d9-023f87e641e0 service nova] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Received unexpected event network-vif-plugged-23d45868-6be3-4f57-8579-243f11b02597 for instance with vm_state active and task_state deleting.
Dec 06 12:50:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:04 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:50:04 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Took 1.36 seconds to deallocate network for instance.
Dec 06 12:50:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4624b55f-fa2e-4fd1-9444-a6eeb3f8bbe2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4624b55f-fa2e-4fd1-9444-a6eeb3f8bbe2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:04 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-4624b55f-fa2e-4fd1-9444-a6eeb3f8bbe2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:50:04 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-4624b55f-fa2e-4fd1-9444-a6eeb3f8bbe2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:50:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4624b55f-fa2e-4fd1-9444-a6eeb3f8bbe2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:04 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-4624b55f-fa2e-4fd1-9444-a6eeb3f8bbe2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Deleted allocations for instance a7113836-350f-4ef2-a64e-418c34e2446f
Dec 06 12:50:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4624b55f-fa2e-4fd1-9444-a6eeb3f8bbe2 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "a7113836-350f-4ef2-a64e-418c34e2446f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.644s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:04 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:50:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-e1f50c39-ae20-4f51-9e29-6e6cde92b156 req-246a57e9-1fd5-45a7-bdf0-5b04d0626793 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received event network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:50:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e1f50c39-ae20-4f51-9e29-6e6cde92b156 req-246a57e9-1fd5-45a7-bdf0-5b04d0626793 service nova] Acquiring lock "db837c7a-c52d-469b-abf7-cea107454c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e1f50c39-ae20-4f51-9e29-6e6cde92b156 req-246a57e9-1fd5-45a7-bdf0-5b04d0626793 service nova] Lock "db837c7a-c52d-469b-abf7-cea107454c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e1f50c39-ae20-4f51-9e29-6e6cde92b156 req-246a57e9-1fd5-45a7-bdf0-5b04d0626793 service nova] Lock "db837c7a-c52d-469b-abf7-cea107454c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-e1f50c39-ae20-4f51-9e29-6e6cde92b156 req-246a57e9-1fd5-45a7-bdf0-5b04d0626793 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] No waiting events found dispatching network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:50:05 user nova-compute[75247]: WARNING nova.compute.manager [req-e1f50c39-ae20-4f51-9e29-6e6cde92b156 req-246a57e9-1fd5-45a7-bdf0-5b04d0626793 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received unexpected event network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 for instance with vm_state active and task_state rescuing.
Dec 06 12:50:05 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c6a0fa1d-ec8a-4d08-a2bb-1b6ae4c78ca6 tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:50:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-23fc8a18-d12b-431a-9a03-259772318e61 req-032824f4-9bab-4bf3-8746-286728969ade service nova] [instance: a7113836-350f-4ef2-a64e-418c34e2446f] Received event network-vif-deleted-23d45868-6be3-4f57-8579-243f11b02597 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:50:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-191a4700-0c99-410f-ad5f-076b1413daa9 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-191a4700-0c99-410f-ad5f-076b1413daa9 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-191a4700-0c99-410f-ad5f-076b1413daa9 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-191a4700-0c99-410f-ad5f-076b1413daa9 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-191a4700-0c99-410f-ad5f-076b1413daa9 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:07 user nova-compute[75247]: INFO nova.compute.manager [None req-191a4700-0c99-410f-ad5f-076b1413daa9 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Terminating instance
Dec 06 12:50:07 user nova-compute[75247]: DEBUG nova.compute.manager [None req-191a4700-0c99-410f-ad5f-076b1413daa9 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:50:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG nova.compute.manager [req-8821fc10-78e9-4900-94b9-df8abb01eec3 req-eeceb329-6c1f-464c-87a8-9dab3c6c9ac3 service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Received event network-vif-unplugged-434efb9d-06e4-413b-b470-4952e114c298 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-8821fc10-78e9-4900-94b9-df8abb01eec3 req-eeceb329-6c1f-464c-87a8-9dab3c6c9ac3 service nova] Acquiring lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-8821fc10-78e9-4900-94b9-df8abb01eec3 req-eeceb329-6c1f-464c-87a8-9dab3c6c9ac3 service nova] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-8821fc10-78e9-4900-94b9-df8abb01eec3 req-eeceb329-6c1f-464c-87a8-9dab3c6c9ac3 service nova] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG nova.compute.manager [req-8821fc10-78e9-4900-94b9-df8abb01eec3 req-eeceb329-6c1f-464c-87a8-9dab3c6c9ac3 service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] No waiting events found dispatching network-vif-unplugged-434efb9d-06e4-413b-b470-4952e114c298 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG nova.compute.manager [req-8821fc10-78e9-4900-94b9-df8abb01eec3 req-eeceb329-6c1f-464c-87a8-9dab3c6c9ac3 service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Received event network-vif-unplugged-434efb9d-06e4-413b-b470-4952e114c298 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:08 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Instance destroyed successfully.
Dec 06 12:50:08 user nova-compute[75247]: DEBUG nova.objects.instance [None req-191a4700-0c99-410f-ad5f-076b1413daa9 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lazy-loading 'resources' on Instance uuid cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-191a4700-0c99-410f-ad5f-076b1413daa9 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T12:44:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2133511103',display_name='tempest-ServerActionsTestOtherA-server-1393924721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2133511103',id=16,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBDhQTUEw1R3RfVHPhzTtaiheMfD6p83eCfaICq1MZJ1xFdfRrt1xoh/Vh31BgL5j0HqUltFVWq6oXJAAH3kNbtsonPlpThgj+8ZXQcR+K3dodbuTA7Es5PaooP9IaaWg==',key_name='tempest-keypair-1057326227',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:46:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0ccf15765714ca2a8c4700d2d6e3ed2',ramdisk_id='',reservation_id='r-1mxkfe1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2075667053',owner_user_name='tempest-ServerActionsTestOtherA-2075667053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:46:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13843d8f074da189dbd3e93750b811',uuid=cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "434efb9d-06e4-413b-b470-4952e114c298", "address": "fa:16:3e:b5:b1:be", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434efb9d-06", "ovs_interfaceid": "434efb9d-06e4-413b-b470-4952e114c298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-191a4700-0c99-410f-ad5f-076b1413daa9 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converting VIF {"id": "434efb9d-06e4-413b-b470-4952e114c298", "address": "fa:16:3e:b5:b1:be", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434efb9d-06", "ovs_interfaceid": "434efb9d-06e4-413b-b470-4952e114c298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-191a4700-0c99-410f-ad5f-076b1413daa9 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:b1:be,bridge_name='br-int',has_traffic_filtering=True,id=434efb9d-06e4-413b-b470-4952e114c298,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434efb9d-06') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG os_vif [None req-191a4700-0c99-410f-ad5f-076b1413daa9 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:b1:be,bridge_name='br-int',has_traffic_filtering=True,id=434efb9d-06e4-413b-b470-4952e114c298,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434efb9d-06') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap434efb9d-06, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71be5a38-ee3e-45ab-ac08-d050a9f07d07) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:50:08 user nova-compute[75247]: INFO os_vif [None req-191a4700-0c99-410f-ad5f-076b1413daa9 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:b1:be,bridge_name='br-int',has_traffic_filtering=True,id=434efb9d-06e4-413b-b470-4952e114c298,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434efb9d-06')
Dec 06 12:50:08 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-191a4700-0c99-410f-ad5f-076b1413daa9 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Deleting instance files /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b_del
Dec 06 12:50:08 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-191a4700-0c99-410f-ad5f-076b1413daa9 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Deletion of /opt/stack/data/nova/instances/cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b_del complete
Dec 06 12:50:08 user nova-compute[75247]: INFO nova.compute.manager [None req-191a4700-0c99-410f-ad5f-076b1413daa9 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Took 1.06 seconds to destroy the instance on the hypervisor.
Dec 06 12:50:08 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-191a4700-0c99-410f-ad5f-076b1413daa9 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:50:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 12:50:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "56f7d945-3eae-4dbe-928e-389620e62353" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "56f7d945-3eae-4dbe-928e-389620e62353" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:09 user nova-compute[75247]: DEBUG nova.compute.manager [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:50:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:09 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:50:09 user nova-compute[75247]: INFO nova.compute.claims [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Claim successful on node user
Dec 06 12:50:10 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:50:10 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Took 1.25 seconds to deallocate network for instance.
Dec 06 12:50:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-191a4700-0c99-410f-ad5f-076b1413daa9 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-bdf9a99f-7449-4f43-b273-fa06e90be40c req-c376140c-d1ca-450c-8a8e-1ba527fbd51c service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Received event network-vif-plugged-434efb9d-06e4-413b-b470-4952e114c298 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:50:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bdf9a99f-7449-4f43-b273-fa06e90be40c req-c376140c-d1ca-450c-8a8e-1ba527fbd51c service nova] Acquiring lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bdf9a99f-7449-4f43-b273-fa06e90be40c req-c376140c-d1ca-450c-8a8e-1ba527fbd51c service nova] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bdf9a99f-7449-4f43-b273-fa06e90be40c req-c376140c-d1ca-450c-8a8e-1ba527fbd51c service nova] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-bdf9a99f-7449-4f43-b273-fa06e90be40c req-c376140c-d1ca-450c-8a8e-1ba527fbd51c service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] No waiting events found dispatching network-vif-plugged-434efb9d-06e4-413b-b470-4952e114c298 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:50:10 user nova-compute[75247]: WARNING nova.compute.manager [req-bdf9a99f-7449-4f43-b273-fa06e90be40c req-c376140c-d1ca-450c-8a8e-1ba527fbd51c service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Received unexpected event network-vif-plugged-434efb9d-06e4-413b-b470-4952e114c298 for instance with vm_state deleted and task_state None.
Dec 06 12:50:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-bdf9a99f-7449-4f43-b273-fa06e90be40c req-c376140c-d1ca-450c-8a8e-1ba527fbd51c service nova] [instance: cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b] Received event network-vif-deleted-434efb9d-06e4-413b-b470-4952e114c298 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:50:10 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:50:10 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:50:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:10 user nova-compute[75247]: DEBUG nova.compute.manager [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:50:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-191a4700-0c99-410f-ad5f-076b1413daa9 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.332s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:10 user nova-compute[75247]: DEBUG nova.compute.manager [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:50:10 user nova-compute[75247]: DEBUG nova.network.neutron [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:50:10 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:50:10 user nova-compute[75247]: DEBUG nova.compute.manager [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:50:11 user nova-compute[75247]: DEBUG nova.policy [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '35d1ce8c369941aab5effd18633a73b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58ba64f48e946098b72d7061d354ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:50:11 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:50:11 user nova-compute[75247]: DEBUG nova.compute.manager [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:50:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:50:11 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Creating image(s)
Dec 06 12:50:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "/opt/stack/data/nova/instances/56f7d945-3eae-4dbe-928e-389620e62353/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "/opt/stack/data/nova/instances/56f7d945-3eae-4dbe-928e-389620e62353/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "/opt/stack/data/nova/instances/56f7d945-3eae-4dbe-928e-389620e62353/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:11 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-191a4700-0c99-410f-ad5f-076b1413daa9 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:50:11 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-191a4700-0c99-410f-ad5f-076b1413daa9 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:50:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.204s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-191a4700-0c99-410f-ad5f-076b1413daa9 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.003s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:11 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-191a4700-0c99-410f-ad5f-076b1413daa9 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Deleted allocations for instance cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b
Dec 06 12:50:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.215s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/56f7d945-3eae-4dbe-928e-389620e62353/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/56f7d945-3eae-4dbe-928e-389620e62353/disk 1073741824" returned: 0 in 0.065s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-191a4700-0c99-410f-ad5f-076b1413daa9 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "cc9a78cf-f62e-45fa-b9fb-398d0ada9d4b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.966s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.185s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:11 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56f7d945-3eae-4dbe-928e-389620e62353/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:50:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f7d945-3eae-4dbe-928e-389620e62353/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:11 user nova-compute[75247]: DEBUG nova.network.neutron [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Successfully created port: e534a6f8-8e4b-4932-a4fc-bb5457532884 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:50:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f7d945-3eae-4dbe-928e-389620e62353/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:12 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Cannot resize image /opt/stack/data/nova/instances/56f7d945-3eae-4dbe-928e-389620e62353/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:50:12 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:50:12 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Ensure instance console log exists: /opt/stack/data/nova/instances/56f7d945-3eae-4dbe-928e-389620e62353/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:50:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:12 user nova-compute[75247]: DEBUG nova.network.neutron [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Successfully updated port: e534a6f8-8e4b-4932-a4fc-bb5457532884 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:50:12 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:50:12 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 12:50:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "refresh_cache-56f7d945-3eae-4dbe-928e-389620e62353" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:50:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquired lock "refresh_cache-56f7d945-3eae-4dbe-928e-389620e62353" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:50:12 user nova-compute[75247]: DEBUG nova.network.neutron [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:50:12 user nova-compute[75247]: DEBUG nova.compute.manager [req-d4307ded-bf2e-427c-9e3b-858edb5f31c4 req-7e7abd8a-135b-45e9-a7da-206c70ff12d9 service nova] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Received event network-changed-e534a6f8-8e4b-4932-a4fc-bb5457532884 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:50:12 user nova-compute[75247]: DEBUG nova.compute.manager [req-d4307ded-bf2e-427c-9e3b-858edb5f31c4 req-7e7abd8a-135b-45e9-a7da-206c70ff12d9 service nova] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Refreshing instance network info cache due to event network-changed-e534a6f8-8e4b-4932-a4fc-bb5457532884. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:50:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d4307ded-bf2e-427c-9e3b-858edb5f31c4 req-7e7abd8a-135b-45e9-a7da-206c70ff12d9 service nova] Acquiring lock "refresh_cache-56f7d945-3eae-4dbe-928e-389620e62353" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.network.neutron [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-3e1b5197-dc38-48a5-b9f9-e053be499433" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-3e1b5197-dc38-48a5-b9f9-e053be499433" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.network.neutron [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Updating instance_info_cache with network_info: [{"id": "e534a6f8-8e4b-4932-a4fc-bb5457532884", "address": "fa:16:3e:db:01:9e", "network": {"id": "24492570-dfe5-49d1-944e-7435cc85d347", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145359804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58ba64f48e946098b72d7061d354ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape534a6f8-8e", "ovs_interfaceid": "e534a6f8-8e4b-4932-a4fc-bb5457532884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Releasing lock "refresh_cache-56f7d945-3eae-4dbe-928e-389620e62353" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.compute.manager [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Instance network_info: |[{"id": "e534a6f8-8e4b-4932-a4fc-bb5457532884", "address": "fa:16:3e:db:01:9e", "network": {"id": "24492570-dfe5-49d1-944e-7435cc85d347", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145359804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58ba64f48e946098b72d7061d354ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape534a6f8-8e", "ovs_interfaceid": "e534a6f8-8e4b-4932-a4fc-bb5457532884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d4307ded-bf2e-427c-9e3b-858edb5f31c4 req-7e7abd8a-135b-45e9-a7da-206c70ff12d9 service nova] Acquired lock "refresh_cache-56f7d945-3eae-4dbe-928e-389620e62353" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.network.neutron [req-d4307ded-bf2e-427c-9e3b-858edb5f31c4 req-7e7abd8a-135b-45e9-a7da-206c70ff12d9 service nova] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Refreshing network info cache for port e534a6f8-8e4b-4932-a4fc-bb5457532884 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Start _get_guest_xml network_info=[{"id": "e534a6f8-8e4b-4932-a4fc-bb5457532884", "address": "fa:16:3e:db:01:9e", "network": {"id": "24492570-dfe5-49d1-944e-7435cc85d347", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145359804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58ba64f48e946098b72d7061d354ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape534a6f8-8e", "ovs_interfaceid": "e534a6f8-8e4b-4932-a4fc-bb5457532884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:50:13 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:50:13 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1851817514',display_name='tempest-VolumesSnapshotTestJSON-instance-1851817514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1851817514',id=27,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlaEQxmoA0L3aug9ccwc8KvY1t5swd1/gga557TcuwVpi+fT39pH/iAcfPvKjxl1HrLLZIn3Fk52w5DM6VLesOF2XN44zjUuPV0J4b6XeOweVgN7ZDlDjp+xCISQTVhjg==',key_name='tempest-keypair-261496105',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b58ba64f48e946098b72d7061d354ef3',ramdisk_id='',reservation_id='r-6t0bo18j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1940428801',owner_user_name='tempest-VolumesSnapshotTestJSON-1940428801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:50:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35d1ce8c369941aab5effd18633a73b0',uuid=56f7d945-3eae-4dbe-928e-389620e62353,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e534a6f8-8e4b-4932-a4fc-bb5457532884", "address": "fa:16:3e:db:01:9e", "network": {"id": "24492570-dfe5-49d1-944e-7435cc85d347", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145359804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58ba64f48e946098b72d7061d354ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape534a6f8-8e", "ovs_interfaceid": "e534a6f8-8e4b-4932-a4fc-bb5457532884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Converting VIF {"id": "e534a6f8-8e4b-4932-a4fc-bb5457532884", "address": "fa:16:3e:db:01:9e", "network": {"id": "24492570-dfe5-49d1-944e-7435cc85d347", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145359804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58ba64f48e946098b72d7061d354ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape534a6f8-8e", "ovs_interfaceid": "e534a6f8-8e4b-4932-a4fc-bb5457532884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:01:9e,bridge_name='br-int',has_traffic_filtering=True,id=e534a6f8-8e4b-4932-a4fc-bb5457532884,network=Network(24492570-dfe5-49d1-944e-7435cc85d347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape534a6f8-8e') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.objects.instance [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lazy-loading 'pci_devices' on Instance uuid 56f7d945-3eae-4dbe-928e-389620e62353 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:50:13 user nova-compute[75247]:   <uuid>56f7d945-3eae-4dbe-928e-389620e62353</uuid>
Dec 06 12:50:13 user nova-compute[75247]:   <name>instance-0000001b</name>
Dec 06 12:50:13 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:50:13 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:50:13 user nova-compute[75247]:   <metadata>
Dec 06 12:50:13 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:50:13 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:50:13 user nova-compute[75247]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1851817514</nova:name>
Dec 06 12:50:13 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:50:13</nova:creationTime>
Dec 06 12:50:13 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:50:13 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:50:13 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:50:13 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:50:13 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:50:13 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:50:13 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:50:13 user nova-compute[75247]:       <nova:owner>
Dec 06 12:50:13 user nova-compute[75247]:         <nova:user uuid="35d1ce8c369941aab5effd18633a73b0">tempest-VolumesSnapshotTestJSON-1940428801-project-member</nova:user>
Dec 06 12:50:13 user nova-compute[75247]:         <nova:project uuid="b58ba64f48e946098b72d7061d354ef3">tempest-VolumesSnapshotTestJSON-1940428801</nova:project>
Dec 06 12:50:13 user nova-compute[75247]:       </nova:owner>
Dec 06 12:50:13 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:50:13 user nova-compute[75247]:       <nova:ports>
Dec 06 12:50:13 user nova-compute[75247]:         <nova:port uuid="e534a6f8-8e4b-4932-a4fc-bb5457532884">
Dec 06 12:50:13 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 06 12:50:13 user nova-compute[75247]:         </nova:port>
Dec 06 12:50:13 user nova-compute[75247]:       </nova:ports>
Dec 06 12:50:13 user nova-compute[75247]:     </nova:instance>
Dec 06 12:50:13 user nova-compute[75247]:   </metadata>
Dec 06 12:50:13 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:50:13 user nova-compute[75247]:     <system>
Dec 06 12:50:13 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:50:13 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:50:13 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:50:13 user nova-compute[75247]:       <entry name="serial">56f7d945-3eae-4dbe-928e-389620e62353</entry>
Dec 06 12:50:13 user nova-compute[75247]:       <entry name="uuid">56f7d945-3eae-4dbe-928e-389620e62353</entry>
Dec 06 12:50:13 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:50:13 user nova-compute[75247]:     </system>
Dec 06 12:50:13 user nova-compute[75247]:   </sysinfo>
Dec 06 12:50:13 user nova-compute[75247]:   <os>
Dec 06 12:50:13 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:50:13 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:50:13 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:50:13 user nova-compute[75247]:   </os>
Dec 06 12:50:13 user nova-compute[75247]:   <features>
Dec 06 12:50:13 user nova-compute[75247]:     <acpi/>
Dec 06 12:50:13 user nova-compute[75247]:     <apic/>
Dec 06 12:50:13 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:50:13 user nova-compute[75247]:   </features>
Dec 06 12:50:13 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:50:13 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:50:13 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:50:13 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:50:13 user nova-compute[75247]:   </clock>
Dec 06 12:50:13 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:50:13 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:50:13 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:50:13 user nova-compute[75247]:   </cpu>
Dec 06 12:50:13 user nova-compute[75247]:   <devices>
Dec 06 12:50:13 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:50:13 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:50:13 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/56f7d945-3eae-4dbe-928e-389620e62353/disk"/>
Dec 06 12:50:13 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:50:13 user nova-compute[75247]:     </disk>
Dec 06 12:50:13 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:50:13 user nova-compute[75247]:       <mac address="fa:16:3e:db:01:9e"/>
Dec 06 12:50:13 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:50:13 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:50:13 user nova-compute[75247]:       <target dev="tape534a6f8-8e"/>
Dec 06 12:50:13 user nova-compute[75247]:     </interface>
Dec 06 12:50:13 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:50:13 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/56f7d945-3eae-4dbe-928e-389620e62353/console.log" append="off"/>
Dec 06 12:50:13 user nova-compute[75247]:     </serial>
Dec 06 12:50:13 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:50:13 user nova-compute[75247]:     <video>
Dec 06 12:50:13 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:50:13 user nova-compute[75247]:     </video>
Dec 06 12:50:13 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:50:13 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:50:13 user nova-compute[75247]:     </rng>
Dec 06 12:50:13 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:50:13 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:50:13 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:50:13 user nova-compute[75247]:     </memballoon>
Dec 06 12:50:13 user nova-compute[75247]:   </devices>
Dec 06 12:50:13 user nova-compute[75247]: </domain>
Dec 06 12:50:13 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1851817514',display_name='tempest-VolumesSnapshotTestJSON-instance-1851817514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1851817514',id=27,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlaEQxmoA0L3aug9ccwc8KvY1t5swd1/gga557TcuwVpi+fT39pH/iAcfPvKjxl1HrLLZIn3Fk52w5DM6VLesOF2XN44zjUuPV0J4b6XeOweVgN7ZDlDjp+xCISQTVhjg==',key_name='tempest-keypair-261496105',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b58ba64f48e946098b72d7061d354ef3',ramdisk_id='',reservation_id='r-6t0bo18j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1940428801',owner_user_name='tempest-VolumesSnapshotTestJSON-1940428801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:50:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35d1ce8c369941aab5effd18633a73b0',uuid=56f7d945-3eae-4dbe-928e-389620e62353,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e534a6f8-8e4b-4932-a4fc-bb5457532884", "address": "fa:16:3e:db:01:9e", "network": {"id": "24492570-dfe5-49d1-944e-7435cc85d347", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145359804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58ba64f48e946098b72d7061d354ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape534a6f8-8e", "ovs_interfaceid": "e534a6f8-8e4b-4932-a4fc-bb5457532884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Converting VIF {"id": "e534a6f8-8e4b-4932-a4fc-bb5457532884", "address": "fa:16:3e:db:01:9e", "network": {"id": "24492570-dfe5-49d1-944e-7435cc85d347", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145359804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58ba64f48e946098b72d7061d354ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape534a6f8-8e", "ovs_interfaceid": "e534a6f8-8e4b-4932-a4fc-bb5457532884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:01:9e,bridge_name='br-int',has_traffic_filtering=True,id=e534a6f8-8e4b-4932-a4fc-bb5457532884,network=Network(24492570-dfe5-49d1-944e-7435cc85d347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape534a6f8-8e') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG os_vif [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:01:9e,bridge_name='br-int',has_traffic_filtering=True,id=e534a6f8-8e4b-4932-a4fc-bb5457532884,network=Network(24492570-dfe5-49d1-944e-7435cc85d347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape534a6f8-8e') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a2ab180-2e10-55f8-a0c6-f99aa8105b52', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape534a6f8-8e, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape534a6f8-8e, col_values=(('qos', UUID('44878fb3-e538-4f79-abca-1a60655b1dbd')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape534a6f8-8e, col_values=(('external_ids', {'iface-id': 'e534a6f8-8e4b-4932-a4fc-bb5457532884', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:01:9e', 'vm-uuid': '56f7d945-3eae-4dbe-928e-389620e62353'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:13 user nova-compute[75247]: INFO os_vif [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:01:9e,bridge_name='br-int',has_traffic_filtering=True,id=e534a6f8-8e4b-4932-a4fc-bb5457532884,network=Network(24492570-dfe5-49d1-944e-7435cc85d347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape534a6f8-8e')
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:50:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] No VIF found with MAC fa:16:3e:db:01:9e, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:50:14 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Updating instance_info_cache with network_info: [{"id": "f373c320-8b0c-440d-b825-d7ec2555b89d", "address": "fa:16:3e:3f:8d:92", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf373c320-8b", "ovs_interfaceid": "f373c320-8b0c-440d-b825-d7ec2555b89d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:50:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-3e1b5197-dc38-48a5-b9f9-e053be499433" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:50:14 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 12:50:14 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:50:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:14 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 12:50:14 user nova-compute[75247]: DEBUG nova.network.neutron [req-d4307ded-bf2e-427c-9e3b-858edb5f31c4 req-7e7abd8a-135b-45e9-a7da-206c70ff12d9 service nova] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Updated VIF entry in instance network info cache for port e534a6f8-8e4b-4932-a4fc-bb5457532884. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:50:14 user nova-compute[75247]: DEBUG nova.network.neutron [req-d4307ded-bf2e-427c-9e3b-858edb5f31c4 req-7e7abd8a-135b-45e9-a7da-206c70ff12d9 service nova] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Updating instance_info_cache with network_info: [{"id": "e534a6f8-8e4b-4932-a4fc-bb5457532884", "address": "fa:16:3e:db:01:9e", "network": {"id": "24492570-dfe5-49d1-944e-7435cc85d347", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145359804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58ba64f48e946098b72d7061d354ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape534a6f8-8e", "ovs_interfaceid": "e534a6f8-8e4b-4932-a4fc-bb5457532884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:50:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d4307ded-bf2e-427c-9e3b-858edb5f31c4 req-7e7abd8a-135b-45e9-a7da-206c70ff12d9 service nova] Releasing lock "refresh_cache-56f7d945-3eae-4dbe-928e-389620e62353" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:50:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:15 user nova-compute[75247]: DEBUG nova.compute.manager [req-1e1cb4d6-a716-4240-93cc-30e0890209dd req-caf064ec-2cee-461e-afc2-00f1355d97a4 service nova] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Received event network-vif-plugged-e534a6f8-8e4b-4932-a4fc-bb5457532884 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:50:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1e1cb4d6-a716-4240-93cc-30e0890209dd req-caf064ec-2cee-461e-afc2-00f1355d97a4 service nova] Acquiring lock "56f7d945-3eae-4dbe-928e-389620e62353-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1e1cb4d6-a716-4240-93cc-30e0890209dd req-caf064ec-2cee-461e-afc2-00f1355d97a4 service nova] Lock "56f7d945-3eae-4dbe-928e-389620e62353-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1e1cb4d6-a716-4240-93cc-30e0890209dd req-caf064ec-2cee-461e-afc2-00f1355d97a4 service nova] Lock "56f7d945-3eae-4dbe-928e-389620e62353-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:15 user nova-compute[75247]: DEBUG nova.compute.manager [req-1e1cb4d6-a716-4240-93cc-30e0890209dd req-caf064ec-2cee-461e-afc2-00f1355d97a4 service nova] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] No waiting events found dispatching network-vif-plugged-e534a6f8-8e4b-4932-a4fc-bb5457532884 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:50:15 user nova-compute[75247]: WARNING nova.compute.manager [req-1e1cb4d6-a716-4240-93cc-30e0890209dd req-caf064ec-2cee-461e-afc2-00f1355d97a4 service nova] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Received unexpected event network-vif-plugged-e534a6f8-8e4b-4932-a4fc-bb5457532884 for instance with vm_state building and task_state spawning.
Dec 06 12:50:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:17 user nova-compute[75247]: DEBUG nova.compute.manager [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:50:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:50:17 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Instance spawned successfully.
Dec 06 12:50:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:50:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:50:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:50:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:50:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:50:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:50:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:50:17 user nova-compute[75247]: DEBUG nova.compute.manager [req-d9c46c1d-eb93-459c-bcf2-8912e7a58e36 req-d0182216-65b1-4be7-a357-62d106168d2a service nova] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Received event network-vif-plugged-e534a6f8-8e4b-4932-a4fc-bb5457532884 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:50:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d9c46c1d-eb93-459c-bcf2-8912e7a58e36 req-d0182216-65b1-4be7-a357-62d106168d2a service nova] Acquiring lock "56f7d945-3eae-4dbe-928e-389620e62353-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d9c46c1d-eb93-459c-bcf2-8912e7a58e36 req-d0182216-65b1-4be7-a357-62d106168d2a service nova] Lock "56f7d945-3eae-4dbe-928e-389620e62353-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d9c46c1d-eb93-459c-bcf2-8912e7a58e36 req-d0182216-65b1-4be7-a357-62d106168d2a service nova] Lock "56f7d945-3eae-4dbe-928e-389620e62353-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:17 user nova-compute[75247]: DEBUG nova.compute.manager [req-d9c46c1d-eb93-459c-bcf2-8912e7a58e36 req-d0182216-65b1-4be7-a357-62d106168d2a service nova] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] No waiting events found dispatching network-vif-plugged-e534a6f8-8e4b-4932-a4fc-bb5457532884 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:50:17 user nova-compute[75247]: WARNING nova.compute.manager [req-d9c46c1d-eb93-459c-bcf2-8912e7a58e36 req-d0182216-65b1-4be7-a357-62d106168d2a service nova] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Received unexpected event network-vif-plugged-e534a6f8-8e4b-4932-a4fc-bb5457532884 for instance with vm_state building and task_state spawning.
Dec 06 12:50:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:17 user nova-compute[75247]: INFO nova.compute.manager [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Took 6.36 seconds to spawn the instance on the hypervisor.
Dec 06 12:50:17 user nova-compute[75247]: DEBUG nova.compute.manager [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:50:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:50:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:17 user nova-compute[75247]: INFO nova.compute.manager [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Took 7.90 seconds to build instance.
Dec 06 12:50:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0bc61596-4a97-4bfe-84b5-4073c43f11a7 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "56f7d945-3eae-4dbe-928e-389620e62353" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.034s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f7d945-3eae-4dbe-928e-389620e62353/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f7d945-3eae-4dbe-928e-389620e62353/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f7d945-3eae-4dbe-928e-389620e62353/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f7d945-3eae-4dbe-928e-389620e62353/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:50:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b042a8f-4f9c-4704-8b48-f9eba4f8014b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b042a8f-4f9c-4704-8b48-f9eba4f8014b/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b042a8f-4f9c-4704-8b48-f9eba4f8014b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b042a8f-4f9c-4704-8b48-f9eba4f8014b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:20 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:50:20 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:50:20 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=7455MB free_disk=25.003692626953125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 12:50:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 70c4664e-ae7a-47de-bba7-18300391d209 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:50:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 782289e2-91cd-4aee-9a08-eadfb2a5965b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:50:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:50:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 3e1b5197-dc38-48a5-b9f9-e053be499433 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:50:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance db837c7a-c52d-469b-abf7-cea107454c60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:50:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance ea75ba22-b4af-4454-93ed-cdfdc76a895b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:50:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:50:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 9b042a8f-4f9c-4704-8b48-f9eba4f8014b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:50:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance bc3ddb40-b05f-4170-b269-d44dec6ecdaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:50:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 530cfb75-7aa8-4e57-b282-8f7a21401b34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:50:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 56f7d945-3eae-4dbe-928e-389620e62353 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:50:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 12:50:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 12:50:21 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:50:21 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:50:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 12:50:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.559s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "92d215fd-8411-430c-b91e-b6e62e02a994" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "92d215fd-8411-430c-b91e-b6e62e02a994" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:21 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:50:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:50:21 user nova-compute[75247]: INFO nova.compute.claims [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Claim successful on node user
Dec 06 12:50:22 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG nova.network.neutron [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:50:22 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:50:22 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG nova.policy [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4548c5d3575e45d787758e52fbf274d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4c40ccbb8a410aa0e65c1f5897de97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4ec1063b-451d-46b8-8b7a-01d631956faa tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4ec1063b-451d-46b8-8b7a-01d631956faa tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4ec1063b-451d-46b8-8b7a-01d631956faa tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4ec1063b-451d-46b8-8b7a-01d631956faa tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4ec1063b-451d-46b8-8b7a-01d631956faa tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:22 user nova-compute[75247]: INFO nova.compute.manager [None req-4ec1063b-451d-46b8-8b7a-01d631956faa tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Terminating instance
Dec 06 12:50:22 user nova-compute[75247]: DEBUG nova.compute.manager [None req-4ec1063b-451d-46b8-8b7a-01d631956faa tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:50:22 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Creating image(s)
Dec 06 12:50:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "/opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "/opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "/opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "7c941b32398ee88229c0e87f8be54f88cfc5e12e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "7c941b32398ee88229c0e87f8be54f88cfc5e12e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c941b32398ee88229c0e87f8be54f88cfc5e12e.part --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-71e3d171-0bf7-4675-9979-45d7af139171 req-bd8043fe-8ef4-49b8-b447-712dfb59f229 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received event network-vif-unplugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-71e3d171-0bf7-4675-9979-45d7af139171 req-bd8043fe-8ef4-49b8-b447-712dfb59f229 service nova] Acquiring lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-71e3d171-0bf7-4675-9979-45d7af139171 req-bd8043fe-8ef4-49b8-b447-712dfb59f229 service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-71e3d171-0bf7-4675-9979-45d7af139171 req-bd8043fe-8ef4-49b8-b447-712dfb59f229 service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-71e3d171-0bf7-4675-9979-45d7af139171 req-bd8043fe-8ef4-49b8-b447-712dfb59f229 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] No waiting events found dispatching network-vif-unplugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-71e3d171-0bf7-4675-9979-45d7af139171 req-bd8043fe-8ef4-49b8-b447-712dfb59f229 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received event network-vif-unplugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:50:22 user nova-compute[75247]: DEBUG nova.network.neutron [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Successfully created port: 358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c941b32398ee88229c0e87f8be54f88cfc5e12e.part --force-share --output=json" returned: 0 in 0.231s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG nova.virt.images [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] 77880627-5661-4b33-918f-7f31d21bbf09 was qcow2, converting to raw {{(pid=75247) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG nova.privsep.utils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7c941b32398ee88229c0e87f8be54f88cfc5e12e.part /opt/stack/data/nova/instances/_base/7c941b32398ee88229c0e87f8be54f88cfc5e12e.converted {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:23 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Instance destroyed successfully.
Dec 06 12:50:23 user nova-compute[75247]: DEBUG nova.objects.instance [None req-4ec1063b-451d-46b8-8b7a-01d631956faa tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'resources' on Instance uuid a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-4ec1063b-451d-46b8-8b7a-01d631956faa tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1942005817',display_name='tempest-AttachVolumeTestJSON-server-1942005817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1942005817',id=4,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGz+hJ0HTVL1CpIzjfndN5RB0FYKnfV0muFx2QzLM69CRA62Oly9Vvvkkj6Ccf/qOmS6iQUbmUmx8/zqty8k8DI7l9pqS+f/lxdpJZ0usxBwqzknFRlQwwi6Ig22Eo3VA==',key_name='tempest-keypair-21482804',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:40:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f3aeaf6ffdb4cc0807d90e73e92fa7e',ramdisk_id='',reservation_id='r-wenfkxlt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-209684424',owner_user_name='tempest-AttachVolumeTestJSON-209684424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:48:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cb0e32ba6094d1e8053787bc1979b65',uuid=a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-4ec1063b-451d-46b8-8b7a-01d631956faa tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Converting VIF {"id": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "address": "fa:16:3e:ae:2f:c5", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5418b-5a", "ovs_interfaceid": "b7c5418b-5afb-45b5-af6c-c46f82ef72cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-4ec1063b-451d-46b8-8b7a-01d631956faa tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:2f:c5,bridge_name='br-int',has_traffic_filtering=True,id=b7c5418b-5afb-45b5-af6c-c46f82ef72cc,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5418b-5a') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG os_vif [None req-4ec1063b-451d-46b8-8b7a-01d631956faa tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:2f:c5,bridge_name='br-int',has_traffic_filtering=True,id=b7c5418b-5afb-45b5-af6c-c46f82ef72cc,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5418b-5a') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7c5418b-5a, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44740920-c0ea-49e3-9218-1c4d2d066e23) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:23 user nova-compute[75247]: INFO os_vif [None req-4ec1063b-451d-46b8-8b7a-01d631956faa tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:2f:c5,bridge_name='br-int',has_traffic_filtering=True,id=b7c5418b-5afb-45b5-af6c-c46f82ef72cc,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5418b-5a')
Dec 06 12:50:23 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-4ec1063b-451d-46b8-8b7a-01d631956faa tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Deleting instance files /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a_del
Dec 06 12:50:23 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-4ec1063b-451d-46b8-8b7a-01d631956faa tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Deletion of /opt/stack/data/nova/instances/a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a_del complete
Dec 06 12:50:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7c941b32398ee88229c0e87f8be54f88cfc5e12e.part /opt/stack/data/nova/instances/_base/7c941b32398ee88229c0e87f8be54f88cfc5e12e.converted" returned: 0 in 0.156s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c941b32398ee88229c0e87f8be54f88cfc5e12e.converted --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:23 user nova-compute[75247]: INFO nova.compute.manager [None req-4ec1063b-451d-46b8-8b7a-01d631956faa tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Took 0.99 seconds to destroy the instance on the hypervisor.
Dec 06 12:50:23 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-4ec1063b-451d-46b8-8b7a-01d631956faa tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c941b32398ee88229c0e87f8be54f88cfc5e12e.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "7c941b32398ee88229c0e87f8be54f88cfc5e12e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.056s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c941b32398ee88229c0e87f8be54f88cfc5e12e --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c941b32398ee88229c0e87f8be54f88cfc5e12e --force-share --output=json" returned: 0 in 0.219s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "7c941b32398ee88229c0e87f8be54f88cfc5e12e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "7c941b32398ee88229c0e87f8be54f88cfc5e12e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c941b32398ee88229c0e87f8be54f88cfc5e12e --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c941b32398ee88229c0e87f8be54f88cfc5e12e --force-share --output=json" returned: 0 in 0.186s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c941b32398ee88229c0e87f8be54f88cfc5e12e,backing_fmt=raw /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c941b32398ee88229c0e87f8be54f88cfc5e12e,backing_fmt=raw /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk 1073741824" returned: 0 in 0.052s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "7c941b32398ee88229c0e87f8be54f88cfc5e12e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c941b32398ee88229c0e87f8be54f88cfc5e12e --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c941b32398ee88229c0e87f8be54f88cfc5e12e --force-share --output=json" returned: 0 in 0.172s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Cannot resize image /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Ensure instance console log exists: /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.network.neutron [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Successfully updated port: 358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "refresh_cache-92d215fd-8411-430c-b91e-b6e62e02a994" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquired lock "refresh_cache-92d215fd-8411-430c-b91e-b6e62e02a994" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.network.neutron [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.compute.manager [req-07b2a20d-b643-4145-8a39-bf774c77d7e6 req-f408f3cc-39f0-4507-adb7-d6ad2057d3cc service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received event network-changed-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.compute.manager [req-07b2a20d-b643-4145-8a39-bf774c77d7e6 req-f408f3cc-39f0-4507-adb7-d6ad2057d3cc service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Refreshing instance network info cache due to event network-changed-358da164-b155-4d24-a006-7454c10ee790. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-07b2a20d-b643-4145-8a39-bf774c77d7e6 req-f408f3cc-39f0-4507-adb7-d6ad2057d3cc service nova] Acquiring lock "refresh_cache-92d215fd-8411-430c-b91e-b6e62e02a994" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.network.neutron [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.compute.manager [req-4394ec5b-1c34-4da4-9333-7204fe58b0be req-1ac65dcc-85dd-4ccc-adc6-82e8e8370377 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received event network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4394ec5b-1c34-4da4-9333-7204fe58b0be req-1ac65dcc-85dd-4ccc-adc6-82e8e8370377 service nova] Acquiring lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4394ec5b-1c34-4da4-9333-7204fe58b0be req-1ac65dcc-85dd-4ccc-adc6-82e8e8370377 service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4394ec5b-1c34-4da4-9333-7204fe58b0be req-1ac65dcc-85dd-4ccc-adc6-82e8e8370377 service nova] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.compute.manager [req-4394ec5b-1c34-4da4-9333-7204fe58b0be req-1ac65dcc-85dd-4ccc-adc6-82e8e8370377 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] No waiting events found dispatching network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:50:24 user nova-compute[75247]: WARNING nova.compute.manager [req-4394ec5b-1c34-4da4-9333-7204fe58b0be req-1ac65dcc-85dd-4ccc-adc6-82e8e8370377 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received unexpected event network-vif-plugged-b7c5418b-5afb-45b5-af6c-c46f82ef72cc for instance with vm_state active and task_state deleting.
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:50:24 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Took 1.57 seconds to deallocate network for instance.
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.network.neutron [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Updating instance_info_cache with network_info: [{"id": "358da164-b155-4d24-a006-7454c10ee790", "address": "fa:16:3e:56:7e:02", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358da164-b1", "ovs_interfaceid": "358da164-b155-4d24-a006-7454c10ee790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Releasing lock "refresh_cache-92d215fd-8411-430c-b91e-b6e62e02a994" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Instance network_info: |[{"id": "358da164-b155-4d24-a006-7454c10ee790", "address": "fa:16:3e:56:7e:02", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358da164-b1", "ovs_interfaceid": "358da164-b155-4d24-a006-7454c10ee790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-07b2a20d-b643-4145-8a39-bf774c77d7e6 req-f408f3cc-39f0-4507-adb7-d6ad2057d3cc service nova] Acquired lock "refresh_cache-92d215fd-8411-430c-b91e-b6e62e02a994" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.network.neutron [req-07b2a20d-b643-4145-8a39-bf774c77d7e6 req-f408f3cc-39f0-4507-adb7-d6ad2057d3cc service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Refreshing network info cache for port 358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Start _get_guest_xml network_info=[{"id": "358da164-b155-4d24-a006-7454c10ee790", "address": "fa:16:3e:56:7e:02", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358da164-b1", "ovs_interfaceid": "358da164-b155-4d24-a006-7454c10ee790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:50:18Z,direct_url=<?>,disk_format='qcow2',id=77880627-5661-4b33-918f-7f31d21bbf09,min_disk=0,min_ram=0,name='tempest-scenario-img--157930804',owner='df4c40ccbb8a410aa0e65c1f5897de97',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:50:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '77880627-5661-4b33-918f-7f31d21bbf09'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4ec1063b-451d-46b8-8b7a-01d631956faa tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4ec1063b-451d-46b8-8b7a-01d631956faa tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:24 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:50:24 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:50:18Z,direct_url=<?>,disk_format='qcow2',id=77880627-5661-4b33-918f-7f31d21bbf09,min_disk=0,min_ram=0,name='tempest-scenario-img--157930804',owner='df4c40ccbb8a410aa0e65c1f5897de97',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:50:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:50:24 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-405491717',display_name='tempest-TestMinimumBasicScenario-server-405491717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-405491717',id=28,image_ref='77880627-5661-4b33-918f-7f31d21bbf09',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8DJx6AERy2099LBCgp0NCcDeirjKP0JaCltFxo6ebyzhA+RaiRR5xAzSQFYIZYmpKbdvwElgDd3tckUYpfpyWVw2FT00kZhSxTzK8Ya6p8RFso6a9TFAS+ZLvdkG8SSQ==',key_name='tempest-TestMinimumBasicScenario-652469488',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df4c40ccbb8a410aa0e65c1f5897de97',ramdisk_id='',reservation_id='r-4nqr0wos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77880627-5661-4b33-918f-7f31d21bbf09',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1052287778',owner_user_name='tempest-TestMinimumBasicScenario-1052287778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:50:22Z,user_data=None,user_id='4548c5d3575e45d787758e52fbf274d6',uuid=92d215fd-8411-430c-b91e-b6e62e02a994,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "358da164-b155-4d24-a006-7454c10ee790", "address": "fa:16:3e:56:7e:02", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358da164-b1", "ovs_interfaceid": "358da164-b155-4d24-a006-7454c10ee790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Converting VIF {"id": "358da164-b155-4d24-a006-7454c10ee790", "address": "fa:16:3e:56:7e:02", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358da164-b1", "ovs_interfaceid": "358da164-b155-4d24-a006-7454c10ee790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:7e:02,bridge_name='br-int',has_traffic_filtering=True,id=358da164-b155-4d24-a006-7454c10ee790,network=Network(56756e7a-b384-43a0-88dc-bab3b11e5f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358da164-b1') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG nova.objects.instance [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lazy-loading 'pci_devices' on Instance uuid 92d215fd-8411-430c-b91e-b6e62e02a994 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:50:25 user nova-compute[75247]:   <uuid>92d215fd-8411-430c-b91e-b6e62e02a994</uuid>
Dec 06 12:50:25 user nova-compute[75247]:   <name>instance-0000001c</name>
Dec 06 12:50:25 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:50:25 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:50:25 user nova-compute[75247]:   <metadata>
Dec 06 12:50:25 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:50:25 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:50:25 user nova-compute[75247]:       <nova:name>tempest-TestMinimumBasicScenario-server-405491717</nova:name>
Dec 06 12:50:25 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:50:24</nova:creationTime>
Dec 06 12:50:25 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:50:25 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:50:25 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:50:25 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:50:25 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:50:25 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:50:25 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:50:25 user nova-compute[75247]:       <nova:owner>
Dec 06 12:50:25 user nova-compute[75247]:         <nova:user uuid="4548c5d3575e45d787758e52fbf274d6">tempest-TestMinimumBasicScenario-1052287778-project-member</nova:user>
Dec 06 12:50:25 user nova-compute[75247]:         <nova:project uuid="df4c40ccbb8a410aa0e65c1f5897de97">tempest-TestMinimumBasicScenario-1052287778</nova:project>
Dec 06 12:50:25 user nova-compute[75247]:       </nova:owner>
Dec 06 12:50:25 user nova-compute[75247]:       <nova:root type="image" uuid="77880627-5661-4b33-918f-7f31d21bbf09"/>
Dec 06 12:50:25 user nova-compute[75247]:       <nova:ports>
Dec 06 12:50:25 user nova-compute[75247]:         <nova:port uuid="358da164-b155-4d24-a006-7454c10ee790">
Dec 06 12:50:25 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 06 12:50:25 user nova-compute[75247]:         </nova:port>
Dec 06 12:50:25 user nova-compute[75247]:       </nova:ports>
Dec 06 12:50:25 user nova-compute[75247]:     </nova:instance>
Dec 06 12:50:25 user nova-compute[75247]:   </metadata>
Dec 06 12:50:25 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:50:25 user nova-compute[75247]:     <system>
Dec 06 12:50:25 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:50:25 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:50:25 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:50:25 user nova-compute[75247]:       <entry name="serial">92d215fd-8411-430c-b91e-b6e62e02a994</entry>
Dec 06 12:50:25 user nova-compute[75247]:       <entry name="uuid">92d215fd-8411-430c-b91e-b6e62e02a994</entry>
Dec 06 12:50:25 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:50:25 user nova-compute[75247]:     </system>
Dec 06 12:50:25 user nova-compute[75247]:   </sysinfo>
Dec 06 12:50:25 user nova-compute[75247]:   <os>
Dec 06 12:50:25 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:50:25 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:50:25 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:50:25 user nova-compute[75247]:   </os>
Dec 06 12:50:25 user nova-compute[75247]:   <features>
Dec 06 12:50:25 user nova-compute[75247]:     <acpi/>
Dec 06 12:50:25 user nova-compute[75247]:     <apic/>
Dec 06 12:50:25 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:50:25 user nova-compute[75247]:   </features>
Dec 06 12:50:25 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:50:25 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:50:25 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:50:25 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:50:25 user nova-compute[75247]:   </clock>
Dec 06 12:50:25 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:50:25 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:50:25 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:50:25 user nova-compute[75247]:   </cpu>
Dec 06 12:50:25 user nova-compute[75247]:   <devices>
Dec 06 12:50:25 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:50:25 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:50:25 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk"/>
Dec 06 12:50:25 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:50:25 user nova-compute[75247]:     </disk>
Dec 06 12:50:25 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:50:25 user nova-compute[75247]:       <mac address="fa:16:3e:56:7e:02"/>
Dec 06 12:50:25 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:50:25 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:50:25 user nova-compute[75247]:       <target dev="tap358da164-b1"/>
Dec 06 12:50:25 user nova-compute[75247]:     </interface>
Dec 06 12:50:25 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:50:25 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/console.log" append="off"/>
Dec 06 12:50:25 user nova-compute[75247]:     </serial>
Dec 06 12:50:25 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:50:25 user nova-compute[75247]:     <video>
Dec 06 12:50:25 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:50:25 user nova-compute[75247]:     </video>
Dec 06 12:50:25 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:50:25 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:50:25 user nova-compute[75247]:     </rng>
Dec 06 12:50:25 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:50:25 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:50:25 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:50:25 user nova-compute[75247]:     </memballoon>
Dec 06 12:50:25 user nova-compute[75247]:   </devices>
Dec 06 12:50:25 user nova-compute[75247]: </domain>
Dec 06 12:50:25 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-405491717',display_name='tempest-TestMinimumBasicScenario-server-405491717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-405491717',id=28,image_ref='77880627-5661-4b33-918f-7f31d21bbf09',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8DJx6AERy2099LBCgp0NCcDeirjKP0JaCltFxo6ebyzhA+RaiRR5xAzSQFYIZYmpKbdvwElgDd3tckUYpfpyWVw2FT00kZhSxTzK8Ya6p8RFso6a9TFAS+ZLvdkG8SSQ==',key_name='tempest-TestMinimumBasicScenario-652469488',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df4c40ccbb8a410aa0e65c1f5897de97',ramdisk_id='',reservation_id='r-4nqr0wos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77880627-5661-4b33-918f-7f31d21bbf09',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1052287778',owner_user_name='tempest-TestMinimumBasicScenario-1052287778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:50:22Z,user_data=None,user_id='4548c5d3575e45d787758e52fbf274d6',uuid=92d215fd-8411-430c-b91e-b6e62e02a994,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "358da164-b155-4d24-a006-7454c10ee790", "address": "fa:16:3e:56:7e:02", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358da164-b1", "ovs_interfaceid": "358da164-b155-4d24-a006-7454c10ee790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Converting VIF {"id": "358da164-b155-4d24-a006-7454c10ee790", "address": "fa:16:3e:56:7e:02", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358da164-b1", "ovs_interfaceid": "358da164-b155-4d24-a006-7454c10ee790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:7e:02,bridge_name='br-int',has_traffic_filtering=True,id=358da164-b155-4d24-a006-7454c10ee790,network=Network(56756e7a-b384-43a0-88dc-bab3b11e5f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358da164-b1') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG os_vif [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:7e:02,bridge_name='br-int',has_traffic_filtering=True,id=358da164-b155-4d24-a006-7454c10ee790,network=Network(56756e7a-b384-43a0-88dc-bab3b11e5f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358da164-b1') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96677c6f-0c52-50a8-a4be-e4285f2cf878', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap358da164-b1, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap358da164-b1, col_values=(('qos', UUID('7eb6cf7d-4369-45cc-941c-63ed1eca1622')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap358da164-b1, col_values=(('external_ids', {'iface-id': '358da164-b155-4d24-a006-7454c10ee790', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:7e:02', 'vm-uuid': '92d215fd-8411-430c-b91e-b6e62e02a994'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:25 user nova-compute[75247]: INFO os_vif [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:7e:02,bridge_name='br-int',has_traffic_filtering=True,id=358da164-b155-4d24-a006-7454c10ee790,network=Network(56756e7a-b384-43a0-88dc-bab3b11e5f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358da164-b1')
Dec 06 12:50:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] No VIF found with MAC fa:16:3e:56:7e:02, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG nova.network.neutron [req-07b2a20d-b643-4145-8a39-bf774c77d7e6 req-f408f3cc-39f0-4507-adb7-d6ad2057d3cc service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Updated VIF entry in instance network info cache for port 358da164-b155-4d24-a006-7454c10ee790. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG nova.network.neutron [req-07b2a20d-b643-4145-8a39-bf774c77d7e6 req-f408f3cc-39f0-4507-adb7-d6ad2057d3cc service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Updating instance_info_cache with network_info: [{"id": "358da164-b155-4d24-a006-7454c10ee790", "address": "fa:16:3e:56:7e:02", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358da164-b1", "ovs_interfaceid": "358da164-b155-4d24-a006-7454c10ee790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-4ec1063b-451d-46b8-8b7a-01d631956faa tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-07b2a20d-b643-4145-8a39-bf774c77d7e6 req-f408f3cc-39f0-4507-adb7-d6ad2057d3cc service nova] Releasing lock "refresh_cache-92d215fd-8411-430c-b91e-b6e62e02a994" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-4ec1063b-451d-46b8-8b7a-01d631956faa tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:50:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4ec1063b-451d-46b8-8b7a-01d631956faa tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:25 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-4ec1063b-451d-46b8-8b7a-01d631956faa tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Deleted allocations for instance a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a
Dec 06 12:50:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4ec1063b-451d-46b8-8b7a-01d631956faa tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.262s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-4650eae4-30e3-4dba-8ab3-8f744a7759c7 req-add9b24b-8083-425b-a93f-dc655fb84325 service nova] [instance: a38068ed-2bb9-4fbb-9fe1-5ace2a9e0f5a] Received event network-vif-deleted-b7c5418b-5afb-45b5-af6c-c46f82ef72cc {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:50:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-755d58ba-e0f1-40af-97e0-5fb09fbd5f43 req-0e445e9e-83ac-4476-8c4d-1af781a621d1 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received event network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:50:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-755d58ba-e0f1-40af-97e0-5fb09fbd5f43 req-0e445e9e-83ac-4476-8c4d-1af781a621d1 service nova] Acquiring lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-755d58ba-e0f1-40af-97e0-5fb09fbd5f43 req-0e445e9e-83ac-4476-8c4d-1af781a621d1 service nova] Lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-755d58ba-e0f1-40af-97e0-5fb09fbd5f43 req-0e445e9e-83ac-4476-8c4d-1af781a621d1 service nova] Lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-755d58ba-e0f1-40af-97e0-5fb09fbd5f43 req-0e445e9e-83ac-4476-8c4d-1af781a621d1 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] No waiting events found dispatching network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:50:26 user nova-compute[75247]: WARNING nova.compute.manager [req-755d58ba-e0f1-40af-97e0-5fb09fbd5f43 req-0e445e9e-83ac-4476-8c4d-1af781a621d1 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received unexpected event network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 for instance with vm_state building and task_state spawning.
Dec 06 12:50:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:28 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:50:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:50:28 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Instance spawned successfully.
Dec 06 12:50:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:50:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:50:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:50:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:50:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:50:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:50:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:50:28 user nova-compute[75247]: INFO nova.compute.manager [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Took 6.40 seconds to spawn the instance on the hypervisor.
Dec 06 12:50:28 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:50:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-598fdb46-9699-43f7-bcd5-39c451d41ac3 req-99df27ab-2bd7-4ce0-a133-7f54b9e02aa6 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received event network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:50:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-598fdb46-9699-43f7-bcd5-39c451d41ac3 req-99df27ab-2bd7-4ce0-a133-7f54b9e02aa6 service nova] Acquiring lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-598fdb46-9699-43f7-bcd5-39c451d41ac3 req-99df27ab-2bd7-4ce0-a133-7f54b9e02aa6 service nova] Lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-598fdb46-9699-43f7-bcd5-39c451d41ac3 req-99df27ab-2bd7-4ce0-a133-7f54b9e02aa6 service nova] Lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-598fdb46-9699-43f7-bcd5-39c451d41ac3 req-99df27ab-2bd7-4ce0-a133-7f54b9e02aa6 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] No waiting events found dispatching network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:50:28 user nova-compute[75247]: WARNING nova.compute.manager [req-598fdb46-9699-43f7-bcd5-39c451d41ac3 req-99df27ab-2bd7-4ce0-a133-7f54b9e02aa6 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received unexpected event network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 for instance with vm_state building and task_state spawning.
Dec 06 12:50:28 user nova-compute[75247]: INFO nova.compute.manager [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Took 7.25 seconds to build instance.
Dec 06 12:50:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ec9a96a-586f-465a-b6bf-7d1d6b6b09bc tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "92d215fd-8411-430c-b91e-b6e62e02a994" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.358s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:40 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6d00a92a-73d4-4789-a202-2a5b0ab7313b tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:50:40 user nova-compute[75247]: INFO nova.compute.manager [None req-6d00a92a-73d4-4789-a202-2a5b0ab7313b tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] instance snapshotting
Dec 06 12:50:40 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6d00a92a-73d4-4789-a202-2a5b0ab7313b tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Beginning live snapshot process
Dec 06 12:50:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6d00a92a-73d4-4789-a202-2a5b0ab7313b tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json -f qcow2 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6d00a92a-73d4-4789-a202-2a5b0ab7313b tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6d00a92a-73d4-4789-a202-2a5b0ab7313b tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json -f qcow2 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6d00a92a-73d4-4789-a202-2a5b0ab7313b tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6d00a92a-73d4-4789-a202-2a5b0ab7313b tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6d00a92a-73d4-4789-a202-2a5b0ab7313b tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.191s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6d00a92a-73d4-4789-a202-2a5b0ab7313b tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl11u2fyw/97528026d6cc4768bcf5811b2088de94.delta 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6d00a92a-73d4-4789-a202-2a5b0ab7313b tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl11u2fyw/97528026d6cc4768bcf5811b2088de94.delta 1073741824" returned: 0 in 0.053s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:41 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6d00a92a-73d4-4789-a202-2a5b0ab7313b tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 06 12:50:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-6d00a92a-73d4-4789-a202-2a5b0ab7313b tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 12:50:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-6d00a92a-73d4-4789-a202-2a5b0ab7313b tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 12:50:42 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6d00a92a-73d4-4789-a202-2a5b0ab7313b tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 06 12:50:42 user nova-compute[75247]: DEBUG nova.privsep.utils [None req-6d00a92a-73d4-4789-a202-2a5b0ab7313b tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 12:50:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6d00a92a-73d4-4789-a202-2a5b0ab7313b tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl11u2fyw/97528026d6cc4768bcf5811b2088de94.delta /opt/stack/data/nova/instances/snapshots/tmpl11u2fyw/97528026d6cc4768bcf5811b2088de94 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6d00a92a-73d4-4789-a202-2a5b0ab7313b tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl11u2fyw/97528026d6cc4768bcf5811b2088de94.delta /opt/stack/data/nova/instances/snapshots/tmpl11u2fyw/97528026d6cc4768bcf5811b2088de94" returned: 0 in 0.265s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:42 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6d00a92a-73d4-4789-a202-2a5b0ab7313b tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Snapshot extracted, beginning image upload
Dec 06 12:50:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:45 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6d00a92a-73d4-4789-a202-2a5b0ab7313b tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Snapshot image upload complete
Dec 06 12:50:45 user nova-compute[75247]: INFO nova.compute.manager [None req-6d00a92a-73d4-4789-a202-2a5b0ab7313b tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Took 4.86 seconds to snapshot the instance on the hypervisor.
Dec 06 12:50:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "504791a2-9892-4721-856a-e0b77a395d01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "504791a2-9892-4721-856a-e0b77a395d01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:55 user nova-compute[75247]: DEBUG nova.compute.manager [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:50:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:55 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:50:55 user nova-compute[75247]: INFO nova.compute.claims [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Claim successful on node user
Dec 06 12:50:55 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:50:55 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:50:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:55 user nova-compute[75247]: DEBUG nova.compute.manager [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:50:55 user nova-compute[75247]: DEBUG nova.compute.manager [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:50:55 user nova-compute[75247]: DEBUG nova.network.neutron [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:50:55 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:50:55 user nova-compute[75247]: DEBUG nova.compute.manager [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:50:55 user nova-compute[75247]: DEBUG nova.policy [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d7becd4d5734bc2b652e6f37492eb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6b077946334f1c8fd16d091a7738e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:50:55 user nova-compute[75247]: DEBUG nova.compute.manager [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:50:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:50:55 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Creating image(s)
Dec 06 12:50:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "/opt/stack/data/nova/instances/504791a2-9892-4721-856a-e0b77a395d01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "/opt/stack/data/nova/instances/504791a2-9892-4721-856a-e0b77a395d01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "/opt/stack/data/nova/instances/504791a2-9892-4721-856a-e0b77a395d01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.177s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.175s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/504791a2-9892-4721-856a-e0b77a395d01/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/504791a2-9892-4721-856a-e0b77a395d01/disk 1073741824" returned: 0 in 0.061s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.186s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:56 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Checking if we can resize image /opt/stack/data/nova/instances/504791a2-9892-4721-856a-e0b77a395d01/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:50:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/504791a2-9892-4721-856a-e0b77a395d01/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:50:56 user nova-compute[75247]: DEBUG nova.network.neutron [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Successfully created port: 0d1f49fb-698e-43fd-8ef4-8ad8b2749f92 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:50:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/504791a2-9892-4721-856a-e0b77a395d01/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:50:56 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Cannot resize image /opt/stack/data/nova/instances/504791a2-9892-4721-856a-e0b77a395d01/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:50:56 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:50:56 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Ensure instance console log exists: /opt/stack/data/nova/instances/504791a2-9892-4721-856a-e0b77a395d01/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:50:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.network.neutron [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Successfully updated port: 0d1f49fb-698e-43fd-8ef4-8ad8b2749f92 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "refresh_cache-504791a2-9892-4721-856a-e0b77a395d01" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquired lock "refresh_cache-504791a2-9892-4721-856a-e0b77a395d01" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.network.neutron [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.compute.manager [req-67f73ca5-3032-4f41-8beb-bcbfe93061e9 req-4b72f100-4de7-4b4d-ab68-0c0b708c87c6 service nova] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Received event network-changed-0d1f49fb-698e-43fd-8ef4-8ad8b2749f92 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.compute.manager [req-67f73ca5-3032-4f41-8beb-bcbfe93061e9 req-4b72f100-4de7-4b4d-ab68-0c0b708c87c6 service nova] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Refreshing instance network info cache due to event network-changed-0d1f49fb-698e-43fd-8ef4-8ad8b2749f92. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-67f73ca5-3032-4f41-8beb-bcbfe93061e9 req-4b72f100-4de7-4b4d-ab68-0c0b708c87c6 service nova] Acquiring lock "refresh_cache-504791a2-9892-4721-856a-e0b77a395d01" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.network.neutron [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.network.neutron [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Updating instance_info_cache with network_info: [{"id": "0d1f49fb-698e-43fd-8ef4-8ad8b2749f92", "address": "fa:16:3e:58:67:92", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d1f49fb-69", "ovs_interfaceid": "0d1f49fb-698e-43fd-8ef4-8ad8b2749f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Releasing lock "refresh_cache-504791a2-9892-4721-856a-e0b77a395d01" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.compute.manager [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Instance network_info: |[{"id": "0d1f49fb-698e-43fd-8ef4-8ad8b2749f92", "address": "fa:16:3e:58:67:92", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d1f49fb-69", "ovs_interfaceid": "0d1f49fb-698e-43fd-8ef4-8ad8b2749f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-67f73ca5-3032-4f41-8beb-bcbfe93061e9 req-4b72f100-4de7-4b4d-ab68-0c0b708c87c6 service nova] Acquired lock "refresh_cache-504791a2-9892-4721-856a-e0b77a395d01" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.network.neutron [req-67f73ca5-3032-4f41-8beb-bcbfe93061e9 req-4b72f100-4de7-4b4d-ab68-0c0b708c87c6 service nova] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Refreshing network info cache for port 0d1f49fb-698e-43fd-8ef4-8ad8b2749f92 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Start _get_guest_xml network_info=[{"id": "0d1f49fb-698e-43fd-8ef4-8ad8b2749f92", "address": "fa:16:3e:58:67:92", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d1f49fb-69", "ovs_interfaceid": "0d1f49fb-698e-43fd-8ef4-8ad8b2749f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:50:57 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:50:57 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-548460361',display_name='tempest-AttachVolumeNegativeTest-server-548460361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-548460361',id=29,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsDqGZfCQcpUWP7TOkMrEcJYJs1a9WJmNto1njU4Mkh724U/nMXqizmwABxywMuU6TvrnjH+lAogQGhP9oMRJHp6pHJQKLFwnckt9ggsCPlL+/raC3W58S4XV2iShNT4g==',key_name='tempest-keypair-968485742',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a6b077946334f1c8fd16d091a7738e1',ramdisk_id='',reservation_id='r-j5esl516',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2136789566',owner_user_name='tempest-AttachVolumeNegativeTest-2136789566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:50:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d7becd4d5734bc2b652e6f37492eb5e',uuid=504791a2-9892-4721-856a-e0b77a395d01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d1f49fb-698e-43fd-8ef4-8ad8b2749f92", "address": "fa:16:3e:58:67:92", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d1f49fb-69", "ovs_interfaceid": "0d1f49fb-698e-43fd-8ef4-8ad8b2749f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Converting VIF {"id": "0d1f49fb-698e-43fd-8ef4-8ad8b2749f92", "address": "fa:16:3e:58:67:92", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d1f49fb-69", "ovs_interfaceid": "0d1f49fb-698e-43fd-8ef4-8ad8b2749f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:67:92,bridge_name='br-int',has_traffic_filtering=True,id=0d1f49fb-698e-43fd-8ef4-8ad8b2749f92,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d1f49fb-69') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.objects.instance [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lazy-loading 'pci_devices' on Instance uuid 504791a2-9892-4721-856a-e0b77a395d01 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:50:57 user nova-compute[75247]:   <uuid>504791a2-9892-4721-856a-e0b77a395d01</uuid>
Dec 06 12:50:57 user nova-compute[75247]:   <name>instance-0000001d</name>
Dec 06 12:50:57 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:50:57 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:50:57 user nova-compute[75247]:   <metadata>
Dec 06 12:50:57 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:50:57 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:50:57 user nova-compute[75247]:       <nova:name>tempest-AttachVolumeNegativeTest-server-548460361</nova:name>
Dec 06 12:50:57 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:50:57</nova:creationTime>
Dec 06 12:50:57 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:50:57 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:50:57 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:50:57 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:50:57 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:50:57 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:50:57 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:50:57 user nova-compute[75247]:       <nova:owner>
Dec 06 12:50:57 user nova-compute[75247]:         <nova:user uuid="9d7becd4d5734bc2b652e6f37492eb5e">tempest-AttachVolumeNegativeTest-2136789566-project-member</nova:user>
Dec 06 12:50:57 user nova-compute[75247]:         <nova:project uuid="6a6b077946334f1c8fd16d091a7738e1">tempest-AttachVolumeNegativeTest-2136789566</nova:project>
Dec 06 12:50:57 user nova-compute[75247]:       </nova:owner>
Dec 06 12:50:57 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:50:57 user nova-compute[75247]:       <nova:ports>
Dec 06 12:50:57 user nova-compute[75247]:         <nova:port uuid="0d1f49fb-698e-43fd-8ef4-8ad8b2749f92">
Dec 06 12:50:57 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 12:50:57 user nova-compute[75247]:         </nova:port>
Dec 06 12:50:57 user nova-compute[75247]:       </nova:ports>
Dec 06 12:50:57 user nova-compute[75247]:     </nova:instance>
Dec 06 12:50:57 user nova-compute[75247]:   </metadata>
Dec 06 12:50:57 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:50:57 user nova-compute[75247]:     <system>
Dec 06 12:50:57 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:50:57 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:50:57 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:50:57 user nova-compute[75247]:       <entry name="serial">504791a2-9892-4721-856a-e0b77a395d01</entry>
Dec 06 12:50:57 user nova-compute[75247]:       <entry name="uuid">504791a2-9892-4721-856a-e0b77a395d01</entry>
Dec 06 12:50:57 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:50:57 user nova-compute[75247]:     </system>
Dec 06 12:50:57 user nova-compute[75247]:   </sysinfo>
Dec 06 12:50:57 user nova-compute[75247]:   <os>
Dec 06 12:50:57 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:50:57 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:50:57 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:50:57 user nova-compute[75247]:   </os>
Dec 06 12:50:57 user nova-compute[75247]:   <features>
Dec 06 12:50:57 user nova-compute[75247]:     <acpi/>
Dec 06 12:50:57 user nova-compute[75247]:     <apic/>
Dec 06 12:50:57 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:50:57 user nova-compute[75247]:   </features>
Dec 06 12:50:57 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:50:57 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:50:57 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:50:57 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:50:57 user nova-compute[75247]:   </clock>
Dec 06 12:50:57 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:50:57 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:50:57 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:50:57 user nova-compute[75247]:   </cpu>
Dec 06 12:50:57 user nova-compute[75247]:   <devices>
Dec 06 12:50:57 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:50:57 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:50:57 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/504791a2-9892-4721-856a-e0b77a395d01/disk"/>
Dec 06 12:50:57 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:50:57 user nova-compute[75247]:     </disk>
Dec 06 12:50:57 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:50:57 user nova-compute[75247]:       <mac address="fa:16:3e:58:67:92"/>
Dec 06 12:50:57 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:50:57 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:50:57 user nova-compute[75247]:       <target dev="tap0d1f49fb-69"/>
Dec 06 12:50:57 user nova-compute[75247]:     </interface>
Dec 06 12:50:57 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:50:57 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/504791a2-9892-4721-856a-e0b77a395d01/console.log" append="off"/>
Dec 06 12:50:57 user nova-compute[75247]:     </serial>
Dec 06 12:50:57 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:50:57 user nova-compute[75247]:     <video>
Dec 06 12:50:57 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:50:57 user nova-compute[75247]:     </video>
Dec 06 12:50:57 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:50:57 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:50:57 user nova-compute[75247]:     </rng>
Dec 06 12:50:57 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:50:57 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:50:57 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:50:57 user nova-compute[75247]:     </memballoon>
Dec 06 12:50:57 user nova-compute[75247]:   </devices>
Dec 06 12:50:57 user nova-compute[75247]: </domain>
Dec 06 12:50:57 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-548460361',display_name='tempest-AttachVolumeNegativeTest-server-548460361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-548460361',id=29,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsDqGZfCQcpUWP7TOkMrEcJYJs1a9WJmNto1njU4Mkh724U/nMXqizmwABxywMuU6TvrnjH+lAogQGhP9oMRJHp6pHJQKLFwnckt9ggsCPlL+/raC3W58S4XV2iShNT4g==',key_name='tempest-keypair-968485742',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a6b077946334f1c8fd16d091a7738e1',ramdisk_id='',reservation_id='r-j5esl516',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2136789566',owner_user_name='tempest-AttachVolumeNegativeTest-2136789566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:50:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d7becd4d5734bc2b652e6f37492eb5e',uuid=504791a2-9892-4721-856a-e0b77a395d01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d1f49fb-698e-43fd-8ef4-8ad8b2749f92", "address": "fa:16:3e:58:67:92", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d1f49fb-69", "ovs_interfaceid": "0d1f49fb-698e-43fd-8ef4-8ad8b2749f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Converting VIF {"id": "0d1f49fb-698e-43fd-8ef4-8ad8b2749f92", "address": "fa:16:3e:58:67:92", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d1f49fb-69", "ovs_interfaceid": "0d1f49fb-698e-43fd-8ef4-8ad8b2749f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:67:92,bridge_name='br-int',has_traffic_filtering=True,id=0d1f49fb-698e-43fd-8ef4-8ad8b2749f92,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d1f49fb-69') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG os_vif [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:67:92,bridge_name='br-int',has_traffic_filtering=True,id=0d1f49fb-698e-43fd-8ef4-8ad8b2749f92,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d1f49fb-69') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd8dbd7d-2ff2-50fe-a579-24e95e01a3e6', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d1f49fb-69, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d1f49fb-69, col_values=(('qos', UUID('6b2f3eb5-f7b9-4e36-b0dd-70e48989d562')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d1f49fb-69, col_values=(('external_ids', {'iface-id': '0d1f49fb-698e-43fd-8ef4-8ad8b2749f92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:67:92', 'vm-uuid': '504791a2-9892-4721-856a-e0b77a395d01'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:57 user nova-compute[75247]: INFO os_vif [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:67:92,bridge_name='br-int',has_traffic_filtering=True,id=0d1f49fb-698e-43fd-8ef4-8ad8b2749f92,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d1f49fb-69')
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] No VIF found with MAC fa:16:3e:58:67:92, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.network.neutron [req-67f73ca5-3032-4f41-8beb-bcbfe93061e9 req-4b72f100-4de7-4b4d-ab68-0c0b708c87c6 service nova] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Updated VIF entry in instance network info cache for port 0d1f49fb-698e-43fd-8ef4-8ad8b2749f92. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG nova.network.neutron [req-67f73ca5-3032-4f41-8beb-bcbfe93061e9 req-4b72f100-4de7-4b4d-ab68-0c0b708c87c6 service nova] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Updating instance_info_cache with network_info: [{"id": "0d1f49fb-698e-43fd-8ef4-8ad8b2749f92", "address": "fa:16:3e:58:67:92", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d1f49fb-69", "ovs_interfaceid": "0d1f49fb-698e-43fd-8ef4-8ad8b2749f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:50:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-67f73ca5-3032-4f41-8beb-bcbfe93061e9 req-4b72f100-4de7-4b4d-ab68-0c0b708c87c6 service nova] Releasing lock "refresh_cache-504791a2-9892-4721-856a-e0b77a395d01" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:50:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:59 user nova-compute[75247]: DEBUG nova.compute.manager [req-0010031f-b362-4970-af2b-0a2e938a3fc7 req-f7592a0d-1da1-417c-8c93-69541ee919cf service nova] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Received event network-vif-plugged-0d1f49fb-698e-43fd-8ef4-8ad8b2749f92 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:50:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0010031f-b362-4970-af2b-0a2e938a3fc7 req-f7592a0d-1da1-417c-8c93-69541ee919cf service nova] Acquiring lock "504791a2-9892-4721-856a-e0b77a395d01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:50:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0010031f-b362-4970-af2b-0a2e938a3fc7 req-f7592a0d-1da1-417c-8c93-69541ee919cf service nova] Lock "504791a2-9892-4721-856a-e0b77a395d01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:50:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0010031f-b362-4970-af2b-0a2e938a3fc7 req-f7592a0d-1da1-417c-8c93-69541ee919cf service nova] Lock "504791a2-9892-4721-856a-e0b77a395d01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:50:59 user nova-compute[75247]: DEBUG nova.compute.manager [req-0010031f-b362-4970-af2b-0a2e938a3fc7 req-f7592a0d-1da1-417c-8c93-69541ee919cf service nova] [instance: 504791a2-9892-4721-856a-e0b77a395d01] No waiting events found dispatching network-vif-plugged-0d1f49fb-698e-43fd-8ef4-8ad8b2749f92 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:50:59 user nova-compute[75247]: WARNING nova.compute.manager [req-0010031f-b362-4970-af2b-0a2e938a3fc7 req-f7592a0d-1da1-417c-8c93-69541ee919cf service nova] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Received unexpected event network-vif-plugged-0d1f49fb-698e-43fd-8ef4-8ad8b2749f92 for instance with vm_state building and task_state spawning.
Dec 06 12:50:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:50:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:01 user nova-compute[75247]: DEBUG nova.compute.manager [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:51:01 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:51:01 user nova-compute[75247]: DEBUG nova.compute.manager [req-a9b87116-dd29-4840-8c24-85a0389d3bf5 req-593d387d-9548-4a79-95bf-2e997bfd6955 service nova] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Received event network-vif-plugged-0d1f49fb-698e-43fd-8ef4-8ad8b2749f92 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:51:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a9b87116-dd29-4840-8c24-85a0389d3bf5 req-593d387d-9548-4a79-95bf-2e997bfd6955 service nova] Acquiring lock "504791a2-9892-4721-856a-e0b77a395d01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a9b87116-dd29-4840-8c24-85a0389d3bf5 req-593d387d-9548-4a79-95bf-2e997bfd6955 service nova] Lock "504791a2-9892-4721-856a-e0b77a395d01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a9b87116-dd29-4840-8c24-85a0389d3bf5 req-593d387d-9548-4a79-95bf-2e997bfd6955 service nova] Lock "504791a2-9892-4721-856a-e0b77a395d01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:01 user nova-compute[75247]: DEBUG nova.compute.manager [req-a9b87116-dd29-4840-8c24-85a0389d3bf5 req-593d387d-9548-4a79-95bf-2e997bfd6955 service nova] [instance: 504791a2-9892-4721-856a-e0b77a395d01] No waiting events found dispatching network-vif-plugged-0d1f49fb-698e-43fd-8ef4-8ad8b2749f92 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:51:01 user nova-compute[75247]: WARNING nova.compute.manager [req-a9b87116-dd29-4840-8c24-85a0389d3bf5 req-593d387d-9548-4a79-95bf-2e997bfd6955 service nova] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Received unexpected event network-vif-plugged-0d1f49fb-698e-43fd-8ef4-8ad8b2749f92 for instance with vm_state building and task_state spawning.
Dec 06 12:51:01 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Instance spawned successfully.
Dec 06 12:51:01 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:51:01 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:51:01 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:51:01 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:51:01 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:51:01 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:51:01 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:51:01 user nova-compute[75247]: INFO nova.compute.manager [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Took 5.60 seconds to spawn the instance on the hypervisor.
Dec 06 12:51:01 user nova-compute[75247]: DEBUG nova.compute.manager [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:51:01 user nova-compute[75247]: INFO nova.compute.manager [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Took 6.44 seconds to build instance.
Dec 06 12:51:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-429505d3-8277-4e4e-86aa-d17f51dc43b9 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "504791a2-9892-4721-856a-e0b77a395d01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.548s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:06 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:51:06 user nova-compute[75247]: INFO nova.compute.manager [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Rescuing
Dec 06 12:51:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "refresh_cache-530cfb75-7aa8-4e57-b282-8f7a21401b34" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:51:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquired lock "refresh_cache-530cfb75-7aa8-4e57-b282-8f7a21401b34" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:51:06 user nova-compute[75247]: DEBUG nova.network.neutron [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:51:07 user nova-compute[75247]: DEBUG nova.network.neutron [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Updating instance_info_cache with network_info: [{"id": "d924dd21-056e-413d-8fc1-493933e7e7e6", "address": "fa:16:3e:76:c7:97", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd924dd21-05", "ovs_interfaceid": "d924dd21-056e-413d-8fc1-493933e7e7e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:51:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Releasing lock "refresh_cache-530cfb75-7aa8-4e57-b282-8f7a21401b34" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:51:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:07 user nova-compute[75247]: DEBUG nova.compute.manager [req-eaccc298-ad5f-4f88-a392-a065ffc93454 req-0d286f0c-ceda-4d82-b366-976a81684648 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Received event network-vif-unplugged-d924dd21-056e-413d-8fc1-493933e7e7e6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:51:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-eaccc298-ad5f-4f88-a392-a065ffc93454 req-0d286f0c-ceda-4d82-b366-976a81684648 service nova] Acquiring lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-eaccc298-ad5f-4f88-a392-a065ffc93454 req-0d286f0c-ceda-4d82-b366-976a81684648 service nova] Lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-eaccc298-ad5f-4f88-a392-a065ffc93454 req-0d286f0c-ceda-4d82-b366-976a81684648 service nova] Lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:07 user nova-compute[75247]: DEBUG nova.compute.manager [req-eaccc298-ad5f-4f88-a392-a065ffc93454 req-0d286f0c-ceda-4d82-b366-976a81684648 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] No waiting events found dispatching network-vif-unplugged-d924dd21-056e-413d-8fc1-493933e7e7e6 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:51:07 user nova-compute[75247]: WARNING nova.compute.manager [req-eaccc298-ad5f-4f88-a392-a065ffc93454 req-0d286f0c-ceda-4d82-b366-976a81684648 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Received unexpected event network-vif-unplugged-d924dd21-056e-413d-8fc1-493933e7e7e6 for instance with vm_state active and task_state rescuing.
Dec 06 12:51:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:07 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:51:07 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75247) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:08 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Instance destroyed successfully.
Dec 06 12:51:08 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Attempting rescue
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75247) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Instance directory exists: not creating {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 06 12:51:08 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Creating image(s)
Dec 06 12:51:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "/opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "/opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "/opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.objects.instance [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'trusted_certs' on Instance uuid 530cfb75-7aa8-4e57-b282-8f7a21401b34 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.219s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue" returned: 0 in 0.064s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.objects.instance [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'migration_context' on Instance uuid 530cfb75-7aa8-4e57-b282-8f7a21401b34 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.objects.base [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Object Instance<530cfb75-7aa8-4e57-b282-8f7a21401b34> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Start _get_guest_xml network_info=[{"id": "d924dd21-056e-413d-8fc1-493933e7e7e6", "address": "fa:16:3e:76:c7:97", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "vif_mac": "fa:16:3e:76:c7:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd924dd21-05", "ovs_interfaceid": "d924dd21-056e-413d-8fc1-493933e7e7e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.objects.instance [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'resources' on Instance uuid 530cfb75-7aa8-4e57-b282-8f7a21401b34 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.objects.base [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Object Instance<530cfb75-7aa8-4e57-b282-8f7a21401b34> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.objects.instance [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'numa_topology' on Instance uuid 530cfb75-7aa8-4e57-b282-8f7a21401b34 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.objects.base [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Object Instance<530cfb75-7aa8-4e57-b282-8f7a21401b34> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:51:08 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:51:08 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.objects.instance [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'vcpu_model' on Instance uuid 530cfb75-7aa8-4e57-b282-8f7a21401b34 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.objects.base [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Object Instance<530cfb75-7aa8-4e57-b282-8f7a21401b34> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:49:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1228817559',display_name='tempest-ServerRescueNegativeTestJSON-server-1228817559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1228817559',id=26,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:49:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b253fd3ef3284dd885d3a0efc1ec07d7',ramdisk_id='',reservation_id='r-7yrk1w0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-295230580',owner_user_name='tempest-ServerRescueNegativeTestJSON-295230580-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:49:31Z,user_data=None,user_id='deac43cb03b440ff9de75801065ec9af',uuid=530cfb75-7aa8-4e57-b282-8f7a21401b34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d924dd21-056e-413d-8fc1-493933e7e7e6", "address": "fa:16:3e:76:c7:97", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "vif_mac": "fa:16:3e:76:c7:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd924dd21-05", "ovs_interfaceid": "d924dd21-056e-413d-8fc1-493933e7e7e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Converting VIF {"id": "d924dd21-056e-413d-8fc1-493933e7e7e6", "address": "fa:16:3e:76:c7:97", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "vif_mac": "fa:16:3e:76:c7:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd924dd21-05", "ovs_interfaceid": "d924dd21-056e-413d-8fc1-493933e7e7e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:c7:97,bridge_name='br-int',has_traffic_filtering=True,id=d924dd21-056e-413d-8fc1-493933e7e7e6,network=Network(579972e2-9933-47d9-b56b-f64b5650d611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd924dd21-05') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.objects.instance [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'pci_devices' on Instance uuid 530cfb75-7aa8-4e57-b282-8f7a21401b34 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.objects.base [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Object Instance<530cfb75-7aa8-4e57-b282-8f7a21401b34> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:51:08 user nova-compute[75247]:   <uuid>530cfb75-7aa8-4e57-b282-8f7a21401b34</uuid>
Dec 06 12:51:08 user nova-compute[75247]:   <name>instance-0000001a</name>
Dec 06 12:51:08 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:51:08 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:51:08 user nova-compute[75247]:   <metadata>
Dec 06 12:51:08 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:51:08 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:51:08 user nova-compute[75247]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1228817559</nova:name>
Dec 06 12:51:08 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:51:08</nova:creationTime>
Dec 06 12:51:08 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:51:08 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:51:08 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:51:08 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:51:08 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:51:08 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:51:08 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:51:08 user nova-compute[75247]:       <nova:owner>
Dec 06 12:51:08 user nova-compute[75247]:         <nova:user uuid="deac43cb03b440ff9de75801065ec9af">tempest-ServerRescueNegativeTestJSON-295230580-project-member</nova:user>
Dec 06 12:51:08 user nova-compute[75247]:         <nova:project uuid="b253fd3ef3284dd885d3a0efc1ec07d7">tempest-ServerRescueNegativeTestJSON-295230580</nova:project>
Dec 06 12:51:08 user nova-compute[75247]:       </nova:owner>
Dec 06 12:51:08 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:51:08 user nova-compute[75247]:       <nova:ports>
Dec 06 12:51:08 user nova-compute[75247]:         <nova:port uuid="d924dd21-056e-413d-8fc1-493933e7e7e6">
Dec 06 12:51:08 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 06 12:51:08 user nova-compute[75247]:         </nova:port>
Dec 06 12:51:08 user nova-compute[75247]:       </nova:ports>
Dec 06 12:51:08 user nova-compute[75247]:     </nova:instance>
Dec 06 12:51:08 user nova-compute[75247]:   </metadata>
Dec 06 12:51:08 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:51:08 user nova-compute[75247]:     <system>
Dec 06 12:51:08 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:51:08 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:51:08 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:51:08 user nova-compute[75247]:       <entry name="serial">530cfb75-7aa8-4e57-b282-8f7a21401b34</entry>
Dec 06 12:51:08 user nova-compute[75247]:       <entry name="uuid">530cfb75-7aa8-4e57-b282-8f7a21401b34</entry>
Dec 06 12:51:08 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:51:08 user nova-compute[75247]:     </system>
Dec 06 12:51:08 user nova-compute[75247]:   </sysinfo>
Dec 06 12:51:08 user nova-compute[75247]:   <os>
Dec 06 12:51:08 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:51:08 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:51:08 user nova-compute[75247]:   </os>
Dec 06 12:51:08 user nova-compute[75247]:   <features>
Dec 06 12:51:08 user nova-compute[75247]:     <acpi/>
Dec 06 12:51:08 user nova-compute[75247]:     <apic/>
Dec 06 12:51:08 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:51:08 user nova-compute[75247]:   </features>
Dec 06 12:51:08 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:51:08 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:51:08 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:51:08 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:51:08 user nova-compute[75247]:   </clock>
Dec 06 12:51:08 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:51:08 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:51:08 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:51:08 user nova-compute[75247]:   </cpu>
Dec 06 12:51:08 user nova-compute[75247]:   <devices>
Dec 06 12:51:08 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:51:08 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:51:08 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue"/>
Dec 06 12:51:08 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:51:08 user nova-compute[75247]:     </disk>
Dec 06 12:51:08 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:51:08 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:51:08 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk"/>
Dec 06 12:51:08 user nova-compute[75247]:       <target dev="vdb" bus="virtio"/>
Dec 06 12:51:08 user nova-compute[75247]:     </disk>
Dec 06 12:51:08 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:51:08 user nova-compute[75247]:       <mac address="fa:16:3e:76:c7:97"/>
Dec 06 12:51:08 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:51:08 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:51:08 user nova-compute[75247]:       <target dev="tapd924dd21-05"/>
Dec 06 12:51:08 user nova-compute[75247]:     </interface>
Dec 06 12:51:08 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:51:08 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/console.log" append="off"/>
Dec 06 12:51:08 user nova-compute[75247]:     </serial>
Dec 06 12:51:08 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:51:08 user nova-compute[75247]:     <video>
Dec 06 12:51:08 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:51:08 user nova-compute[75247]:     </video>
Dec 06 12:51:08 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:51:08 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:51:08 user nova-compute[75247]:     </rng>
Dec 06 12:51:08 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:51:08 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:51:08 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:51:08 user nova-compute[75247]:     </memballoon>
Dec 06 12:51:08 user nova-compute[75247]:   </devices>
Dec 06 12:51:08 user nova-compute[75247]: </domain>
Dec 06 12:51:08 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:51:08 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Instance destroyed successfully.
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:51:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] No VIF found with MAC fa:16:3e:76:c7:97, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:51:09 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:51:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-21f64c4d-69ac-493d-afac-3cdfbddff254 req-e98ecf01-600b-4f83-afa6-041e626c3a96 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Received event network-vif-plugged-d924dd21-056e-413d-8fc1-493933e7e7e6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:51:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-21f64c4d-69ac-493d-afac-3cdfbddff254 req-e98ecf01-600b-4f83-afa6-041e626c3a96 service nova] Acquiring lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-21f64c4d-69ac-493d-afac-3cdfbddff254 req-e98ecf01-600b-4f83-afa6-041e626c3a96 service nova] Lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-21f64c4d-69ac-493d-afac-3cdfbddff254 req-e98ecf01-600b-4f83-afa6-041e626c3a96 service nova] Lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-21f64c4d-69ac-493d-afac-3cdfbddff254 req-e98ecf01-600b-4f83-afa6-041e626c3a96 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] No waiting events found dispatching network-vif-plugged-d924dd21-056e-413d-8fc1-493933e7e7e6 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:51:10 user nova-compute[75247]: WARNING nova.compute.manager [req-21f64c4d-69ac-493d-afac-3cdfbddff254 req-e98ecf01-600b-4f83-afa6-041e626c3a96 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Received unexpected event network-vif-plugged-d924dd21-056e-413d-8fc1-493933e7e7e6 for instance with vm_state active and task_state rescuing.
Dec 06 12:51:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:10 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:51:10 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:51:10 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:51:10 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 12:51:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Acquiring lock "9b042a8f-4f9c-4704-8b48-f9eba4f8014b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "9b042a8f-4f9c-4704-8b48-f9eba4f8014b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Acquiring lock "9b042a8f-4f9c-4704-8b48-f9eba4f8014b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "9b042a8f-4f9c-4704-8b48-f9eba4f8014b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "9b042a8f-4f9c-4704-8b48-f9eba4f8014b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:11 user nova-compute[75247]: INFO nova.compute.manager [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Terminating instance
Dec 06 12:51:11 user nova-compute[75247]: DEBUG nova.compute.manager [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:51:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:11 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG nova.compute.manager [req-a25f00cb-3e10-4616-8587-bae8a899a30a req-2eb22bfa-c493-44da-a0d0-dab5cf671ca1 service nova] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Received event network-vif-unplugged-afacb60d-782e-47e5-9eb3-64b3ad760da0 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a25f00cb-3e10-4616-8587-bae8a899a30a req-2eb22bfa-c493-44da-a0d0-dab5cf671ca1 service nova] Acquiring lock "9b042a8f-4f9c-4704-8b48-f9eba4f8014b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a25f00cb-3e10-4616-8587-bae8a899a30a req-2eb22bfa-c493-44da-a0d0-dab5cf671ca1 service nova] Lock "9b042a8f-4f9c-4704-8b48-f9eba4f8014b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a25f00cb-3e10-4616-8587-bae8a899a30a req-2eb22bfa-c493-44da-a0d0-dab5cf671ca1 service nova] Lock "9b042a8f-4f9c-4704-8b48-f9eba4f8014b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG nova.compute.manager [req-a25f00cb-3e10-4616-8587-bae8a899a30a req-2eb22bfa-c493-44da-a0d0-dab5cf671ca1 service nova] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] No waiting events found dispatching network-vif-unplugged-afacb60d-782e-47e5-9eb3-64b3ad760da0 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG nova.compute.manager [req-a25f00cb-3e10-4616-8587-bae8a899a30a req-2eb22bfa-c493-44da-a0d0-dab5cf671ca1 service nova] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Received event network-vif-unplugged-afacb60d-782e-47e5-9eb3-64b3ad760da0 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:51:12 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Instance destroyed successfully.
Dec 06 12:51:12 user nova-compute[75247]: DEBUG nova.objects.instance [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lazy-loading 'resources' on Instance uuid 9b042a8f-4f9c-4704-8b48-f9eba4f8014b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:49:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1125904575',display_name='tempest-VolumesAdminNegativeTest-server-1125904575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1125904575',id=24,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:49:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4efbc08c0354cb28d4d62be836f5e6f',ramdisk_id='',reservation_id='r-2rjank0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2088368587',owner_user_name='tempest-VolumesAdminNegativeTest-2088368587-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:49:21Z,user_data=None,user_id='bf32752c9f2d404b8ee4819e72e1b516',uuid=9b042a8f-4f9c-4704-8b48-f9eba4f8014b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "afacb60d-782e-47e5-9eb3-64b3ad760da0", "address": "fa:16:3e:cc:f8:8a", "network": {"id": "783b08eb-3a13-4dea-a30d-94ce21434b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-358384266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4efbc08c0354cb28d4d62be836f5e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafacb60d-78", "ovs_interfaceid": "afacb60d-782e-47e5-9eb3-64b3ad760da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Converting VIF {"id": "afacb60d-782e-47e5-9eb3-64b3ad760da0", "address": "fa:16:3e:cc:f8:8a", "network": {"id": "783b08eb-3a13-4dea-a30d-94ce21434b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-358384266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4efbc08c0354cb28d4d62be836f5e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafacb60d-78", "ovs_interfaceid": "afacb60d-782e-47e5-9eb3-64b3ad760da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f8:8a,bridge_name='br-int',has_traffic_filtering=True,id=afacb60d-782e-47e5-9eb3-64b3ad760da0,network=Network(783b08eb-3a13-4dea-a30d-94ce21434b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafacb60d-78') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG os_vif [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f8:8a,bridge_name='br-int',has_traffic_filtering=True,id=afacb60d-782e-47e5-9eb3-64b3ad760da0,network=Network(783b08eb-3a13-4dea-a30d-94ce21434b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafacb60d-78') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapafacb60d-78, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG nova.compute.manager [req-7e037a9e-0f24-4d13-aaf8-c05e046f44e0 req-387597b5-b081-4b5b-8101-01465772c3c0 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Received event network-vif-plugged-d924dd21-056e-413d-8fc1-493933e7e7e6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7e037a9e-0f24-4d13-aaf8-c05e046f44e0 req-387597b5-b081-4b5b-8101-01465772c3c0 service nova] Acquiring lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7e037a9e-0f24-4d13-aaf8-c05e046f44e0 req-387597b5-b081-4b5b-8101-01465772c3c0 service nova] Lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7e037a9e-0f24-4d13-aaf8-c05e046f44e0 req-387597b5-b081-4b5b-8101-01465772c3c0 service nova] Lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG nova.compute.manager [req-7e037a9e-0f24-4d13-aaf8-c05e046f44e0 req-387597b5-b081-4b5b-8101-01465772c3c0 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] No waiting events found dispatching network-vif-plugged-d924dd21-056e-413d-8fc1-493933e7e7e6 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:51:12 user nova-compute[75247]: WARNING nova.compute.manager [req-7e037a9e-0f24-4d13-aaf8-c05e046f44e0 req-387597b5-b081-4b5b-8101-01465772c3c0 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Received unexpected event network-vif-plugged-d924dd21-056e-413d-8fc1-493933e7e7e6 for instance with vm_state active and task_state rescuing.
Dec 06 12:51:12 user nova-compute[75247]: DEBUG nova.compute.manager [req-7e037a9e-0f24-4d13-aaf8-c05e046f44e0 req-387597b5-b081-4b5b-8101-01465772c3c0 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Received event network-vif-plugged-d924dd21-056e-413d-8fc1-493933e7e7e6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7e037a9e-0f24-4d13-aaf8-c05e046f44e0 req-387597b5-b081-4b5b-8101-01465772c3c0 service nova] Acquiring lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7e037a9e-0f24-4d13-aaf8-c05e046f44e0 req-387597b5-b081-4b5b-8101-01465772c3c0 service nova] Lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7e037a9e-0f24-4d13-aaf8-c05e046f44e0 req-387597b5-b081-4b5b-8101-01465772c3c0 service nova] Lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG nova.compute.manager [req-7e037a9e-0f24-4d13-aaf8-c05e046f44e0 req-387597b5-b081-4b5b-8101-01465772c3c0 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] No waiting events found dispatching network-vif-plugged-d924dd21-056e-413d-8fc1-493933e7e7e6 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:51:12 user nova-compute[75247]: WARNING nova.compute.manager [req-7e037a9e-0f24-4d13-aaf8-c05e046f44e0 req-387597b5-b081-4b5b-8101-01465772c3c0 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Received unexpected event network-vif-plugged-d924dd21-056e-413d-8fc1-493933e7e7e6 for instance with vm_state active and task_state rescuing.
Dec 06 12:51:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ec2c23f-2127-45ec-81ad-b0c4663cdb50) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:12 user nova-compute[75247]: INFO os_vif [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f8:8a,bridge_name='br-int',has_traffic_filtering=True,id=afacb60d-782e-47e5-9eb3-64b3ad760da0,network=Network(783b08eb-3a13-4dea-a30d-94ce21434b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafacb60d-78')
Dec 06 12:51:12 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Deleting instance files /opt/stack/data/nova/instances/9b042a8f-4f9c-4704-8b48-f9eba4f8014b_del
Dec 06 12:51:12 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Deletion of /opt/stack/data/nova/instances/9b042a8f-4f9c-4704-8b48-f9eba4f8014b_del complete
Dec 06 12:51:12 user nova-compute[75247]: INFO nova.compute.manager [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Took 0.73 seconds to destroy the instance on the hypervisor.
Dec 06 12:51:12 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG nova.compute.manager [None req-be44c6d8-2676-4021-afce-e7dc9ca220b2 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:51:12 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:51:12 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Took 0.51 seconds to deallocate network for instance.
Dec 06 12:51:12 user nova-compute[75247]: DEBUG nova.compute.manager [req-32c31386-bdb6-4e51-94a9-d57fc662331a req-76440e03-5722-43aa-85b3-037310621359 service nova] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Received event network-vif-deleted-afacb60d-782e-47e5-9eb3-64b3ad760da0 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:51:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:13 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Refreshing inventories for resource provider d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 12:51:13 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Updating ProviderTree inventory for provider d326b140-3450-4409-964c-9eafc6cc025d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 12:51:13 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Updating inventory in ProviderTree for provider d326b140-3450-4409-964c-9eafc6cc025d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 12:51:13 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Refreshing aggregate associations for resource provider d326b140-3450-4409-964c-9eafc6cc025d, aggregates: None {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 12:51:13 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Refreshing trait associations for resource provider d326b140-3450-4409-964c-9eafc6cc025d, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 12:51:13 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:51:13 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:51:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.769s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:13 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Deleted allocations for instance 9b042a8f-4f9c-4704-8b48-f9eba4f8014b
Dec 06 12:51:13 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:51:13 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 12:51:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3d985517-4a09-4adc-9d8c-cff8188737f3 tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "9b042a8f-4f9c-4704-8b48-f9eba4f8014b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.230s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-db837c7a-c52d-469b-abf7-cea107454c60" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:51:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-db837c7a-c52d-469b-abf7-cea107454c60" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:51:14 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 12:51:14 user nova-compute[75247]: DEBUG nova.compute.manager [req-7b0c4a02-2931-48d3-8c48-3371423938d8 req-9e188d38-48e4-4f18-8fb0-73872fee0652 service nova] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Received event network-vif-plugged-afacb60d-782e-47e5-9eb3-64b3ad760da0 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:51:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7b0c4a02-2931-48d3-8c48-3371423938d8 req-9e188d38-48e4-4f18-8fb0-73872fee0652 service nova] Acquiring lock "9b042a8f-4f9c-4704-8b48-f9eba4f8014b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7b0c4a02-2931-48d3-8c48-3371423938d8 req-9e188d38-48e4-4f18-8fb0-73872fee0652 service nova] Lock "9b042a8f-4f9c-4704-8b48-f9eba4f8014b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7b0c4a02-2931-48d3-8c48-3371423938d8 req-9e188d38-48e4-4f18-8fb0-73872fee0652 service nova] Lock "9b042a8f-4f9c-4704-8b48-f9eba4f8014b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:14 user nova-compute[75247]: DEBUG nova.compute.manager [req-7b0c4a02-2931-48d3-8c48-3371423938d8 req-9e188d38-48e4-4f18-8fb0-73872fee0652 service nova] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] No waiting events found dispatching network-vif-plugged-afacb60d-782e-47e5-9eb3-64b3ad760da0 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:51:14 user nova-compute[75247]: WARNING nova.compute.manager [req-7b0c4a02-2931-48d3-8c48-3371423938d8 req-9e188d38-48e4-4f18-8fb0-73872fee0652 service nova] [instance: 9b042a8f-4f9c-4704-8b48-f9eba4f8014b] Received unexpected event network-vif-plugged-afacb60d-782e-47e5-9eb3-64b3ad760da0 for instance with vm_state deleted and task_state None.
Dec 06 12:51:14 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Updating instance_info_cache with network_info: [{"id": "861bfd56-2888-46b4-b583-08526d05bcd6", "address": "fa:16:3e:eb:bc:82", "network": {"id": "52a97bc9-88b7-430a-80c8-3d6210441943", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1761062078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8f578ae9d44706b68eaac234ae6d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861bfd56-28", "ovs_interfaceid": "861bfd56-2888-46b4-b583-08526d05bcd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:51:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-db837c7a-c52d-469b-abf7-cea107454c60" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:51:14 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 12:51:15 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:51:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:15 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 12:51:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:16 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:51:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:51:16 user nova-compute[75247]: INFO nova.compute.claims [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Claim successful on node user
Dec 06 12:51:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/504791a2-9892-4721-856a-e0b77a395d01/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/504791a2-9892-4721-856a-e0b77a395d01/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/504791a2-9892-4721-856a-e0b77a395d01/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:17 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:51:17 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:51:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.653s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:17 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:51:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/504791a2-9892-4721-856a-e0b77a395d01/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:17 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:51:17 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:51:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:17 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:51:17 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:51:17 user nova-compute[75247]: DEBUG nova.policy [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4cb0e32ba6094d1e8053787bc1979b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3aeaf6ffdb4cc0807d90e73e92fa7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:51:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:17 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:51:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:51:17 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Creating image(s)
Dec 06 12:51:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e7f8114-2e5d-4bf6-bb31-b00666f0d901/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "/opt/stack/data/nova/instances/0e7f8114-2e5d-4bf6-bb31-b00666f0d901/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "/opt/stack/data/nova/instances/0e7f8114-2e5d-4bf6-bb31-b00666f0d901/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.205s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.203s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/0e7f8114-2e5d-4bf6-bb31-b00666f0d901/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/0e7f8114-2e5d-4bf6-bb31-b00666f0d901/disk 1073741824" returned: 0 in 0.053s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Successfully created port: 8a76a9ce-2bbc-4989-9fcb-66cce8adf16b {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.225s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e7f8114-2e5d-4bf6-bb31-b00666f0d901/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7f8114-2e5d-4bf6-bb31-b00666f0d901/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7f8114-2e5d-4bf6-bb31-b00666f0d901/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Cannot resize image /opt/stack/data/nova/instances/0e7f8114-2e5d-4bf6-bb31-b00666f0d901/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Ensure instance console log exists: /opt/stack/data/nova/instances/0e7f8114-2e5d-4bf6-bb31-b00666f0d901/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk.rescue --force-share --output=json" returned: 0 in 0.243s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f7d945-3eae-4dbe-928e-389620e62353/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:19 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Successfully updated port: 8a76a9ce-2bbc-4989-9fcb-66cce8adf16b {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:51:19 user nova-compute[75247]: DEBUG nova.compute.manager [req-c448f84e-a5b4-436d-a272-a50473a3412d req-fbbbc63c-7712-4414-a7e2-57523171ecfd service nova] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Received event network-changed-8a76a9ce-2bbc-4989-9fcb-66cce8adf16b {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:51:19 user nova-compute[75247]: DEBUG nova.compute.manager [req-c448f84e-a5b4-436d-a272-a50473a3412d req-fbbbc63c-7712-4414-a7e2-57523171ecfd service nova] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Refreshing instance network info cache due to event network-changed-8a76a9ce-2bbc-4989-9fcb-66cce8adf16b. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:51:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c448f84e-a5b4-436d-a272-a50473a3412d req-fbbbc63c-7712-4414-a7e2-57523171ecfd service nova] Acquiring lock "refresh_cache-0e7f8114-2e5d-4bf6-bb31-b00666f0d901" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:51:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c448f84e-a5b4-436d-a272-a50473a3412d req-fbbbc63c-7712-4414-a7e2-57523171ecfd service nova] Acquired lock "refresh_cache-0e7f8114-2e5d-4bf6-bb31-b00666f0d901" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:51:19 user nova-compute[75247]: DEBUG nova.network.neutron [req-c448f84e-a5b4-436d-a272-a50473a3412d req-fbbbc63c-7712-4414-a7e2-57523171ecfd service nova] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Refreshing network info cache for port 8a76a9ce-2bbc-4989-9fcb-66cce8adf16b {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:51:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "refresh_cache-0e7f8114-2e5d-4bf6-bb31-b00666f0d901" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:51:19 user nova-compute[75247]: DEBUG nova.network.neutron [req-c448f84e-a5b4-436d-a272-a50473a3412d req-fbbbc63c-7712-4414-a7e2-57523171ecfd service nova] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:51:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f7d945-3eae-4dbe-928e-389620e62353/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f7d945-3eae-4dbe-928e-389620e62353/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:19 user nova-compute[75247]: DEBUG nova.network.neutron [req-c448f84e-a5b4-436d-a272-a50473a3412d req-fbbbc63c-7712-4414-a7e2-57523171ecfd service nova] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:51:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c448f84e-a5b4-436d-a272-a50473a3412d req-fbbbc63c-7712-4414-a7e2-57523171ecfd service nova] Releasing lock "refresh_cache-0e7f8114-2e5d-4bf6-bb31-b00666f0d901" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:51:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquired lock "refresh_cache-0e7f8114-2e5d-4bf6-bb31-b00666f0d901" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:51:19 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f7d945-3eae-4dbe-928e-389620e62353/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Updating instance_info_cache with network_info: [{"id": "8a76a9ce-2bbc-4989-9fcb-66cce8adf16b", "address": "fa:16:3e:67:2a:53", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a76a9ce-2b", "ovs_interfaceid": "8a76a9ce-2bbc-4989-9fcb-66cce8adf16b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Releasing lock "refresh_cache-0e7f8114-2e5d-4bf6-bb31-b00666f0d901" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Instance network_info: |[{"id": "8a76a9ce-2bbc-4989-9fcb-66cce8adf16b", "address": "fa:16:3e:67:2a:53", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a76a9ce-2b", "ovs_interfaceid": "8a76a9ce-2bbc-4989-9fcb-66cce8adf16b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Start _get_guest_xml network_info=[{"id": "8a76a9ce-2bbc-4989-9fcb-66cce8adf16b", "address": "fa:16:3e:67:2a:53", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a76a9ce-2b", "ovs_interfaceid": "8a76a9ce-2bbc-4989-9fcb-66cce8adf16b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:51:20 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:51:20 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:51:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1435568381',display_name='tempest-AttachVolumeTestJSON-server-1435568381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1435568381',id=30,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeC3Lxqos3L/j7GsxbWERod31gMNYOh1WvDp2eLcoFHCmccbaJ0Azy260YTcypWiKfWA/hNruUSMbgPcCcPBaCDpII0NLAW1z4+pb8a4RbrKEPhWaImdiv7EkBwvVj0CQ==',key_name='tempest-keypair-1203396339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f3aeaf6ffdb4cc0807d90e73e92fa7e',ramdisk_id='',reservation_id='r-5wriy0n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-209684424',owner_user_name='tempest-AttachVolumeTestJSON-209684424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:51:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cb0e32ba6094d1e8053787bc1979b65',uuid=0e7f8114-2e5d-4bf6-bb31-b00666f0d901,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a76a9ce-2bbc-4989-9fcb-66cce8adf16b", "address": "fa:16:3e:67:2a:53", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a76a9ce-2b", "ovs_interfaceid": "8a76a9ce-2bbc-4989-9fcb-66cce8adf16b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Converting VIF {"id": "8a76a9ce-2bbc-4989-9fcb-66cce8adf16b", "address": "fa:16:3e:67:2a:53", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a76a9ce-2b", "ovs_interfaceid": "8a76a9ce-2bbc-4989-9fcb-66cce8adf16b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:2a:53,bridge_name='br-int',has_traffic_filtering=True,id=8a76a9ce-2bbc-4989-9fcb-66cce8adf16b,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a76a9ce-2b') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.objects.instance [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e7f8114-2e5d-4bf6-bb31-b00666f0d901 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:51:20 user nova-compute[75247]:   <uuid>0e7f8114-2e5d-4bf6-bb31-b00666f0d901</uuid>
Dec 06 12:51:20 user nova-compute[75247]:   <name>instance-0000001e</name>
Dec 06 12:51:20 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:51:20 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:51:20 user nova-compute[75247]:   <metadata>
Dec 06 12:51:20 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:51:20 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:51:20 user nova-compute[75247]:       <nova:name>tempest-AttachVolumeTestJSON-server-1435568381</nova:name>
Dec 06 12:51:20 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:51:20</nova:creationTime>
Dec 06 12:51:20 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:51:20 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:51:20 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:51:20 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:51:20 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:51:20 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:51:20 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:51:20 user nova-compute[75247]:       <nova:owner>
Dec 06 12:51:20 user nova-compute[75247]:         <nova:user uuid="4cb0e32ba6094d1e8053787bc1979b65">tempest-AttachVolumeTestJSON-209684424-project-member</nova:user>
Dec 06 12:51:20 user nova-compute[75247]:         <nova:project uuid="4f3aeaf6ffdb4cc0807d90e73e92fa7e">tempest-AttachVolumeTestJSON-209684424</nova:project>
Dec 06 12:51:20 user nova-compute[75247]:       </nova:owner>
Dec 06 12:51:20 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:51:20 user nova-compute[75247]:       <nova:ports>
Dec 06 12:51:20 user nova-compute[75247]:         <nova:port uuid="8a76a9ce-2bbc-4989-9fcb-66cce8adf16b">
Dec 06 12:51:20 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 12:51:20 user nova-compute[75247]:         </nova:port>
Dec 06 12:51:20 user nova-compute[75247]:       </nova:ports>
Dec 06 12:51:20 user nova-compute[75247]:     </nova:instance>
Dec 06 12:51:20 user nova-compute[75247]:   </metadata>
Dec 06 12:51:20 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:51:20 user nova-compute[75247]:     <system>
Dec 06 12:51:20 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:51:20 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:51:20 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:51:20 user nova-compute[75247]:       <entry name="serial">0e7f8114-2e5d-4bf6-bb31-b00666f0d901</entry>
Dec 06 12:51:20 user nova-compute[75247]:       <entry name="uuid">0e7f8114-2e5d-4bf6-bb31-b00666f0d901</entry>
Dec 06 12:51:20 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:51:20 user nova-compute[75247]:     </system>
Dec 06 12:51:20 user nova-compute[75247]:   </sysinfo>
Dec 06 12:51:20 user nova-compute[75247]:   <os>
Dec 06 12:51:20 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:51:20 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:51:20 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:51:20 user nova-compute[75247]:   </os>
Dec 06 12:51:20 user nova-compute[75247]:   <features>
Dec 06 12:51:20 user nova-compute[75247]:     <acpi/>
Dec 06 12:51:20 user nova-compute[75247]:     <apic/>
Dec 06 12:51:20 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:51:20 user nova-compute[75247]:   </features>
Dec 06 12:51:20 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:51:20 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:51:20 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:51:20 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:51:20 user nova-compute[75247]:   </clock>
Dec 06 12:51:20 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:51:20 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:51:20 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:51:20 user nova-compute[75247]:   </cpu>
Dec 06 12:51:20 user nova-compute[75247]:   <devices>
Dec 06 12:51:20 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:51:20 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:51:20 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/0e7f8114-2e5d-4bf6-bb31-b00666f0d901/disk"/>
Dec 06 12:51:20 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:51:20 user nova-compute[75247]:     </disk>
Dec 06 12:51:20 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:51:20 user nova-compute[75247]:       <mac address="fa:16:3e:67:2a:53"/>
Dec 06 12:51:20 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:51:20 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:51:20 user nova-compute[75247]:       <target dev="tap8a76a9ce-2b"/>
Dec 06 12:51:20 user nova-compute[75247]:     </interface>
Dec 06 12:51:20 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:51:20 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/0e7f8114-2e5d-4bf6-bb31-b00666f0d901/console.log" append="off"/>
Dec 06 12:51:20 user nova-compute[75247]:     </serial>
Dec 06 12:51:20 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:51:20 user nova-compute[75247]:     <video>
Dec 06 12:51:20 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:51:20 user nova-compute[75247]:     </video>
Dec 06 12:51:20 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:51:20 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:51:20 user nova-compute[75247]:     </rng>
Dec 06 12:51:20 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:51:20 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:51:20 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:51:20 user nova-compute[75247]:     </memballoon>
Dec 06 12:51:20 user nova-compute[75247]:   </devices>
Dec 06 12:51:20 user nova-compute[75247]: </domain>
Dec 06 12:51:20 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:51:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1435568381',display_name='tempest-AttachVolumeTestJSON-server-1435568381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1435568381',id=30,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeC3Lxqos3L/j7GsxbWERod31gMNYOh1WvDp2eLcoFHCmccbaJ0Azy260YTcypWiKfWA/hNruUSMbgPcCcPBaCDpII0NLAW1z4+pb8a4RbrKEPhWaImdiv7EkBwvVj0CQ==',key_name='tempest-keypair-1203396339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f3aeaf6ffdb4cc0807d90e73e92fa7e',ramdisk_id='',reservation_id='r-5wriy0n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-209684424',owner_user_name='tempest-AttachVolumeTestJSON-209684424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:51:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cb0e32ba6094d1e8053787bc1979b65',uuid=0e7f8114-2e5d-4bf6-bb31-b00666f0d901,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a76a9ce-2bbc-4989-9fcb-66cce8adf16b", "address": "fa:16:3e:67:2a:53", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a76a9ce-2b", "ovs_interfaceid": "8a76a9ce-2bbc-4989-9fcb-66cce8adf16b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Converting VIF {"id": "8a76a9ce-2bbc-4989-9fcb-66cce8adf16b", "address": "fa:16:3e:67:2a:53", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a76a9ce-2b", "ovs_interfaceid": "8a76a9ce-2bbc-4989-9fcb-66cce8adf16b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:2a:53,bridge_name='br-int',has_traffic_filtering=True,id=8a76a9ce-2bbc-4989-9fcb-66cce8adf16b,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a76a9ce-2b') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG os_vif [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:2a:53,bridge_name='br-int',has_traffic_filtering=True,id=8a76a9ce-2bbc-4989-9fcb-66cce8adf16b,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a76a9ce-2b') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39d530b8-3f99-5355-a81b-11572c3559f4', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a76a9ce-2b, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a76a9ce-2b, col_values=(('qos', UUID('83bba9e6-8d3d-46ae-a83c-b583f5b662a3')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a76a9ce-2b, col_values=(('external_ids', {'iface-id': '8a76a9ce-2bbc-4989-9fcb-66cce8adf16b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:2a:53', 'vm-uuid': '0e7f8114-2e5d-4bf6-bb31-b00666f0d901'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:20 user nova-compute[75247]: INFO os_vif [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:2a:53,bridge_name='br-int',has_traffic_filtering=True,id=8a76a9ce-2bbc-4989-9fcb-66cce8adf16b,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a76a9ce-2b')
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] No VIF found with MAC fa:16:3e:67:2a:53, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:21 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:51:21 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:51:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=7471MB free_disk=24.89272689819336GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 12:51:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 70c4664e-ae7a-47de-bba7-18300391d209 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 782289e2-91cd-4aee-9a08-eadfb2a5965b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 3e1b5197-dc38-48a5-b9f9-e053be499433 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance db837c7a-c52d-469b-abf7-cea107454c60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance ea75ba22-b4af-4454-93ed-cdfdc76a895b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance bc3ddb40-b05f-4170-b269-d44dec6ecdaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 530cfb75-7aa8-4e57-b282-8f7a21401b34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 56f7d945-3eae-4dbe-928e-389620e62353 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 92d215fd-8411-430c-b91e-b6e62e02a994 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 504791a2-9892-4721-856a-e0b77a395d01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 0e7f8114-2e5d-4bf6-bb31-b00666f0d901 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-160479d3-aff8-44ca-95c3-de9fae0d4c63 req-d900e148-b291-4ce3-b94b-fdb265460359 service nova] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Received event network-vif-plugged-8a76a9ce-2bbc-4989-9fcb-66cce8adf16b {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-160479d3-aff8-44ca-95c3-de9fae0d4c63 req-d900e148-b291-4ce3-b94b-fdb265460359 service nova] Acquiring lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-160479d3-aff8-44ca-95c3-de9fae0d4c63 req-d900e148-b291-4ce3-b94b-fdb265460359 service nova] Lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-160479d3-aff8-44ca-95c3-de9fae0d4c63 req-d900e148-b291-4ce3-b94b-fdb265460359 service nova] Lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-160479d3-aff8-44ca-95c3-de9fae0d4c63 req-d900e148-b291-4ce3-b94b-fdb265460359 service nova] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] No waiting events found dispatching network-vif-plugged-8a76a9ce-2bbc-4989-9fcb-66cce8adf16b {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:51:22 user nova-compute[75247]: WARNING nova.compute.manager [req-160479d3-aff8-44ca-95c3-de9fae0d4c63 req-d900e148-b291-4ce3-b94b-fdb265460359 service nova] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Received unexpected event network-vif-plugged-8a76a9ce-2bbc-4989-9fcb-66cce8adf16b for instance with vm_state building and task_state spawning.
Dec 06 12:51:22 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.777s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Cleaning up deleted instances {{(pid=75247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:22 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] There are 0 instances to clean {{(pid=75247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 12:51:23 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:51:23 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:51:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:24 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:51:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:51:24 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Instance spawned successfully.
Dec 06 12:51:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:51:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:51:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:51:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:51:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:51:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:51:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:51:24 user nova-compute[75247]: INFO nova.compute.manager [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Took 6.60 seconds to spawn the instance on the hypervisor.
Dec 06 12:51:24 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:51:24 user nova-compute[75247]: DEBUG nova.compute.manager [req-06f938f4-343b-47eb-8cee-150f8404044c req-0c63e07d-da06-43bf-94c3-e91f04aea3a7 service nova] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Received event network-vif-plugged-8a76a9ce-2bbc-4989-9fcb-66cce8adf16b {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:51:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-06f938f4-343b-47eb-8cee-150f8404044c req-0c63e07d-da06-43bf-94c3-e91f04aea3a7 service nova] Acquiring lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-06f938f4-343b-47eb-8cee-150f8404044c req-0c63e07d-da06-43bf-94c3-e91f04aea3a7 service nova] Lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-06f938f4-343b-47eb-8cee-150f8404044c req-0c63e07d-da06-43bf-94c3-e91f04aea3a7 service nova] Lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:24 user nova-compute[75247]: DEBUG nova.compute.manager [req-06f938f4-343b-47eb-8cee-150f8404044c req-0c63e07d-da06-43bf-94c3-e91f04aea3a7 service nova] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] No waiting events found dispatching network-vif-plugged-8a76a9ce-2bbc-4989-9fcb-66cce8adf16b {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:51:24 user nova-compute[75247]: WARNING nova.compute.manager [req-06f938f4-343b-47eb-8cee-150f8404044c req-0c63e07d-da06-43bf-94c3-e91f04aea3a7 service nova] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Received unexpected event network-vif-plugged-8a76a9ce-2bbc-4989-9fcb-66cce8adf16b for instance with vm_state building and task_state spawning.
Dec 06 12:51:24 user nova-compute[75247]: INFO nova.compute.manager [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Took 7.86 seconds to build instance.
Dec 06 12:51:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e7ceee17-8885-4ebc-b467-088153451e41 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.994s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "6d767ae1-4df2-4e87-b991-729fabd467f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:47 user nova-compute[75247]: DEBUG nova.compute.manager [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:51:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:47 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:51:47 user nova-compute[75247]: INFO nova.compute.claims [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Claim successful on node user
Dec 06 12:51:47 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:51:47 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:51:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:47 user nova-compute[75247]: DEBUG nova.compute.manager [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:51:47 user nova-compute[75247]: DEBUG nova.compute.manager [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:51:47 user nova-compute[75247]: DEBUG nova.network.neutron [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:51:47 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:51:47 user nova-compute[75247]: DEBUG nova.compute.manager [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:51:47 user nova-compute[75247]: DEBUG nova.policy [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0efa55fc4754d96a33d07d52342d8f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222da79e3583495d90d5442029996343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:51:47 user nova-compute[75247]: INFO nova.virt.block_device [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Booting with volume-backed-image 8242af4f-c2f6-4990-9385-f1348e8ff114 at /dev/vda
Dec 06 12:51:48 user nova-compute[75247]: DEBUG nova.network.neutron [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Successfully created port: 63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:51:48 user nova-compute[75247]: INFO nova.compute.manager [None req-bf7a46fa-b02d-4b70-ad0d-b53d62179a7f tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Unrescuing
Dec 06 12:51:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bf7a46fa-b02d-4b70-ad0d-b53d62179a7f tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Acquiring lock "refresh_cache-db837c7a-c52d-469b-abf7-cea107454c60" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:51:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bf7a46fa-b02d-4b70-ad0d-b53d62179a7f tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Acquired lock "refresh_cache-db837c7a-c52d-469b-abf7-cea107454c60" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:51:48 user nova-compute[75247]: DEBUG nova.network.neutron [None req-bf7a46fa-b02d-4b70-ad0d-b53d62179a7f tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:51:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:49 user nova-compute[75247]: DEBUG nova.network.neutron [None req-bf7a46fa-b02d-4b70-ad0d-b53d62179a7f tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Updating instance_info_cache with network_info: [{"id": "861bfd56-2888-46b4-b583-08526d05bcd6", "address": "fa:16:3e:eb:bc:82", "network": {"id": "52a97bc9-88b7-430a-80c8-3d6210441943", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1761062078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8f578ae9d44706b68eaac234ae6d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861bfd56-28", "ovs_interfaceid": "861bfd56-2888-46b4-b583-08526d05bcd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:51:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bf7a46fa-b02d-4b70-ad0d-b53d62179a7f tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Releasing lock "refresh_cache-db837c7a-c52d-469b-abf7-cea107454c60" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:51:49 user nova-compute[75247]: DEBUG nova.objects.instance [None req-bf7a46fa-b02d-4b70-ad0d-b53d62179a7f tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lazy-loading 'flavor' on Instance uuid db837c7a-c52d-469b-abf7-cea107454c60 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:51:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:49 user nova-compute[75247]: DEBUG nova.network.neutron [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Successfully updated port: 63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:51:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "refresh_cache-6d767ae1-4df2-4e87-b991-729fabd467f8" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:51:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquired lock "refresh_cache-6d767ae1-4df2-4e87-b991-729fabd467f8" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:51:49 user nova-compute[75247]: DEBUG nova.network.neutron [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:51:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-7fdf41b0-e0b7-46ab-926d-684a608f32a0 req-881b75cf-f124-4b09-a368-d36590f8fa19 service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Received event network-changed-63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:51:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-7fdf41b0-e0b7-46ab-926d-684a608f32a0 req-881b75cf-f124-4b09-a368-d36590f8fa19 service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Refreshing instance network info cache due to event network-changed-63f9635e-3eb4-4d2b-b289-e219ade9fb28. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:51:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7fdf41b0-e0b7-46ab-926d-684a608f32a0 req-881b75cf-f124-4b09-a368-d36590f8fa19 service nova] Acquiring lock "refresh_cache-6d767ae1-4df2-4e87-b991-729fabd467f8" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:51:49 user nova-compute[75247]: DEBUG nova.network.neutron [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:51:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-fb47a1b9-1f41-4e6d-b378-95d495ef105f req-7eb82261-7ab2-4010-9846-20173f8fe30e service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received event network-vif-unplugged-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:51:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fb47a1b9-1f41-4e6d-b378-95d495ef105f req-7eb82261-7ab2-4010-9846-20173f8fe30e service nova] Acquiring lock "db837c7a-c52d-469b-abf7-cea107454c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fb47a1b9-1f41-4e6d-b378-95d495ef105f req-7eb82261-7ab2-4010-9846-20173f8fe30e service nova] Lock "db837c7a-c52d-469b-abf7-cea107454c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fb47a1b9-1f41-4e6d-b378-95d495ef105f req-7eb82261-7ab2-4010-9846-20173f8fe30e service nova] Lock "db837c7a-c52d-469b-abf7-cea107454c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-fb47a1b9-1f41-4e6d-b378-95d495ef105f req-7eb82261-7ab2-4010-9846-20173f8fe30e service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] No waiting events found dispatching network-vif-unplugged-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:51:49 user nova-compute[75247]: WARNING nova.compute.manager [req-fb47a1b9-1f41-4e6d-b378-95d495ef105f req-7eb82261-7ab2-4010-9846-20173f8fe30e service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received unexpected event network-vif-unplugged-861bfd56-2888-46b4-b583-08526d05bcd6 for instance with vm_state rescued and task_state unrescuing.
Dec 06 12:51:49 user nova-compute[75247]: DEBUG nova.network.neutron [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Updating instance_info_cache with network_info: [{"id": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "address": "fa:16:3e:73:5b:1b", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f9635e-3e", "ovs_interfaceid": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:51:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Releasing lock "refresh_cache-6d767ae1-4df2-4e87-b991-729fabd467f8" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:51:49 user nova-compute[75247]: DEBUG nova.compute.manager [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Instance network_info: |[{"id": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "address": "fa:16:3e:73:5b:1b", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f9635e-3e", "ovs_interfaceid": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:51:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7fdf41b0-e0b7-46ab-926d-684a608f32a0 req-881b75cf-f124-4b09-a368-d36590f8fa19 service nova] Acquired lock "refresh_cache-6d767ae1-4df2-4e87-b991-729fabd467f8" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:51:49 user nova-compute[75247]: DEBUG nova.network.neutron [req-7fdf41b0-e0b7-46ab-926d-684a608f32a0 req-881b75cf-f124-4b09-a368-d36590f8fa19 service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Refreshing network info cache for port 63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:51:50 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Instance destroyed successfully.
Dec 06 12:51:50 user nova-compute[75247]: DEBUG nova.network.neutron [req-7fdf41b0-e0b7-46ab-926d-684a608f32a0 req-881b75cf-f124-4b09-a368-d36590f8fa19 service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Updated VIF entry in instance network info cache for port 63f9635e-3eb4-4d2b-b289-e219ade9fb28. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:51:50 user nova-compute[75247]: DEBUG nova.network.neutron [req-7fdf41b0-e0b7-46ab-926d-684a608f32a0 req-881b75cf-f124-4b09-a368-d36590f8fa19 service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Updating instance_info_cache with network_info: [{"id": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "address": "fa:16:3e:73:5b:1b", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f9635e-3e", "ovs_interfaceid": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:51:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7fdf41b0-e0b7-46ab-926d-684a608f32a0 req-881b75cf-f124-4b09-a368-d36590f8fa19 service nova] Releasing lock "refresh_cache-6d767ae1-4df2-4e87-b991-729fabd467f8" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:51:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:51 user nova-compute[75247]: DEBUG nova.compute.manager [req-2c9f7b21-8864-4f08-945a-adc576c5c03b req-bbd1aebf-cb26-4033-a6b3-ae04ea20628f service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received event network-changed-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:51:51 user nova-compute[75247]: DEBUG nova.compute.manager [req-2c9f7b21-8864-4f08-945a-adc576c5c03b req-bbd1aebf-cb26-4033-a6b3-ae04ea20628f service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Refreshing instance network info cache due to event network-changed-861bfd56-2888-46b4-b583-08526d05bcd6. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:51:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2c9f7b21-8864-4f08-945a-adc576c5c03b req-bbd1aebf-cb26-4033-a6b3-ae04ea20628f service nova] Acquiring lock "refresh_cache-db837c7a-c52d-469b-abf7-cea107454c60" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:51:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2c9f7b21-8864-4f08-945a-adc576c5c03b req-bbd1aebf-cb26-4033-a6b3-ae04ea20628f service nova] Acquired lock "refresh_cache-db837c7a-c52d-469b-abf7-cea107454c60" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:51:51 user nova-compute[75247]: DEBUG nova.network.neutron [req-2c9f7b21-8864-4f08-945a-adc576c5c03b req-bbd1aebf-cb26-4033-a6b3-ae04ea20628f service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Refreshing network info cache for port 861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:51:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:52 user nova-compute[75247]: DEBUG nova.network.neutron [req-2c9f7b21-8864-4f08-945a-adc576c5c03b req-bbd1aebf-cb26-4033-a6b3-ae04ea20628f service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Updated VIF entry in instance network info cache for port 861bfd56-2888-46b4-b583-08526d05bcd6. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:51:52 user nova-compute[75247]: DEBUG nova.network.neutron [req-2c9f7b21-8864-4f08-945a-adc576c5c03b req-bbd1aebf-cb26-4033-a6b3-ae04ea20628f service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Updating instance_info_cache with network_info: [{"id": "861bfd56-2888-46b4-b583-08526d05bcd6", "address": "fa:16:3e:eb:bc:82", "network": {"id": "52a97bc9-88b7-430a-80c8-3d6210441943", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1761062078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8f578ae9d44706b68eaac234ae6d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861bfd56-28", "ovs_interfaceid": "861bfd56-2888-46b4-b583-08526d05bcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:51:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2c9f7b21-8864-4f08-945a-adc576c5c03b req-bbd1aebf-cb26-4033-a6b3-ae04ea20628f service nova] Releasing lock "refresh_cache-db837c7a-c52d-469b-abf7-cea107454c60" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:51:52 user nova-compute[75247]: DEBUG nova.compute.manager [req-2c9f7b21-8864-4f08-945a-adc576c5c03b req-bbd1aebf-cb26-4033-a6b3-ae04ea20628f service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received event network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:51:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2c9f7b21-8864-4f08-945a-adc576c5c03b req-bbd1aebf-cb26-4033-a6b3-ae04ea20628f service nova] Acquiring lock "db837c7a-c52d-469b-abf7-cea107454c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2c9f7b21-8864-4f08-945a-adc576c5c03b req-bbd1aebf-cb26-4033-a6b3-ae04ea20628f service nova] Lock "db837c7a-c52d-469b-abf7-cea107454c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2c9f7b21-8864-4f08-945a-adc576c5c03b req-bbd1aebf-cb26-4033-a6b3-ae04ea20628f service nova] Lock "db837c7a-c52d-469b-abf7-cea107454c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:52 user nova-compute[75247]: DEBUG nova.compute.manager [req-2c9f7b21-8864-4f08-945a-adc576c5c03b req-bbd1aebf-cb26-4033-a6b3-ae04ea20628f service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] No waiting events found dispatching network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:51:52 user nova-compute[75247]: WARNING nova.compute.manager [req-2c9f7b21-8864-4f08-945a-adc576c5c03b req-bbd1aebf-cb26-4033-a6b3-ae04ea20628f service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received unexpected event network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 for instance with vm_state rescued and task_state unrescuing.
Dec 06 12:51:52 user nova-compute[75247]: DEBUG nova.compute.manager [req-2c9f7b21-8864-4f08-945a-adc576c5c03b req-bbd1aebf-cb26-4033-a6b3-ae04ea20628f service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received event network-changed-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:51:52 user nova-compute[75247]: DEBUG nova.compute.manager [req-2c9f7b21-8864-4f08-945a-adc576c5c03b req-bbd1aebf-cb26-4033-a6b3-ae04ea20628f service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Refreshing instance network info cache due to event network-changed-861bfd56-2888-46b4-b583-08526d05bcd6. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:51:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2c9f7b21-8864-4f08-945a-adc576c5c03b req-bbd1aebf-cb26-4033-a6b3-ae04ea20628f service nova] Acquiring lock "refresh_cache-db837c7a-c52d-469b-abf7-cea107454c60" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:51:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2c9f7b21-8864-4f08-945a-adc576c5c03b req-bbd1aebf-cb26-4033-a6b3-ae04ea20628f service nova] Acquired lock "refresh_cache-db837c7a-c52d-469b-abf7-cea107454c60" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:51:52 user nova-compute[75247]: DEBUG nova.network.neutron [req-2c9f7b21-8864-4f08-945a-adc576c5c03b req-bbd1aebf-cb26-4033-a6b3-ae04ea20628f service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Refreshing network info cache for port 861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:51:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:52 user nova-compute[75247]: DEBUG nova.network.neutron [req-2c9f7b21-8864-4f08-945a-adc576c5c03b req-bbd1aebf-cb26-4033-a6b3-ae04ea20628f service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Updated VIF entry in instance network info cache for port 861bfd56-2888-46b4-b583-08526d05bcd6. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:51:52 user nova-compute[75247]: DEBUG nova.network.neutron [req-2c9f7b21-8864-4f08-945a-adc576c5c03b req-bbd1aebf-cb26-4033-a6b3-ae04ea20628f service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Updating instance_info_cache with network_info: [{"id": "861bfd56-2888-46b4-b583-08526d05bcd6", "address": "fa:16:3e:eb:bc:82", "network": {"id": "52a97bc9-88b7-430a-80c8-3d6210441943", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1761062078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8f578ae9d44706b68eaac234ae6d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861bfd56-28", "ovs_interfaceid": "861bfd56-2888-46b4-b583-08526d05bcd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:51:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2c9f7b21-8864-4f08-945a-adc576c5c03b req-bbd1aebf-cb26-4033-a6b3-ae04ea20628f service nova] Releasing lock "refresh_cache-db837c7a-c52d-469b-abf7-cea107454c60" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:51:53 user nova-compute[75247]: DEBUG nova.compute.manager [req-f02a0728-cde3-4b18-8c39-45ae90edba59 req-3af60245-e351-477d-8698-60c0b6c19f2a service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received event network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:51:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f02a0728-cde3-4b18-8c39-45ae90edba59 req-3af60245-e351-477d-8698-60c0b6c19f2a service nova] Acquiring lock "db837c7a-c52d-469b-abf7-cea107454c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f02a0728-cde3-4b18-8c39-45ae90edba59 req-3af60245-e351-477d-8698-60c0b6c19f2a service nova] Lock "db837c7a-c52d-469b-abf7-cea107454c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f02a0728-cde3-4b18-8c39-45ae90edba59 req-3af60245-e351-477d-8698-60c0b6c19f2a service nova] Lock "db837c7a-c52d-469b-abf7-cea107454c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:53 user nova-compute[75247]: DEBUG nova.compute.manager [req-f02a0728-cde3-4b18-8c39-45ae90edba59 req-3af60245-e351-477d-8698-60c0b6c19f2a service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] No waiting events found dispatching network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:51:53 user nova-compute[75247]: WARNING nova.compute.manager [req-f02a0728-cde3-4b18-8c39-45ae90edba59 req-3af60245-e351-477d-8698-60c0b6c19f2a service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received unexpected event network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 for instance with vm_state rescued and task_state unrescuing.
Dec 06 12:51:53 user nova-compute[75247]: DEBUG nova.compute.manager [req-f02a0728-cde3-4b18-8c39-45ae90edba59 req-3af60245-e351-477d-8698-60c0b6c19f2a service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received event network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:51:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f02a0728-cde3-4b18-8c39-45ae90edba59 req-3af60245-e351-477d-8698-60c0b6c19f2a service nova] Acquiring lock "db837c7a-c52d-469b-abf7-cea107454c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:51:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f02a0728-cde3-4b18-8c39-45ae90edba59 req-3af60245-e351-477d-8698-60c0b6c19f2a service nova] Lock "db837c7a-c52d-469b-abf7-cea107454c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:51:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f02a0728-cde3-4b18-8c39-45ae90edba59 req-3af60245-e351-477d-8698-60c0b6c19f2a service nova] Lock "db837c7a-c52d-469b-abf7-cea107454c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:51:53 user nova-compute[75247]: DEBUG nova.compute.manager [req-f02a0728-cde3-4b18-8c39-45ae90edba59 req-3af60245-e351-477d-8698-60c0b6c19f2a service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] No waiting events found dispatching network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:51:53 user nova-compute[75247]: WARNING nova.compute.manager [req-f02a0728-cde3-4b18-8c39-45ae90edba59 req-3af60245-e351-477d-8698-60c0b6c19f2a service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received unexpected event network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 for instance with vm_state rescued and task_state unrescuing.
Dec 06 12:51:53 user nova-compute[75247]: DEBUG nova.compute.manager [None req-bf7a46fa-b02d-4b70-ad0d-b53d62179a7f tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:51:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:51:58 user nova-compute[75247]: DEBUG os_brick.utils [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:51:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42459fa-ca3f-48bc-aa75-9408e0d24d60]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:51:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e665ff-3c1d-4127-8667-4cab7d45b53e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:51:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:51:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0911ef53-1c33-4d3e-9247-b20151b0588e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:51:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[182ae407-646a-47fe-a902-a4f9f0ffc12b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:51:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:51:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:51:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:51:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:51:58 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:51:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bef5d76-db2b-4345-9f3a-ab415348b793]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:51:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:51:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:51:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:51:58 user nova-compute[75247]: DEBUG os_brick.utils [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:51:58 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Updating existing volume attachment record: b3e518e4-c16c-4a1c-a5b3-d6a787524d60 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:51:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:00 user nova-compute[75247]: DEBUG nova.compute.manager [req-55ecf287-6d36-4739-b042-8e49727a1b06 req-a5ed8abe-552f-4ff3-88f9-a838edee1a7e service nova] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Received event network-changed-e534a6f8-8e4b-4932-a4fc-bb5457532884 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:52:00 user nova-compute[75247]: DEBUG nova.compute.manager [req-55ecf287-6d36-4739-b042-8e49727a1b06 req-a5ed8abe-552f-4ff3-88f9-a838edee1a7e service nova] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Refreshing instance network info cache due to event network-changed-e534a6f8-8e4b-4932-a4fc-bb5457532884. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:52:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-55ecf287-6d36-4739-b042-8e49727a1b06 req-a5ed8abe-552f-4ff3-88f9-a838edee1a7e service nova] Acquiring lock "refresh_cache-56f7d945-3eae-4dbe-928e-389620e62353" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:52:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-55ecf287-6d36-4739-b042-8e49727a1b06 req-a5ed8abe-552f-4ff3-88f9-a838edee1a7e service nova] Acquired lock "refresh_cache-56f7d945-3eae-4dbe-928e-389620e62353" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:52:00 user nova-compute[75247]: DEBUG nova.network.neutron [req-55ecf287-6d36-4739-b042-8e49727a1b06 req-a5ed8abe-552f-4ff3-88f9-a838edee1a7e service nova] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Refreshing network info cache for port e534a6f8-8e4b-4932-a4fc-bb5457532884 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:52:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "56f7d945-3eae-4dbe-928e-389620e62353" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:52:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "56f7d945-3eae-4dbe-928e-389620e62353" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:52:00 user nova-compute[75247]: DEBUG nova.objects.instance [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lazy-loading 'flavor' on Instance uuid 56f7d945-3eae-4dbe-928e-389620e62353 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:52:01 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Ignoring supplied device name: /dev/vdb
Dec 06 12:52:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "56f7d945-3eae-4dbe-928e-389620e62353" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:52:01 user nova-compute[75247]: DEBUG nova.network.neutron [req-55ecf287-6d36-4739-b042-8e49727a1b06 req-a5ed8abe-552f-4ff3-88f9-a838edee1a7e service nova] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Updated VIF entry in instance network info cache for port e534a6f8-8e4b-4932-a4fc-bb5457532884. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:52:01 user nova-compute[75247]: DEBUG nova.network.neutron [req-55ecf287-6d36-4739-b042-8e49727a1b06 req-a5ed8abe-552f-4ff3-88f9-a838edee1a7e service nova] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Updating instance_info_cache with network_info: [{"id": "e534a6f8-8e4b-4932-a4fc-bb5457532884", "address": "fa:16:3e:db:01:9e", "network": {"id": "24492570-dfe5-49d1-944e-7435cc85d347", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145359804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58ba64f48e946098b72d7061d354ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape534a6f8-8e", "ovs_interfaceid": "e534a6f8-8e4b-4932-a4fc-bb5457532884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:52:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-55ecf287-6d36-4739-b042-8e49727a1b06 req-a5ed8abe-552f-4ff3-88f9-a838edee1a7e service nova] Releasing lock "refresh_cache-56f7d945-3eae-4dbe-928e-389620e62353" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:52:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "56f7d945-3eae-4dbe-928e-389620e62353" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:52:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "56f7d945-3eae-4dbe-928e-389620e62353" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:52:01 user nova-compute[75247]: INFO nova.compute.manager [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Attaching volume f4b00d03-3331-4acd-aea3-9643c7e9d4c0 to /dev/vdb
Dec 06 12:52:01 user nova-compute[75247]: DEBUG os_brick.utils [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:52:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:01 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3553d030-533c-4053-9617-21217933c7b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:01 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bbc1a5-80cc-4b8e-9a6c-5b8325912139]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:01 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46686c9-259f-43b0-9683-fa1d5770c498]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:01 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9e8ed6-a176-4034-98d9-66b52cc61bc3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:52:01 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:52:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:01 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:52:01 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:52:01 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[97319070-83d1-4b9b-bf80-ba71cbe70d7d]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:01 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:52:01 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:52:01 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:52:01 user nova-compute[75247]: DEBUG os_brick.utils [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:52:01 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Updating existing volume attachment record: 7ee97b1e-238e-4afd-8dee-f7297ffcedf4 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:52:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f58af715-7bf8-41f4-8f35-8f59469df5df tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Acquiring lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:52:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f58af715-7bf8-41f4-8f35-8f59469df5df tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:52:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f58af715-7bf8-41f4-8f35-8f59469df5df tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Acquiring lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:52:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f58af715-7bf8-41f4-8f35-8f59469df5df tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:52:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f58af715-7bf8-41f4-8f35-8f59469df5df tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:52:07 user nova-compute[75247]: INFO nova.compute.manager [None req-f58af715-7bf8-41f4-8f35-8f59469df5df tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Terminating instance
Dec 06 12:52:07 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f58af715-7bf8-41f4-8f35-8f59469df5df tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:52:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:08 user nova-compute[75247]: DEBUG nova.compute.manager [req-627ea1e0-dcd8-4dde-a43b-f2b9af99aa0c req-5c09518f-4870-41e5-a213-dbd8c0313f55 service nova] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Received event network-vif-unplugged-02bb5689-5d75-4967-b307-862ab2c1fb7f {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:52:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-627ea1e0-dcd8-4dde-a43b-f2b9af99aa0c req-5c09518f-4870-41e5-a213-dbd8c0313f55 service nova] Acquiring lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:52:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-627ea1e0-dcd8-4dde-a43b-f2b9af99aa0c req-5c09518f-4870-41e5-a213-dbd8c0313f55 service nova] Lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:52:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-627ea1e0-dcd8-4dde-a43b-f2b9af99aa0c req-5c09518f-4870-41e5-a213-dbd8c0313f55 service nova] Lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:52:08 user nova-compute[75247]: DEBUG nova.compute.manager [req-627ea1e0-dcd8-4dde-a43b-f2b9af99aa0c req-5c09518f-4870-41e5-a213-dbd8c0313f55 service nova] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] No waiting events found dispatching network-vif-unplugged-02bb5689-5d75-4967-b307-862ab2c1fb7f {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:52:08 user nova-compute[75247]: DEBUG nova.compute.manager [req-627ea1e0-dcd8-4dde-a43b-f2b9af99aa0c req-5c09518f-4870-41e5-a213-dbd8c0313f55 service nova] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Received event network-vif-unplugged-02bb5689-5d75-4967-b307-862ab2c1fb7f for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:52:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:08 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Instance destroyed successfully.
Dec 06 12:52:08 user nova-compute[75247]: DEBUG nova.objects.instance [None req-f58af715-7bf8-41f4-8f35-8f59469df5df tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lazy-loading 'resources' on Instance uuid ea75ba22-b4af-4454-93ed-cdfdc76a895b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:52:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-f58af715-7bf8-41f4-8f35-8f59469df5df tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:46:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-665748525',display_name='tempest-VolumesAdminNegativeTest-server-665748525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-665748525',id=20,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQQA+7DSE6583wGnYk/k+1nlvhK4j6yyf7h2HkFbkNbbbCHQs3yFehOjpWcuNMBDHfEJUTWmEoHhm2gOuo3td2hzkIcdmiszifBHS0DZt1HBIGxkWLxjawHtdFSJeAqDQ==',key_name='tempest-keypair-668190557',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:46:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4efbc08c0354cb28d4d62be836f5e6f',ramdisk_id='',reservation_id='r-h07wrpwu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2088368587',owner_user_name='tempest-VolumesAdminNegativeTest-2088368587-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:46:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf32752c9f2d404b8ee4819e72e1b516',uuid=ea75ba22-b4af-4454-93ed-cdfdc76a895b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02bb5689-5d75-4967-b307-862ab2c1fb7f", "address": "fa:16:3e:88:36:c4", "network": {"id": "783b08eb-3a13-4dea-a30d-94ce21434b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-358384266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4efbc08c0354cb28d4d62be836f5e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02bb5689-5d", "ovs_interfaceid": "02bb5689-5d75-4967-b307-862ab2c1fb7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:52:08 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-f58af715-7bf8-41f4-8f35-8f59469df5df tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Converting VIF {"id": "02bb5689-5d75-4967-b307-862ab2c1fb7f", "address": "fa:16:3e:88:36:c4", "network": {"id": "783b08eb-3a13-4dea-a30d-94ce21434b4b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-358384266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4efbc08c0354cb28d4d62be836f5e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02bb5689-5d", "ovs_interfaceid": "02bb5689-5d75-4967-b307-862ab2c1fb7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:52:08 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-f58af715-7bf8-41f4-8f35-8f59469df5df tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:36:c4,bridge_name='br-int',has_traffic_filtering=True,id=02bb5689-5d75-4967-b307-862ab2c1fb7f,network=Network(783b08eb-3a13-4dea-a30d-94ce21434b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02bb5689-5d') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:52:08 user nova-compute[75247]: DEBUG os_vif [None req-f58af715-7bf8-41f4-8f35-8f59469df5df tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:36:c4,bridge_name='br-int',has_traffic_filtering=True,id=02bb5689-5d75-4967-b307-862ab2c1fb7f,network=Network(783b08eb-3a13-4dea-a30d-94ce21434b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02bb5689-5d') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:52:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02bb5689-5d, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:52:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:52:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3269f323-969e-4d3f-aa44-65d76e44dab6) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:52:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:52:08 user nova-compute[75247]: INFO os_vif [None req-f58af715-7bf8-41f4-8f35-8f59469df5df tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:36:c4,bridge_name='br-int',has_traffic_filtering=True,id=02bb5689-5d75-4967-b307-862ab2c1fb7f,network=Network(783b08eb-3a13-4dea-a30d-94ce21434b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02bb5689-5d')
Dec 06 12:52:08 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-f58af715-7bf8-41f4-8f35-8f59469df5df tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Deleting instance files /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b_del
Dec 06 12:52:08 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-f58af715-7bf8-41f4-8f35-8f59469df5df tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Deletion of /opt/stack/data/nova/instances/ea75ba22-b4af-4454-93ed-cdfdc76a895b_del complete
Dec 06 12:52:08 user nova-compute[75247]: INFO nova.compute.manager [None req-f58af715-7bf8-41f4-8f35-8f59469df5df tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Took 0.98 seconds to destroy the instance on the hypervisor.
Dec 06 12:52:08 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-f58af715-7bf8-41f4-8f35-8f59469df5df tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:52:08 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:52:08 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:52:08 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:52:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:52:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:52:09 user nova-compute[75247]: DEBUG nova.compute.manager [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:52:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:52:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:52:09 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:52:09 user nova-compute[75247]: INFO nova.compute.claims [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Claim successful on node user
Dec 06 12:52:09 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:52:09 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Took 1.17 seconds to deallocate network for instance.
Dec 06 12:52:09 user nova-compute[75247]: DEBUG nova.compute.manager [req-af9b595d-b6fb-42aa-805f-74e694ee2a50 req-de4ded6b-6350-44e8-abd9-0f70f1b81aa5 service nova] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Received event network-vif-deleted-02bb5689-5d75-4967-b307-862ab2c1fb7f {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f58af715-7bf8-41f4-8f35-8f59469df5df tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-75c547d6-295b-4c4d-b328-ac2eb843565d req-ca5fe239-c09d-4f8e-b1c5-6c0bb970780b service nova] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Received event network-vif-plugged-02bb5689-5d75-4967-b307-862ab2c1fb7f {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-75c547d6-295b-4c4d-b328-ac2eb843565d req-ca5fe239-c09d-4f8e-b1c5-6c0bb970780b service nova] Acquiring lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-75c547d6-295b-4c4d-b328-ac2eb843565d req-ca5fe239-c09d-4f8e-b1c5-6c0bb970780b service nova] Lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-75c547d6-295b-4c4d-b328-ac2eb843565d req-ca5fe239-c09d-4f8e-b1c5-6c0bb970780b service nova] Lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-75c547d6-295b-4c4d-b328-ac2eb843565d req-ca5fe239-c09d-4f8e-b1c5-6c0bb970780b service nova] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] No waiting events found dispatching network-vif-plugged-02bb5689-5d75-4967-b307-862ab2c1fb7f {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:52:10 user nova-compute[75247]: WARNING nova.compute.manager [req-75c547d6-295b-4c4d-b328-ac2eb843565d req-ca5fe239-c09d-4f8e-b1c5-6c0bb970780b service nova] [instance: ea75ba22-b4af-4454-93ed-cdfdc76a895b] Received unexpected event network-vif-plugged-02bb5689-5d75-4967-b307-862ab2c1fb7f for instance with vm_state deleted and task_state None.
Dec 06 12:52:10 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.661s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG nova.compute.manager [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f58af715-7bf8-41f4-8f35-8f59469df5df tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.480s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG nova.compute.manager [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG nova.network.neutron [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:52:10 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:52:10 user nova-compute[75247]: DEBUG nova.compute.manager [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG nova.policy [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc13843d8f074da189dbd3e93750b811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ccf15765714ca2a8c4700d2d6e3ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:52:10 user nova-compute[75247]: INFO nova.virt.block_device [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Booting with volume 7ce8f69d-d096-4c5d-ae72-af142a835d31 at /dev/vda
Dec 06 12:52:10 user nova-compute[75247]: DEBUG os_brick.utils [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3753d6e-ad7c-4566-b506-4aee52b80976]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b4c72f-3fa9-4cb2-b006-aabfc3425364]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0852dbb9-5904-44c3-808d-228b21a89113]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9930758-2fc0-4619-804c-599d113d2f1a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:52:10 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:52:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8199d1b-3bb2-4b11-b469-5ecdcbd22634]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG os_brick.utils [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:52:10 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Updating existing volume attachment record: 267b63ba-8787-4ddc-96a2-e8170a175432 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:52:11 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-f58af715-7bf8-41f4-8f35-8f59469df5df tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:52:11 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-f58af715-7bf8-41f4-8f35-8f59469df5df tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:52:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f58af715-7bf8-41f4-8f35-8f59469df5df tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.616s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:52:11 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-f58af715-7bf8-41f4-8f35-8f59469df5df tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Deleted allocations for instance ea75ba22-b4af-4454-93ed-cdfdc76a895b
Dec 06 12:52:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f58af715-7bf8-41f4-8f35-8f59469df5df tempest-VolumesAdminNegativeTest-2088368587 tempest-VolumesAdminNegativeTest-2088368587-project-member] Lock "ea75ba22-b4af-4454-93ed-cdfdc76a895b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.491s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:52:11 user nova-compute[75247]: DEBUG nova.network.neutron [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Successfully created port: 41d8bb63-57dd-4479-9a1e-89e223d16677 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:52:11 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:52:11 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:52:11 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:52:11 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 12:52:12 user nova-compute[75247]: DEBUG nova.network.neutron [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Successfully updated port: 41d8bb63-57dd-4479-9a1e-89e223d16677 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:52:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "refresh_cache-b3720cc0-ff80-4ca2-8b13-d83dded593ad" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:52:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquired lock "refresh_cache-b3720cc0-ff80-4ca2-8b13-d83dded593ad" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:52:12 user nova-compute[75247]: DEBUG nova.network.neutron [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:52:12 user nova-compute[75247]: DEBUG nova.compute.manager [req-0e715b9c-41f0-45a6-8ad4-3bfdeb0e960c req-4c890c8a-0b6d-40de-b8f3-5a35dd3785af service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Received event network-changed-41d8bb63-57dd-4479-9a1e-89e223d16677 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:52:12 user nova-compute[75247]: DEBUG nova.compute.manager [req-0e715b9c-41f0-45a6-8ad4-3bfdeb0e960c req-4c890c8a-0b6d-40de-b8f3-5a35dd3785af service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Refreshing instance network info cache due to event network-changed-41d8bb63-57dd-4479-9a1e-89e223d16677. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:52:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0e715b9c-41f0-45a6-8ad4-3bfdeb0e960c req-4c890c8a-0b6d-40de-b8f3-5a35dd3785af service nova] Acquiring lock "refresh_cache-b3720cc0-ff80-4ca2-8b13-d83dded593ad" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:52:12 user nova-compute[75247]: DEBUG nova.network.neutron [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:52:12 user nova-compute[75247]: DEBUG nova.network.neutron [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Updating instance_info_cache with network_info: [{"id": "41d8bb63-57dd-4479-9a1e-89e223d16677", "address": "fa:16:3e:9a:8b:8a", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d8bb63-57", "ovs_interfaceid": "41d8bb63-57dd-4479-9a1e-89e223d16677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:52:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Releasing lock "refresh_cache-b3720cc0-ff80-4ca2-8b13-d83dded593ad" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:52:12 user nova-compute[75247]: DEBUG nova.compute.manager [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Instance network_info: |[{"id": "41d8bb63-57dd-4479-9a1e-89e223d16677", "address": "fa:16:3e:9a:8b:8a", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d8bb63-57", "ovs_interfaceid": "41d8bb63-57dd-4479-9a1e-89e223d16677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:52:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0e715b9c-41f0-45a6-8ad4-3bfdeb0e960c req-4c890c8a-0b6d-40de-b8f3-5a35dd3785af service nova] Acquired lock "refresh_cache-b3720cc0-ff80-4ca2-8b13-d83dded593ad" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:52:12 user nova-compute[75247]: DEBUG nova.network.neutron [req-0e715b9c-41f0-45a6-8ad4-3bfdeb0e960c req-4c890c8a-0b6d-40de-b8f3-5a35dd3785af service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Refreshing network info cache for port 41d8bb63-57dd-4479-9a1e-89e223d16677 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:52:13 user nova-compute[75247]: DEBUG nova.network.neutron [req-0e715b9c-41f0-45a6-8ad4-3bfdeb0e960c req-4c890c8a-0b6d-40de-b8f3-5a35dd3785af service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Updated VIF entry in instance network info cache for port 41d8bb63-57dd-4479-9a1e-89e223d16677. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:52:13 user nova-compute[75247]: DEBUG nova.network.neutron [req-0e715b9c-41f0-45a6-8ad4-3bfdeb0e960c req-4c890c8a-0b6d-40de-b8f3-5a35dd3785af service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Updating instance_info_cache with network_info: [{"id": "41d8bb63-57dd-4479-9a1e-89e223d16677", "address": "fa:16:3e:9a:8b:8a", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d8bb63-57", "ovs_interfaceid": "41d8bb63-57dd-4479-9a1e-89e223d16677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:52:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0e715b9c-41f0-45a6-8ad4-3bfdeb0e960c req-4c890c8a-0b6d-40de-b8f3-5a35dd3785af service nova] Releasing lock "refresh_cache-b3720cc0-ff80-4ca2-8b13-d83dded593ad" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:52:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:15 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:52:15 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:52:15 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 12:52:16 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Didn't find any instances for network info cache update. {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 12:52:16 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:52:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:52:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:52:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:52:16 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 12:52:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/504791a2-9892-4721-856a-e0b77a395d01/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/504791a2-9892-4721-856a-e0b77a395d01/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/504791a2-9892-4721-856a-e0b77a395d01/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/504791a2-9892-4721-856a-e0b77a395d01/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:52:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7f8114-2e5d-4bf6-bb31-b00666f0d901/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7f8114-2e5d-4bf6-bb31-b00666f0d901/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7f8114-2e5d-4bf6-bb31-b00666f0d901/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQzXhTyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:52:19 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:52:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:52:19 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:52:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:52:19 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6225c9b6-1b18-4d64-ba19-7fb89a61ac99]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:52:19 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[730f7a4b-f03e-4de1-acac-794520ac0941]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0] added
Dec 06 12:52:19 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7f8114-2e5d-4bf6-bb31-b00666f0d901/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e676c68-79a7-472e-aa04-18c82935e65c]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f7d945-3eae-4dbe-928e-389620e62353/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff6fd1d-7a5c-4a4a-b18e-a86f2e32e3f6]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sQzXhTyR {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sQzXhTyR" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0421a61-01ab-459e-8aa7-7a8fa0435ccb]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sQzXhTyR'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c12dd13-adf3-4f50-bfb2-8945108383cd]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG nova.compute.manager [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:52:19 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Creating image(s)
Dec 06 12:52:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Did not create local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Ensure instance console log exists: /opt/stack/data/nova/instances/6d767ae1-4df2-4e87-b991-729fabd467f8/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Start _get_guest_xml network_info=[{"id": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "address": "fa:16:3e:73:5b:1b", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f9635e-3e", "ovs_interfaceid": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'b3e518e4-c16c-4a1c-a5b3-d6a787524d60', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcQpUNhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6d767ae1-4df2-4e87-b991-729fabd467f8', 'attached_at': '', 'detached_at': '', 'volume_id': '5d5e4e7c-239f-4371-b595-68e70bd0cd33', 'serial': '5d5e4e7c-239f-4371-b595-68e70bd0cd33'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[50da741e-7610-47ae-9a1a-1f084a1fbcc9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:52:19 user nova-compute[75247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)
Dec 06 12:52:19 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:52:19 user nova-compute[75247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)
Dec 06 12:52:19 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:19 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:52:19 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:52:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcQpUNhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:52:19 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:52:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa8d5ae-2e7e-4ab0-910c-347dc5b56d4f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0, portal: 172.16.0.220,3260]
Dec 06 12:52:19 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0, portal: 172.16.0.220,3260] successful.
Dec 06 12:52:19 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f7d945-3eae-4dbe-928e-389620e62353/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f7d945-3eae-4dbe-928e-389620e62353/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f0f323-7b89-4df5-a152-d72b44dddf9f]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c64c52-7098-4c7f-95ce-382ddf0afb68]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:52:19 user nova-compute[75247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)
Dec 06 12:52:19 user nova-compute[75247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)
Dec 06 12:52:19 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:52:19 user nova-compute[75247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)
Dec 06 12:52:19 user nova-compute[75247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)
Dec 06 12:52:19 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[749d219e-4ee4-4f3f-815a-b3b225787cc0]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: None {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f7d945-3eae-4dbe-928e-389620e62353/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:52:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:20 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:52:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQzXhTyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:52:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.684s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:52:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] <== connect_volume: return (1686ms) {'type': 'block', 'scsi_wwn': '23338653537633764', 'path': '/dev/sdc'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:52:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338653537633764', 'path': '/dev/sdc'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:52:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.379s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:52:20 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:52:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:52:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:52:20 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:52:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:20 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:52:20 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:52:20 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=7340MB free_disk=24.886859893798828GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 12:52:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:52:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:52:20 user nova-compute[75247]: DEBUG nova.objects.instance [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lazy-loading 'flavor' on Instance uuid 56f7d945-3eae-4dbe-928e-389620e62353 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:52:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[435abd7a-a6fb-483a-ac05-1b4b9a7bdcdb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:52:20 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 12:52:20 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:52:20 user nova-compute[75247]:   <source dev="/dev/sdc"/>
Dec 06 12:52:20 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:52:20 user nova-compute[75247]:   <serial>f4b00d03-3331-4acd-aea3-9643c7e9d4c0</serial>
Dec 06 12:52:20 user nova-compute[75247]: </disk>
Dec 06 12:52:20 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 12:52:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a666ea7b-543d-41a1-8302-50829eb20597]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33] added
Dec 06 12:52:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ef9be7-70e8-49ff-83ad-8444f2fca8bf]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d986c869-5e56-4618-9413-732a896d3252]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dcQpUNhr {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dcQpUNhr" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cd1f7a-fa5a-46e8-bab6-21a0c2313fa3]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dcQpUNhr'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfeb237-1fa0-4d07-8e1c-88fa883c15b0]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 70c4664e-ae7a-47de-bba7-18300391d209 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 782289e2-91cd-4aee-9a08-eadfb2a5965b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 3e1b5197-dc38-48a5-b9f9-e053be499433 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance db837c7a-c52d-469b-abf7-cea107454c60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance bc3ddb40-b05f-4170-b269-d44dec6ecdaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 530cfb75-7aa8-4e57-b282-8f7a21401b34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 56f7d945-3eae-4dbe-928e-389620e62353 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 92d215fd-8411-430c-b91e-b6e62e02a994 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 504791a2-9892-4721-856a-e0b77a395d01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 0e7f8114-2e5d-4bf6-bb31-b00666f0d901 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 6d767ae1-4df2-4e87-b991-729fabd467f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance b3720cc0-ff80-4ca2-8b13-d83dded593ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2faabba-d7d4-4f1f-a3b8-15e9748e076b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:52:21 user nova-compute[75247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)
Dec 06 12:52:21 user nova-compute[75247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)
Dec 06 12:52:21 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:52:21 user nova-compute[75247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)
Dec 06 12:52:21 user nova-compute[75247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)
Dec 06 12:52:21 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a705c5c-f0c4-4035-84dd-231d904246ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33, portal: 172.16.0.220,3260]
Dec 06 12:52:21 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33, portal: 172.16.0.220,3260] successful.
Dec 06 12:52:21 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be78280-d20e-4179-a8cf-ee9f6b8dd756]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41486eb-3161-4f38-bbb4-8d00e7721fe3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:52:21 user nova-compute[75247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)
Dec 06 12:52:21 user nova-compute[75247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)
Dec 06 12:52:21 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:52:21 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:52:21 user nova-compute[75247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)
Dec 06 12:52:21 user nova-compute[75247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)
Dec 06 12:52:21 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:52:21 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0071577-216f-448e-a9e9-153d2d080b78]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcQpUNhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] No VIF found with MAC fa:16:3e:db:01:9e, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a9c232ef-0a07-45b5-9e53-bf7d786ee9f8 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "56f7d945-3eae-4dbe-928e-389620e62353" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.378s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.696s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.compute.manager [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:52:21 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Creating image(s)
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Did not create local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Ensure instance console log exists: /opt/stack/data/nova/instances/b3720cc0-ff80-4ca2-8b13-d83dded593ad/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Start _get_guest_xml network_info=[{"id": "41d8bb63-57dd-4479-9a1e-89e223d16677", "address": "fa:16:3e:9a:8b:8a", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d8bb63-57", "ovs_interfaceid": "41d8bb63-57dd-4479-9a1e-89e223d16677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '267b63ba-8787-4ddc-96a2-e8170a175432', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmYCPVNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b3720cc0-ff80-4ca2-8b13-d83dded593ad', 'attached_at': '', 'detached_at': '', 'volume_id': '7ce8f69d-d096-4c5d-ae72-af142a835d31', 'serial': '7ce8f69d-d096-4c5d-ae72-af142a835d31'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:52:21 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:52:21 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmYCPVNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:52:21 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:52:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Acquiring lock "db837c7a-c52d-469b-abf7-cea107454c60" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "db837c7a-c52d-469b-abf7-cea107454c60" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:52:21 user nova-compute[75247]: INFO nova.compute.manager [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Detaching volume 0262f2d3-7689-4ed3-90cd-aa4535135c65
Dec 06 12:52:21 user nova-compute[75247]: INFO nova.virt.block_device [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Attempting to driver detach volume 0262f2d3-7689-4ed3-90cd-aa4535135c65 from mountpoint /dev/vdb
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Attempting to detach device vdb from instance db837c7a-c52d-469b-abf7-cea107454c60 from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:52:21 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:52:21 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:52:21 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:52:21 user nova-compute[75247]:   <serial>0262f2d3-7689-4ed3-90cd-aa4535135c65</serial>
Dec 06 12:52:21 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:52:21 user nova-compute[75247]: </disk>
Dec 06 12:52:21 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:52:21 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Successfully detached device vdb from instance db837c7a-c52d-469b-abf7-cea107454c60 from the persistent domain config.
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance db837c7a-c52d-469b-abf7-cea107454c60 from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 12:52:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:52:21 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:52:21 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:52:21 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:52:21 user nova-compute[75247]:   <serial>0262f2d3-7689-4ed3-90cd-aa4535135c65</serial>
Dec 06 12:52:21 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:52:21 user nova-compute[75247]: </disk>
Dec 06 12:52:21 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] <== connect_volume: return (2754ms) {'type': 'block', 'scsi_wwn': '23932633965323938', 'path': '/dev/sde'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932633965323938', 'path': '/dev/sde'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.533s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:52:22 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:52:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:52:22 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5d9409-05bc-41f1-b3e8-8c59f8817d20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:52:22 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1519077913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1519077913',id=31,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='222da79e3583495d90d5442029996343',ramdisk_id='',reservation_id='r-9fiavbvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:51:48Z,user_data=None,user_id='d0efa55fc4754d96a33d07d52342d8f7',uuid=6d767ae1-4df2-4e87-b991-729fabd467f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "address": "fa:16:3e:73:5b:1b", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f9635e-3e", "ovs_interfaceid": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converting VIF {"id": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "address": "fa:16:3e:73:5b:1b", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f9635e-3e", "ovs_interfaceid": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:5b:1b,bridge_name='br-int',has_traffic_filtering=True,id=63f9635e-3eb4-4d2b-b289-e219ade9fb28,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f9635e-3e') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG nova.objects.instance [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d767ae1-4df2-4e87-b991-729fabd467f8 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:52:22 user nova-compute[75247]:   <uuid>6d767ae1-4df2-4e87-b991-729fabd467f8</uuid>
Dec 06 12:52:22 user nova-compute[75247]:   <name>instance-0000001f</name>
Dec 06 12:52:22 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:52:22 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:52:22 user nova-compute[75247]:   <metadata>
Dec 06 12:52:22 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:52:22 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:52:22 user nova-compute[75247]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1519077913</nova:name>
Dec 06 12:52:22 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:52:19</nova:creationTime>
Dec 06 12:52:22 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:52:22 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:52:22 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:52:22 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:52:22 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:52:22 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:52:22 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:52:22 user nova-compute[75247]:       <nova:owner>
Dec 06 12:52:22 user nova-compute[75247]:         <nova:user uuid="d0efa55fc4754d96a33d07d52342d8f7">tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member</nova:user>
Dec 06 12:52:22 user nova-compute[75247]:         <nova:project uuid="222da79e3583495d90d5442029996343">tempest-ServerBootFromVolumeStableRescueTest-1200643969</nova:project>
Dec 06 12:52:22 user nova-compute[75247]:       </nova:owner>
Dec 06 12:52:22 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:52:22 user nova-compute[75247]:       <nova:ports>
Dec 06 12:52:22 user nova-compute[75247]:         <nova:port uuid="63f9635e-3eb4-4d2b-b289-e219ade9fb28">
Dec 06 12:52:22 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 06 12:52:22 user nova-compute[75247]:         </nova:port>
Dec 06 12:52:22 user nova-compute[75247]:       </nova:ports>
Dec 06 12:52:22 user nova-compute[75247]:     </nova:instance>
Dec 06 12:52:22 user nova-compute[75247]:   </metadata>
Dec 06 12:52:22 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:52:22 user nova-compute[75247]:     <system>
Dec 06 12:52:22 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:52:22 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:52:22 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:52:22 user nova-compute[75247]:       <entry name="serial">6d767ae1-4df2-4e87-b991-729fabd467f8</entry>
Dec 06 12:52:22 user nova-compute[75247]:       <entry name="uuid">6d767ae1-4df2-4e87-b991-729fabd467f8</entry>
Dec 06 12:52:22 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:52:22 user nova-compute[75247]:     </system>
Dec 06 12:52:22 user nova-compute[75247]:   </sysinfo>
Dec 06 12:52:22 user nova-compute[75247]:   <os>
Dec 06 12:52:22 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:52:22 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:52:22 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:52:22 user nova-compute[75247]:   </os>
Dec 06 12:52:22 user nova-compute[75247]:   <features>
Dec 06 12:52:22 user nova-compute[75247]:     <acpi/>
Dec 06 12:52:22 user nova-compute[75247]:     <apic/>
Dec 06 12:52:22 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:52:22 user nova-compute[75247]:   </features>
Dec 06 12:52:22 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:52:22 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:52:22 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:52:22 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:52:22 user nova-compute[75247]:   </clock>
Dec 06 12:52:22 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:52:22 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:52:22 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:52:22 user nova-compute[75247]:   </cpu>
Dec 06 12:52:22 user nova-compute[75247]:   <devices>
Dec 06 12:52:22 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 12:52:22 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:52:22 user nova-compute[75247]:       <source dev="/dev/sde"/>
Dec 06 12:52:22 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:52:22 user nova-compute[75247]:       <serial>5d5e4e7c-239f-4371-b595-68e70bd0cd33</serial>
Dec 06 12:52:22 user nova-compute[75247]:     </disk>
Dec 06 12:52:22 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:52:22 user nova-compute[75247]:       <mac address="fa:16:3e:73:5b:1b"/>
Dec 06 12:52:22 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:52:22 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:52:22 user nova-compute[75247]:       <target dev="tap63f9635e-3e"/>
Dec 06 12:52:22 user nova-compute[75247]:     </interface>
Dec 06 12:52:22 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:52:22 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/6d767ae1-4df2-4e87-b991-729fabd467f8/console.log" append="off"/>
Dec 06 12:52:22 user nova-compute[75247]:     </serial>
Dec 06 12:52:22 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:52:22 user nova-compute[75247]:     <video>
Dec 06 12:52:22 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:52:22 user nova-compute[75247]:     </video>
Dec 06 12:52:22 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:52:22 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:52:22 user nova-compute[75247]:     </rng>
Dec 06 12:52:22 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:52:22 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:52:22 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:52:22 user nova-compute[75247]:     </memballoon>
Dec 06 12:52:22 user nova-compute[75247]:   </devices>
Dec 06 12:52:22 user nova-compute[75247]: </domain>
Dec 06 12:52:22 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1519077913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1519077913',id=31,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='222da79e3583495d90d5442029996343',ramdisk_id='',reservation_id='r-9fiavbvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:51:48Z,user_data=None,user_id='d0efa55fc4754d96a33d07d52342d8f7',uuid=6d767ae1-4df2-4e87-b991-729fabd467f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "address": "fa:16:3e:73:5b:1b", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f9635e-3e", "ovs_interfaceid": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converting VIF {"id": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "address": "fa:16:3e:73:5b:1b", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f9635e-3e", "ovs_interfaceid": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:5b:1b,bridge_name='br-int',has_traffic_filtering=True,id=63f9635e-3eb4-4d2b-b289-e219ade9fb28,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f9635e-3e') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG os_vif [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:5b:1b,bridge_name='br-int',has_traffic_filtering=True,id=63f9635e-3eb4-4d2b-b289-e219ade9fb28,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f9635e-3e') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9c8506-a0ad-458e-80c9-1a1552f4b602]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31] added
Dec 06 12:52:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd834ffb-2320-5526-9103-ea4cf377ab8f', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63f9635e-3e, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63f9635e-3e, col_values=(('qos', UUID('6e65219f-7592-4f87-8683-8830188b5f0d')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63f9635e-3e, col_values=(('external_ids', {'iface-id': '63f9635e-3eb4-4d2b-b289-e219ade9fb28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:5b:1b', 'vm-uuid': '6d767ae1-4df2-4e87-b991-729fabd467f8'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3394e9f-ab9d-4574-ac44-5c222add9445]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:22 user nova-compute[75247]: INFO os_vif [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:5b:1b,bridge_name='br-int',has_traffic_filtering=True,id=63f9635e-3eb4-4d2b-b289-e219ade9fb28,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f9635e-3e')
Dec 06 12:52:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance db837c7a-c52d-469b-abf7-cea107454c60 {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fbbb76-9e49-49b5-b5c0-c65858b68a17]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jmYCPVNh {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jmYCPVNh" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e06ab3-a366-4d90-ac9b-e403758cbee2]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jmYCPVNh'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] No VIF found with MAC fa:16:3e:73:5b:1b, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa941baf-f065-4905-a43b-7a140c537ec3]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc626e01-e4f2-4935-9d5d-5eca575e5e7e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:52:22 user nova-compute[75247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)
Dec 06 12:52:22 user nova-compute[75247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)
Dec 06 12:52:22 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:52:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:52:22 user nova-compute[75247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)
Dec 06 12:52:22 user nova-compute[75247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)
Dec 06 12:52:22 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:52:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccb3aad-c10a-4391-a4dc-cd88e2474388]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31, portal: 172.16.0.220,3260]
Dec 06 12:52:22 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31, portal: 172.16.0.220,3260] successful.
Dec 06 12:52:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eefda5a-30ff-4eb7-bf5f-75242cb1e056]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[58360898-e156-4b76-b36d-f8a9c0058dc4]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:52:22 user nova-compute[75247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)
Dec 06 12:52:22 user nova-compute[75247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)
Dec 06 12:52:22 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:52:22 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:52:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:52:22 user nova-compute[75247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)
Dec 06 12:52:22 user nova-compute[75247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)
Dec 06 12:52:22 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:52:22 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:52:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64536b9-5bb3-449c-824a-c693d42d2cdd]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: None {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmYCPVNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] <== connect_volume: return (1900ms) {'type': 'block', 'scsi_wwn': '26530663838663662', 'path': '/dev/sdf'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530663838663662', 'path': '/dev/sdf'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:52:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1873472062',display_name='tempest-ServerActionsTestOtherA-server-1873472062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1873472062',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1PSIn5waVLUBUVXmci26Bjo3OHYSVHL8/oxs3uvNoObvAgLe5HgiP5u61wX8nEvgm8XgeBjcCfcP/HNC/vep9hMtkBYH/Pz/i1rF8IkHYEtoKU1LHCX3Qi/2pvpu4Reg==',key_name='tempest-keypair-1071092699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0ccf15765714ca2a8c4700d2d6e3ed2',ramdisk_id='',reservation_id='r-80mdy70u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2075667053',owner_user_name='tempest-ServerActionsTestOtherA-2075667053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:52:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13843d8f074da189dbd3e93750b811',uuid=b3720cc0-ff80-4ca2-8b13-d83dded593ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41d8bb63-57dd-4479-9a1e-89e223d16677", "address": "fa:16:3e:9a:8b:8a", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d8bb63-57", "ovs_interfaceid": "41d8bb63-57dd-4479-9a1e-89e223d16677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converting VIF {"id": "41d8bb63-57dd-4479-9a1e-89e223d16677", "address": "fa:16:3e:9a:8b:8a", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d8bb63-57", "ovs_interfaceid": "41d8bb63-57dd-4479-9a1e-89e223d16677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:8b:8a,bridge_name='br-int',has_traffic_filtering=True,id=41d8bb63-57dd-4479-9a1e-89e223d16677,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d8bb63-57') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG nova.objects.instance [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lazy-loading 'pci_devices' on Instance uuid b3720cc0-ff80-4ca2-8b13-d83dded593ad {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:52:23 user nova-compute[75247]:   <uuid>b3720cc0-ff80-4ca2-8b13-d83dded593ad</uuid>
Dec 06 12:52:23 user nova-compute[75247]:   <name>instance-00000020</name>
Dec 06 12:52:23 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:52:23 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:52:23 user nova-compute[75247]:   <metadata>
Dec 06 12:52:23 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:52:23 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:52:23 user nova-compute[75247]:       <nova:name>tempest-ServerActionsTestOtherA-server-1873472062</nova:name>
Dec 06 12:52:23 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:52:21</nova:creationTime>
Dec 06 12:52:23 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:52:23 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:52:23 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:52:23 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:52:23 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:52:23 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:52:23 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:52:23 user nova-compute[75247]:       <nova:owner>
Dec 06 12:52:23 user nova-compute[75247]:         <nova:user uuid="fc13843d8f074da189dbd3e93750b811">tempest-ServerActionsTestOtherA-2075667053-project-member</nova:user>
Dec 06 12:52:23 user nova-compute[75247]:         <nova:project uuid="a0ccf15765714ca2a8c4700d2d6e3ed2">tempest-ServerActionsTestOtherA-2075667053</nova:project>
Dec 06 12:52:23 user nova-compute[75247]:       </nova:owner>
Dec 06 12:52:23 user nova-compute[75247]:       <nova:ports>
Dec 06 12:52:23 user nova-compute[75247]:         <nova:port uuid="41d8bb63-57dd-4479-9a1e-89e223d16677">
Dec 06 12:52:23 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 06 12:52:23 user nova-compute[75247]:         </nova:port>
Dec 06 12:52:23 user nova-compute[75247]:       </nova:ports>
Dec 06 12:52:23 user nova-compute[75247]:     </nova:instance>
Dec 06 12:52:23 user nova-compute[75247]:   </metadata>
Dec 06 12:52:23 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:52:23 user nova-compute[75247]:     <system>
Dec 06 12:52:23 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:52:23 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:52:23 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:52:23 user nova-compute[75247]:       <entry name="serial">b3720cc0-ff80-4ca2-8b13-d83dded593ad</entry>
Dec 06 12:52:23 user nova-compute[75247]:       <entry name="uuid">b3720cc0-ff80-4ca2-8b13-d83dded593ad</entry>
Dec 06 12:52:23 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:52:23 user nova-compute[75247]:     </system>
Dec 06 12:52:23 user nova-compute[75247]:   </sysinfo>
Dec 06 12:52:23 user nova-compute[75247]:   <os>
Dec 06 12:52:23 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:52:23 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:52:23 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:52:23 user nova-compute[75247]:   </os>
Dec 06 12:52:23 user nova-compute[75247]:   <features>
Dec 06 12:52:23 user nova-compute[75247]:     <acpi/>
Dec 06 12:52:23 user nova-compute[75247]:     <apic/>
Dec 06 12:52:23 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:52:23 user nova-compute[75247]:   </features>
Dec 06 12:52:23 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:52:23 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:52:23 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:52:23 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:52:23 user nova-compute[75247]:   </clock>
Dec 06 12:52:23 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:52:23 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:52:23 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:52:23 user nova-compute[75247]:   </cpu>
Dec 06 12:52:23 user nova-compute[75247]:   <devices>
Dec 06 12:52:23 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 12:52:23 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:52:23 user nova-compute[75247]:       <source dev="/dev/sdf"/>
Dec 06 12:52:23 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:52:23 user nova-compute[75247]:       <serial>7ce8f69d-d096-4c5d-ae72-af142a835d31</serial>
Dec 06 12:52:23 user nova-compute[75247]:     </disk>
Dec 06 12:52:23 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:52:23 user nova-compute[75247]:       <mac address="fa:16:3e:9a:8b:8a"/>
Dec 06 12:52:23 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:52:23 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:52:23 user nova-compute[75247]:       <target dev="tap41d8bb63-57"/>
Dec 06 12:52:23 user nova-compute[75247]:     </interface>
Dec 06 12:52:23 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:52:23 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/b3720cc0-ff80-4ca2-8b13-d83dded593ad/console.log" append="off"/>
Dec 06 12:52:23 user nova-compute[75247]:     </serial>
Dec 06 12:52:23 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:52:23 user nova-compute[75247]:     <video>
Dec 06 12:52:23 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:52:23 user nova-compute[75247]:     </video>
Dec 06 12:52:23 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:52:23 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:52:23 user nova-compute[75247]:     </rng>
Dec 06 12:52:23 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:52:23 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:52:23 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:52:23 user nova-compute[75247]:     </memballoon>
Dec 06 12:52:23 user nova-compute[75247]:   </devices>
Dec 06 12:52:23 user nova-compute[75247]: </domain>
Dec 06 12:52:23 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:52:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1873472062',display_name='tempest-ServerActionsTestOtherA-server-1873472062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1873472062',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1PSIn5waVLUBUVXmci26Bjo3OHYSVHL8/oxs3uvNoObvAgLe5HgiP5u61wX8nEvgm8XgeBjcCfcP/HNC/vep9hMtkBYH/Pz/i1rF8IkHYEtoKU1LHCX3Qi/2pvpu4Reg==',key_name='tempest-keypair-1071092699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0ccf15765714ca2a8c4700d2d6e3ed2',ramdisk_id='',reservation_id='r-80mdy70u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2075667053',owner_user_name='tempest-ServerActionsTestOtherA-2075667053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:52:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13843d8f074da189dbd3e93750b811',uuid=b3720cc0-ff80-4ca2-8b13-d83dded593ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41d8bb63-57dd-4479-9a1e-89e223d16677", "address": "fa:16:3e:9a:8b:8a", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d8bb63-57", "ovs_interfaceid": "41d8bb63-57dd-4479-9a1e-89e223d16677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converting VIF {"id": "41d8bb63-57dd-4479-9a1e-89e223d16677", "address": "fa:16:3e:9a:8b:8a", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d8bb63-57", "ovs_interfaceid": "41d8bb63-57dd-4479-9a1e-89e223d16677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:8b:8a,bridge_name='br-int',has_traffic_filtering=True,id=41d8bb63-57dd-4479-9a1e-89e223d16677,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d8bb63-57') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG os_vif [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:8b:8a,bridge_name='br-int',has_traffic_filtering=True,id=41d8bb63-57dd-4479-9a1e-89e223d16677,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d8bb63-57') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4cb8e765-fa8f-5ae8-946b-73de4f03f707', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41d8bb63-57, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41d8bb63-57, col_values=(('qos', UUID('f277c676-6168-4d53-8a5c-a691071f6e08')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41d8bb63-57, col_values=(('external_ids', {'iface-id': '41d8bb63-57dd-4479-9a1e-89e223d16677', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:8b:8a', 'vm-uuid': 'b3720cc0-ff80-4ca2-8b13-d83dded593ad'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:23 user nova-compute[75247]: INFO os_vif [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:8b:8a,bridge_name='br-int',has_traffic_filtering=True,id=41d8bb63-57dd-4479-9a1e-89e223d16677,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d8bb63-57')
Dec 06 12:52:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:52:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] No VIF found with MAC fa:16:3e:9a:8b:8a, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:52:24 user nova-compute[75247]: DEBUG nova.compute.manager [req-872f648e-e998-4419-9acf-da65138ca9da req-29ebf204-c310-4600-bcfc-7ec4ecbb49ef service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Received event network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:52:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-872f648e-e998-4419-9acf-da65138ca9da req-29ebf204-c310-4600-bcfc-7ec4ecbb49ef service nova] Acquiring lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:52:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-872f648e-e998-4419-9acf-da65138ca9da req-29ebf204-c310-4600-bcfc-7ec4ecbb49ef service nova] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:52:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-872f648e-e998-4419-9acf-da65138ca9da req-29ebf204-c310-4600-bcfc-7ec4ecbb49ef service nova] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:52:24 user nova-compute[75247]: DEBUG nova.compute.manager [req-872f648e-e998-4419-9acf-da65138ca9da req-29ebf204-c310-4600-bcfc-7ec4ecbb49ef service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] No waiting events found dispatching network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:52:24 user nova-compute[75247]: WARNING nova.compute.manager [req-872f648e-e998-4419-9acf-da65138ca9da req-29ebf204-c310-4600-bcfc-7ec4ecbb49ef service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Received unexpected event network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 for instance with vm_state building and task_state spawning.
Dec 06 12:52:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-e2cebe0f-4446-42ee-aa0b-48014e14c971 req-de6eae86-8219-42b0-92ef-a20f8b520a22 service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Received event network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e2cebe0f-4446-42ee-aa0b-48014e14c971 req-de6eae86-8219-42b0-92ef-a20f8b520a22 service nova] Acquiring lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e2cebe0f-4446-42ee-aa0b-48014e14c971 req-de6eae86-8219-42b0-92ef-a20f8b520a22 service nova] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e2cebe0f-4446-42ee-aa0b-48014e14c971 req-de6eae86-8219-42b0-92ef-a20f8b520a22 service nova] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-e2cebe0f-4446-42ee-aa0b-48014e14c971 req-de6eae86-8219-42b0-92ef-a20f8b520a22 service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] No waiting events found dispatching network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:52:26 user nova-compute[75247]: WARNING nova.compute.manager [req-e2cebe0f-4446-42ee-aa0b-48014e14c971 req-de6eae86-8219-42b0-92ef-a20f8b520a22 service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Received unexpected event network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 for instance with vm_state building and task_state spawning.
Dec 06 12:52:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-e2cebe0f-4446-42ee-aa0b-48014e14c971 req-de6eae86-8219-42b0-92ef-a20f8b520a22 service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Received event network-vif-plugged-41d8bb63-57dd-4479-9a1e-89e223d16677 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e2cebe0f-4446-42ee-aa0b-48014e14c971 req-de6eae86-8219-42b0-92ef-a20f8b520a22 service nova] Acquiring lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e2cebe0f-4446-42ee-aa0b-48014e14c971 req-de6eae86-8219-42b0-92ef-a20f8b520a22 service nova] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e2cebe0f-4446-42ee-aa0b-48014e14c971 req-de6eae86-8219-42b0-92ef-a20f8b520a22 service nova] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-e2cebe0f-4446-42ee-aa0b-48014e14c971 req-de6eae86-8219-42b0-92ef-a20f8b520a22 service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] No waiting events found dispatching network-vif-plugged-41d8bb63-57dd-4479-9a1e-89e223d16677 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:52:26 user nova-compute[75247]: WARNING nova.compute.manager [req-e2cebe0f-4446-42ee-aa0b-48014e14c971 req-de6eae86-8219-42b0-92ef-a20f8b520a22 service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Received unexpected event network-vif-plugged-41d8bb63-57dd-4479-9a1e-89e223d16677 for instance with vm_state building and task_state spawning.
Dec 06 12:52:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-e2cebe0f-4446-42ee-aa0b-48014e14c971 req-de6eae86-8219-42b0-92ef-a20f8b520a22 service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Received event network-vif-plugged-41d8bb63-57dd-4479-9a1e-89e223d16677 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e2cebe0f-4446-42ee-aa0b-48014e14c971 req-de6eae86-8219-42b0-92ef-a20f8b520a22 service nova] Acquiring lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e2cebe0f-4446-42ee-aa0b-48014e14c971 req-de6eae86-8219-42b0-92ef-a20f8b520a22 service nova] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e2cebe0f-4446-42ee-aa0b-48014e14c971 req-de6eae86-8219-42b0-92ef-a20f8b520a22 service nova] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-e2cebe0f-4446-42ee-aa0b-48014e14c971 req-de6eae86-8219-42b0-92ef-a20f8b520a22 service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] No waiting events found dispatching network-vif-plugged-41d8bb63-57dd-4479-9a1e-89e223d16677 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:52:26 user nova-compute[75247]: WARNING nova.compute.manager [req-e2cebe0f-4446-42ee-aa0b-48014e14c971 req-de6eae86-8219-42b0-92ef-a20f8b520a22 service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Received unexpected event network-vif-plugged-41d8bb63-57dd-4479-9a1e-89e223d16677 for instance with vm_state building and task_state spawning.
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "92d215fd-8411-430c-b91e-b6e62e02a994" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "92d215fd-8411-430c-b91e-b6e62e02a994" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG nova.objects.instance [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lazy-loading 'flavor' on Instance uuid 92d215fd-8411-430c-b91e-b6e62e02a994 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "92d215fd-8411-430c-b91e-b6e62e02a994" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "92d215fd-8411-430c-b91e-b6e62e02a994" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "92d215fd-8411-430c-b91e-b6e62e02a994" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:52:26 user nova-compute[75247]: INFO nova.compute.manager [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Attaching volume f9a3d0be-0d86-4a99-a353-728604fb5abd to /dev/vdb
Dec 06 12:52:26 user nova-compute[75247]: DEBUG os_brick.utils [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00010ab-35a5-427a-94cb-ec6968910928]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[314c7ff4-d3cb-42f9-ae51-8569512de590]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9eaea3-2486-4e33-a44d-82a1e68e95fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c2363f-544b-43a5-9673-58b8906492a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:52:26 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:52:26 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9c4a10-9051-4485-81cb-d85d1e39244c]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG os_brick.utils [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:52:26 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Updating existing volume attachment record: 3bb0750d-976d-4fe9-82b7-a1b94b7bcf48 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:52:27 user nova-compute[75247]: DEBUG nova.compute.manager [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:52:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:52:27 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Instance spawned successfully.
Dec 06 12:52:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:52:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:52:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:52:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:52:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:52:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:52:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:52:27 user nova-compute[75247]: INFO nova.compute.manager [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Took 7.85 seconds to spawn the instance on the hypervisor.
Dec 06 12:52:27 user nova-compute[75247]: DEBUG nova.compute.manager [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:52:27 user nova-compute[75247]: INFO nova.compute.manager [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Took 40.32 seconds to build instance.
Dec 06 12:52:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b1f5c480-4800-4c51-a2bb-c59072763cf7 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.418s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:52:27 user nova-compute[75247]: DEBUG nova.compute.manager [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:52:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:52:27 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Instance spawned successfully.
Dec 06 12:52:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:52:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:52:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:52:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:52:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:52:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:52:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:52:27 user nova-compute[75247]: INFO nova.compute.manager [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Took 6.11 seconds to spawn the instance on the hypervisor.
Dec 06 12:52:27 user nova-compute[75247]: DEBUG nova.compute.manager [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:52:27 user nova-compute[75247]: INFO nova.compute.manager [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Took 18.11 seconds to build instance.
Dec 06 12:52:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-adebcc61-b009-420d-90b3-204dbffc6fb4 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.242s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:52:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:42 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance db837c7a-c52d-469b-abf7-cea107454c60 is timed out.
Dec 06 12:52:42 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Successfully detached device vdb from instance db837c7a-c52d-469b-abf7-cea107454c60 from the live domain config.
Dec 06 12:52:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDLdVmPj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:52:42 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:52:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[41da5874-6714-4a28-865a-e18275fbbae8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:52:42 user nova-compute[75247]: No targets found.
Dec 06 12:52:42 user nova-compute[75247]: iSNS:
Dec 06 12:52:42 user nova-compute[75247]: No targets found.
Dec 06 12:52:42 user nova-compute[75247]: STATIC:
Dec 06 12:52:42 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:52:42 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:52:42 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:52:42 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65
Dec 06 12:52:42 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:52:42 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:52:42 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33
Dec 06 12:52:42 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:52:42 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:52:42 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31
Dec 06 12:52:42 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:52:42 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:52:42 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0
Dec 06 12:52:42 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:52:42 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:52:42 user nova-compute[75247]: FIRMWARE:
Dec 06 12:52:42 user nova-compute[75247]: No targets found.
Dec 06 12:52:42 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:52:42 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:52:42 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6f0daa-347f-4885-bb5f-c5bc044d400e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b9f854-d509-4497-94b9-bae96c58aee3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:52:42 user nova-compute[75247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)
Dec 06 12:52:42 user nova-compute[75247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)
Dec 06 12:52:42 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:52:42 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:52:42 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:52:42 user nova-compute[75247]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 (non-flash)
Dec 06 12:52:42 user nova-compute[75247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)
Dec 06 12:52:42 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:52:42 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:52:42 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c613760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65'): ({'sdb'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Removing single pathed devices sdb {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e2cac5-622a-4b45-8ccb-08822166242d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fc26c9-3f1f-4cbc-ac16-004dd7fd08b1]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Flushing IO for device /dev/sdb {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cab0b86-0ae9-470d-b474-79ff54c096ea]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadda2d2-0832-4831-bb66-ab8ac569ef0f]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0056c6-c819-48db-89a8-82026ce39348]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[53aec0b1-5f0b-4946-8ef2-d003a7e53dce]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65, portal: 172.16.0.220,3260]
Dec 06 12:52:42 user nova-compute[75247]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65, portal: 172.16.0.220,3260] successful.
Dec 06 12:52:42 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0262f2d3-7689-4ed3-90cd-aa4535135c65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bb2fcb-bb38-42d2-8427-41a5303acaef]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] <== disconnect_volume: return (332ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:52:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:52:43 user nova-compute[75247]: DEBUG nova.objects.instance [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lazy-loading 'flavor' on Instance uuid db837c7a-c52d-469b-abf7-cea107454c60 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:52:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-2abd074a-794c-46f2-9c38-250bf8047ebc tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "db837c7a-c52d-469b-abf7-cea107454c60" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.773s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:52:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:52:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 12:52:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 12:52:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 12:52:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:46 user nova-compute[75247]: DEBUG nova.compute.manager [req-626118df-25d0-4b07-b9ab-6278d17da7ef req-60912207-d7fc-46ce-835a-5dde8713658b service nova] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Received event network-changed-0d1f49fb-698e-43fd-8ef4-8ad8b2749f92 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:52:46 user nova-compute[75247]: DEBUG nova.compute.manager [req-626118df-25d0-4b07-b9ab-6278d17da7ef req-60912207-d7fc-46ce-835a-5dde8713658b service nova] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Refreshing instance network info cache due to event network-changed-0d1f49fb-698e-43fd-8ef4-8ad8b2749f92. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:52:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-626118df-25d0-4b07-b9ab-6278d17da7ef req-60912207-d7fc-46ce-835a-5dde8713658b service nova] Acquiring lock "refresh_cache-504791a2-9892-4721-856a-e0b77a395d01" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:52:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-626118df-25d0-4b07-b9ab-6278d17da7ef req-60912207-d7fc-46ce-835a-5dde8713658b service nova] Acquired lock "refresh_cache-504791a2-9892-4721-856a-e0b77a395d01" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:52:46 user nova-compute[75247]: DEBUG nova.network.neutron [req-626118df-25d0-4b07-b9ab-6278d17da7ef req-60912207-d7fc-46ce-835a-5dde8713658b service nova] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Refreshing network info cache for port 0d1f49fb-698e-43fd-8ef4-8ad8b2749f92 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:52:46 user nova-compute[75247]: DEBUG nova.network.neutron [req-626118df-25d0-4b07-b9ab-6278d17da7ef req-60912207-d7fc-46ce-835a-5dde8713658b service nova] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Updated VIF entry in instance network info cache for port 0d1f49fb-698e-43fd-8ef4-8ad8b2749f92. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:52:46 user nova-compute[75247]: DEBUG nova.network.neutron [req-626118df-25d0-4b07-b9ab-6278d17da7ef req-60912207-d7fc-46ce-835a-5dde8713658b service nova] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Updating instance_info_cache with network_info: [{"id": "0d1f49fb-698e-43fd-8ef4-8ad8b2749f92", "address": "fa:16:3e:58:67:92", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d1f49fb-69", "ovs_interfaceid": "0d1f49fb-698e-43fd-8ef4-8ad8b2749f92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:52:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-626118df-25d0-4b07-b9ab-6278d17da7ef req-60912207-d7fc-46ce-835a-5dde8713658b service nova] Releasing lock "refresh_cache-504791a2-9892-4721-856a-e0b77a395d01" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:52:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "504791a2-9892-4721-856a-e0b77a395d01" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:52:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "504791a2-9892-4721-856a-e0b77a395d01" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:52:48 user nova-compute[75247]: DEBUG nova.objects.instance [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lazy-loading 'flavor' on Instance uuid 504791a2-9892-4721-856a-e0b77a395d01 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:52:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "504791a2-9892-4721-856a-e0b77a395d01" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "504791a2-9892-4721-856a-e0b77a395d01" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "504791a2-9892-4721-856a-e0b77a395d01" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:52:49 user nova-compute[75247]: INFO nova.compute.manager [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Attaching volume f637e7a5-35e1-4f16-aa0c-327428b35034 to /dev/vdb
Dec 06 12:52:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.utils [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ed95af-db1c-4229-99c0-8f3ec31a120d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d10554-be3e-4a81-88fe-b7e7e017a7ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[febf31f8-9436-4fd1-b36c-91e37ff5bc38]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[659e7864-5a19-485e-b48f-b9617ccb451f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:52:49 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5681935d-d2b0-4252-8864-aba909809225]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.utils [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Updating existing volume attachment record: d45628db-7c0b-4024-b732-988fa000dafb {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PlvhWwCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:52:49 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:52:49 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:52:49 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabd0833-f7bf-467c-aa2c-f5b51c8ded91]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:52:49 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed7b9b4-baf5-4744-8bd9-0ac3bd221f9e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd] added
Dec 06 12:52:49 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0f16c0-6ba4-4843-a3e2-caf7875f7969]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec2b46c-edef-4aea-be37-97d60152f42b]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PlvhWwCI {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PlvhWwCI" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9383a2bc-7007-4633-8f53-e5278eccc779]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PlvhWwCI'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06d0630-9b66-485e-86f2-ba9dfd314d3d]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[806b620b-8c86-4d5e-b952-444d709d05a3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:52:49 user nova-compute[75247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)
Dec 06 12:52:49 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:52:49 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:52:49 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:52:49 user nova-compute[75247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)
Dec 06 12:52:49 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:52:49 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:52:49 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed100106-57dd-4e15-8607-eb45652123a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd, portal: 172.16.0.220,3260]
Dec 06 12:52:49 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd, portal: 172.16.0.220,3260] successful.
Dec 06 12:52:49 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39f77d1-3104-447c-b12b-2c8b8d03b55b]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b3d18e-08f3-46b4-9af4-fc1f03ca5a64]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:52:49 user nova-compute[75247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)
Dec 06 12:52:49 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:52:49 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:52:49 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:52:49 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:52:49 user nova-compute[75247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)
Dec 06 12:52:49 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:52:49 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:52:49 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:52:49 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf6c046-1182-4d21-88a6-f9b3b26c1e94]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:52:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PlvhWwCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:52:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:52:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26234316336613263', 'path': '/dev/sdb'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:52:50 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234316336613263', 'path': '/dev/sdb'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:52:50 user nova-compute[75247]: DEBUG nova.objects.instance [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lazy-loading 'flavor' on Instance uuid 92d215fd-8411-430c-b91e-b6e62e02a994 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:52:50 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 12:52:50 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:52:50 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:52:50 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:52:50 user nova-compute[75247]:   <serial>f9a3d0be-0d86-4a99-a353-728604fb5abd</serial>
Dec 06 12:52:50 user nova-compute[75247]: </disk>
Dec 06 12:52:50 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 12:52:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:52:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:52:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] No VIF found with MAC fa:16:3e:56:7e:02, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:52:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-cc52c67b-ec4d-427b-b8c1-aedfa5c33879 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "92d215fd-8411-430c-b91e-b6e62e02a994" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.901s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:52:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:54 user nova-compute[75247]: DEBUG nova.compute.manager [req-03913278-871f-4f39-b590-729bdaa0e67e req-17a89769-be8c-472c-b4fd-22a1ae25c113 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received event network-changed-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:52:54 user nova-compute[75247]: DEBUG nova.compute.manager [req-03913278-871f-4f39-b590-729bdaa0e67e req-17a89769-be8c-472c-b4fd-22a1ae25c113 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Refreshing instance network info cache due to event network-changed-358da164-b155-4d24-a006-7454c10ee790. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:52:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-03913278-871f-4f39-b590-729bdaa0e67e req-17a89769-be8c-472c-b4fd-22a1ae25c113 service nova] Acquiring lock "refresh_cache-92d215fd-8411-430c-b91e-b6e62e02a994" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:52:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-03913278-871f-4f39-b590-729bdaa0e67e req-17a89769-be8c-472c-b4fd-22a1ae25c113 service nova] Acquired lock "refresh_cache-92d215fd-8411-430c-b91e-b6e62e02a994" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:52:54 user nova-compute[75247]: DEBUG nova.network.neutron [req-03913278-871f-4f39-b590-729bdaa0e67e req-17a89769-be8c-472c-b4fd-22a1ae25c113 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Refreshing network info cache for port 358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:52:55 user nova-compute[75247]: DEBUG nova.network.neutron [req-03913278-871f-4f39-b590-729bdaa0e67e req-17a89769-be8c-472c-b4fd-22a1ae25c113 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Updated VIF entry in instance network info cache for port 358da164-b155-4d24-a006-7454c10ee790. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:52:55 user nova-compute[75247]: DEBUG nova.network.neutron [req-03913278-871f-4f39-b590-729bdaa0e67e req-17a89769-be8c-472c-b4fd-22a1ae25c113 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Updating instance_info_cache with network_info: [{"id": "358da164-b155-4d24-a006-7454c10ee790", "address": "fa:16:3e:56:7e:02", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358da164-b1", "ovs_interfaceid": "358da164-b155-4d24-a006-7454c10ee790", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:52:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-03913278-871f-4f39-b590-729bdaa0e67e req-17a89769-be8c-472c-b4fd-22a1ae25c113 service nova] Releasing lock "refresh_cache-92d215fd-8411-430c-b91e-b6e62e02a994" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:52:57 user nova-compute[75247]: DEBUG nova.compute.manager [req-414386fb-fa18-43a7-bf71-8f03eeb6896c req-17653b5e-2702-4c52-af50-caf18c8962d1 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received event network-changed-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:52:57 user nova-compute[75247]: DEBUG nova.compute.manager [req-414386fb-fa18-43a7-bf71-8f03eeb6896c req-17653b5e-2702-4c52-af50-caf18c8962d1 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Refreshing instance network info cache due to event network-changed-358da164-b155-4d24-a006-7454c10ee790. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:52:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-414386fb-fa18-43a7-bf71-8f03eeb6896c req-17653b5e-2702-4c52-af50-caf18c8962d1 service nova] Acquiring lock "refresh_cache-92d215fd-8411-430c-b91e-b6e62e02a994" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:52:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-414386fb-fa18-43a7-bf71-8f03eeb6896c req-17653b5e-2702-4c52-af50-caf18c8962d1 service nova] Acquired lock "refresh_cache-92d215fd-8411-430c-b91e-b6e62e02a994" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:52:57 user nova-compute[75247]: DEBUG nova.network.neutron [req-414386fb-fa18-43a7-bf71-8f03eeb6896c req-17653b5e-2702-4c52-af50-caf18c8962d1 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Refreshing network info cache for port 358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:52:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "56f7d945-3eae-4dbe-928e-389620e62353" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:52:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "56f7d945-3eae-4dbe-928e-389620e62353" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:52:57 user nova-compute[75247]: INFO nova.compute.manager [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Detaching volume f4b00d03-3331-4acd-aea3-9643c7e9d4c0
Dec 06 12:52:57 user nova-compute[75247]: INFO nova.virt.block_device [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Attempting to driver detach volume f4b00d03-3331-4acd-aea3-9643c7e9d4c0 from mountpoint /dev/vdb
Dec 06 12:52:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Attempting to detach device vdb from instance 56f7d945-3eae-4dbe-928e-389620e62353 from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 12:52:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:52:57 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:52:57 user nova-compute[75247]:   <source dev="/dev/sdc"/>
Dec 06 12:52:57 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:52:57 user nova-compute[75247]:   <serial>f4b00d03-3331-4acd-aea3-9643c7e9d4c0</serial>
Dec 06 12:52:57 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:52:57 user nova-compute[75247]: </disk>
Dec 06 12:52:57 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:52:57 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Successfully detached device vdb from instance 56f7d945-3eae-4dbe-928e-389620e62353 from the persistent domain config.
Dec 06 12:52:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 56f7d945-3eae-4dbe-928e-389620e62353 from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 12:52:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:52:57 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:52:57 user nova-compute[75247]:   <source dev="/dev/sdc"/>
Dec 06 12:52:57 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:52:57 user nova-compute[75247]:   <serial>f4b00d03-3331-4acd-aea3-9643c7e9d4c0</serial>
Dec 06 12:52:57 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:52:57 user nova-compute[75247]: </disk>
Dec 06 12:52:57 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:52:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "56f7d945-3eae-4dbe-928e-389620e62353" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:52:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-182fa5ae-34de-4a61-9788-45393cb3dd0c tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "92d215fd-8411-430c-b91e-b6e62e02a994" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:52:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-182fa5ae-34de-4a61-9788-45393cb3dd0c tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "92d215fd-8411-430c-b91e-b6e62e02a994" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:52:57 user nova-compute[75247]: INFO nova.compute.manager [None req-182fa5ae-34de-4a61-9788-45393cb3dd0c tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Rebooting instance
Dec 06 12:52:58 user nova-compute[75247]: DEBUG nova.network.neutron [req-414386fb-fa18-43a7-bf71-8f03eeb6896c req-17653b5e-2702-4c52-af50-caf18c8962d1 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Updated VIF entry in instance network info cache for port 358da164-b155-4d24-a006-7454c10ee790. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:52:58 user nova-compute[75247]: DEBUG nova.network.neutron [req-414386fb-fa18-43a7-bf71-8f03eeb6896c req-17653b5e-2702-4c52-af50-caf18c8962d1 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Updating instance_info_cache with network_info: [{"id": "358da164-b155-4d24-a006-7454c10ee790", "address": "fa:16:3e:56:7e:02", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358da164-b1", "ovs_interfaceid": "358da164-b155-4d24-a006-7454c10ee790", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:52:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-414386fb-fa18-43a7-bf71-8f03eeb6896c req-17653b5e-2702-4c52-af50-caf18c8962d1 service nova] Releasing lock "refresh_cache-92d215fd-8411-430c-b91e-b6e62e02a994" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:52:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-182fa5ae-34de-4a61-9788-45393cb3dd0c tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "refresh_cache-92d215fd-8411-430c-b91e-b6e62e02a994" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:52:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-182fa5ae-34de-4a61-9788-45393cb3dd0c tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquired lock "refresh_cache-92d215fd-8411-430c-b91e-b6e62e02a994" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:52:58 user nova-compute[75247]: DEBUG nova.network.neutron [None req-182fa5ae-34de-4a61-9788-45393cb3dd0c tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:52:58 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 56f7d945-3eae-4dbe-928e-389620e62353 {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 12:52:58 user nova-compute[75247]: DEBUG nova.network.neutron [None req-182fa5ae-34de-4a61-9788-45393cb3dd0c tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Updating instance_info_cache with network_info: [{"id": "358da164-b155-4d24-a006-7454c10ee790", "address": "fa:16:3e:56:7e:02", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358da164-b1", "ovs_interfaceid": "358da164-b155-4d24-a006-7454c10ee790", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:52:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-182fa5ae-34de-4a61-9788-45393cb3dd0c tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Releasing lock "refresh_cache-92d215fd-8411-430c-b91e-b6e62e02a994" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:52:58 user nova-compute[75247]: DEBUG nova.compute.manager [None req-182fa5ae-34de-4a61-9788-45393cb3dd0c tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:52:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:52:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:01 user nova-compute[75247]: DEBUG nova.compute.manager [req-cbf616f2-02dc-460d-8811-af81e1c0925b req-3c0b820c-da0a-4aa5-bc67-f2086a842d5c service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received event network-vif-unplugged-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:53:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-cbf616f2-02dc-460d-8811-af81e1c0925b req-3c0b820c-da0a-4aa5-bc67-f2086a842d5c service nova] Acquiring lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-cbf616f2-02dc-460d-8811-af81e1c0925b req-3c0b820c-da0a-4aa5-bc67-f2086a842d5c service nova] Lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-cbf616f2-02dc-460d-8811-af81e1c0925b req-3c0b820c-da0a-4aa5-bc67-f2086a842d5c service nova] Lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:01 user nova-compute[75247]: DEBUG nova.compute.manager [req-cbf616f2-02dc-460d-8811-af81e1c0925b req-3c0b820c-da0a-4aa5-bc67-f2086a842d5c service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] No waiting events found dispatching network-vif-unplugged-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:53:01 user nova-compute[75247]: WARNING nova.compute.manager [req-cbf616f2-02dc-460d-8811-af81e1c0925b req-3c0b820c-da0a-4aa5-bc67-f2086a842d5c service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received unexpected event network-vif-unplugged-358da164-b155-4d24-a006-7454c10ee790 for instance with vm_state active and task_state reboot_started.
Dec 06 12:53:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:01 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-182fa5ae-34de-4a61-9788-45393cb3dd0c tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Instance shutdown successfully.
Dec 06 12:53:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-1d25c0a4-2259-44b5-9a39-df2a3d5b481c req-71531fcb-8505-4a57-8e05-6956b3eaba4c service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received event network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:53:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1d25c0a4-2259-44b5-9a39-df2a3d5b481c req-71531fcb-8505-4a57-8e05-6956b3eaba4c service nova] Acquiring lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1d25c0a4-2259-44b5-9a39-df2a3d5b481c req-71531fcb-8505-4a57-8e05-6956b3eaba4c service nova] Lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1d25c0a4-2259-44b5-9a39-df2a3d5b481c req-71531fcb-8505-4a57-8e05-6956b3eaba4c service nova] Lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-1d25c0a4-2259-44b5-9a39-df2a3d5b481c req-71531fcb-8505-4a57-8e05-6956b3eaba4c service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] No waiting events found dispatching network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:53:03 user nova-compute[75247]: WARNING nova.compute.manager [req-1d25c0a4-2259-44b5-9a39-df2a3d5b481c req-71531fcb-8505-4a57-8e05-6956b3eaba4c service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received unexpected event network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 for instance with vm_state active and task_state reboot_started.
Dec 06 12:53:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xmiMYVRK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:53:04 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:53:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:53:04 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:53:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:53:04 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10887a3-4b87-4393-b5ec-c960557d8346]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:53:04 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f097a2-5290-4006-aae4-e75b3c9fb194]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034] added
Dec 06 12:53:04 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe72f33-03cc-42ee-948c-ec2587af8a00]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c9faab-a333-4fbf-b3cd-2d9727919ac7]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xmiMYVRK {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xmiMYVRK" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9abf57-c58e-46ce-a751-23fcb0ecb49f]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xmiMYVRK'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4420d94d-de5b-4d6f-89bd-8f3836b18378]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f4aeeb-fe12-4f4d-a497-a8b227e869b1]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:53:04 user nova-compute[75247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)
Dec 06 12:53:04 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:53:04 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:53:04 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:53:04 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:53:04 user nova-compute[75247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)
Dec 06 12:53:04 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:53:04 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:53:04 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:53:04 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3543c36b-e2cd-4107-a337-fda911051ed8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034, portal: 172.16.0.220,3260]
Dec 06 12:53:04 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034, portal: 172.16.0.220,3260] successful.
Dec 06 12:53:04 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79599ee-c975-4c53-835f-837edc6874a4]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20f387d-fc33-4b62-a234-bc659677ebf1]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:53:04 user nova-compute[75247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)
Dec 06 12:53:04 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:53:04 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:53:04 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:53:04 user nova-compute[75247]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 (non-flash)
Dec 06 12:53:04 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:53:04 user nova-compute[75247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)
Dec 06 12:53:04 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:53:04 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:53:04 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:53:04 user nova-compute[75247]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 (non-flash)
Dec 06 12:53:04 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] HCTL ('38', '-', '-', 0) found on session 37 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[427bf431-a79b-4cf4-ba30-b55964c26311]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:53:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xmiMYVRK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:53:05 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Instance running successfully.
Dec 06 12:53:05 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-182fa5ae-34de-4a61-9788-45393cb3dd0c tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Instance soft rebooted successfully.
Dec 06 12:53:05 user nova-compute[75247]: DEBUG nova.compute.manager [None req-182fa5ae-34de-4a61-9788-45393cb3dd0c tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:53:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-4ed08311-05a8-423b-af52-83b57600dcba req-b2709085-c936-4696-bb7f-2174b5024c6a service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received event network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:53:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4ed08311-05a8-423b-af52-83b57600dcba req-b2709085-c936-4696-bb7f-2174b5024c6a service nova] Acquiring lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4ed08311-05a8-423b-af52-83b57600dcba req-b2709085-c936-4696-bb7f-2174b5024c6a service nova] Lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4ed08311-05a8-423b-af52-83b57600dcba req-b2709085-c936-4696-bb7f-2174b5024c6a service nova] Lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-4ed08311-05a8-423b-af52-83b57600dcba req-b2709085-c936-4696-bb7f-2174b5024c6a service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] No waiting events found dispatching network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:53:05 user nova-compute[75247]: WARNING nova.compute.manager [req-4ed08311-05a8-423b-af52-83b57600dcba req-b2709085-c936-4696-bb7f-2174b5024c6a service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received unexpected event network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 for instance with vm_state active and task_state reboot_started.
Dec 06 12:53:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-4ed08311-05a8-423b-af52-83b57600dcba req-b2709085-c936-4696-bb7f-2174b5024c6a service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received event network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:53:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4ed08311-05a8-423b-af52-83b57600dcba req-b2709085-c936-4696-bb7f-2174b5024c6a service nova] Acquiring lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4ed08311-05a8-423b-af52-83b57600dcba req-b2709085-c936-4696-bb7f-2174b5024c6a service nova] Lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4ed08311-05a8-423b-af52-83b57600dcba req-b2709085-c936-4696-bb7f-2174b5024c6a service nova] Lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-4ed08311-05a8-423b-af52-83b57600dcba req-b2709085-c936-4696-bb7f-2174b5024c6a service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] No waiting events found dispatching network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:53:05 user nova-compute[75247]: WARNING nova.compute.manager [req-4ed08311-05a8-423b-af52-83b57600dcba req-b2709085-c936-4696-bb7f-2174b5024c6a service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received unexpected event network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 for instance with vm_state active and task_state reboot_started.
Dec 06 12:53:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-182fa5ae-34de-4a61-9788-45393cb3dd0c tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "92d215fd-8411-430c-b91e-b6e62e02a994" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.531s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:05 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:53:05 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '26631626234333263', 'path': '/dev/sdg'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:53:05 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631626234333263', 'path': '/dev/sdg'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:53:05 user nova-compute[75247]: DEBUG nova.objects.instance [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lazy-loading 'flavor' on Instance uuid 504791a2-9892-4721-856a-e0b77a395d01 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:53:05 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 12:53:05 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:53:05 user nova-compute[75247]:   <source dev="/dev/sdg"/>
Dec 06 12:53:05 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:53:05 user nova-compute[75247]:   <serial>f637e7a5-35e1-4f16-aa0c-327428b35034</serial>
Dec 06 12:53:05 user nova-compute[75247]: </disk>
Dec 06 12:53:05 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 12:53:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:53:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:53:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] No VIF found with MAC fa:16:3e:58:67:92, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:53:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-fab77cee-f58b-422f-991c-bae3f531893d tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "504791a2-9892-4721-856a-e0b77a395d01" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.461s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:07 user nova-compute[75247]: DEBUG nova.compute.manager [req-76b20ffa-ee20-4228-83c2-1ce9cbfd9489 req-a9cd0c6e-5dfd-4d77-9843-f8f97dee60bd service nova] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Received event network-changed-8a76a9ce-2bbc-4989-9fcb-66cce8adf16b {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:53:07 user nova-compute[75247]: DEBUG nova.compute.manager [req-76b20ffa-ee20-4228-83c2-1ce9cbfd9489 req-a9cd0c6e-5dfd-4d77-9843-f8f97dee60bd service nova] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Refreshing instance network info cache due to event network-changed-8a76a9ce-2bbc-4989-9fcb-66cce8adf16b. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:53:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-76b20ffa-ee20-4228-83c2-1ce9cbfd9489 req-a9cd0c6e-5dfd-4d77-9843-f8f97dee60bd service nova] Acquiring lock "refresh_cache-0e7f8114-2e5d-4bf6-bb31-b00666f0d901" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:53:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-76b20ffa-ee20-4228-83c2-1ce9cbfd9489 req-a9cd0c6e-5dfd-4d77-9843-f8f97dee60bd service nova] Acquired lock "refresh_cache-0e7f8114-2e5d-4bf6-bb31-b00666f0d901" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:53:07 user nova-compute[75247]: DEBUG nova.network.neutron [req-76b20ffa-ee20-4228-83c2-1ce9cbfd9489 req-a9cd0c6e-5dfd-4d77-9843-f8f97dee60bd service nova] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Refreshing network info cache for port 8a76a9ce-2bbc-4989-9fcb-66cce8adf16b {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:53:08 user nova-compute[75247]: DEBUG nova.network.neutron [req-76b20ffa-ee20-4228-83c2-1ce9cbfd9489 req-a9cd0c6e-5dfd-4d77-9843-f8f97dee60bd service nova] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Updated VIF entry in instance network info cache for port 8a76a9ce-2bbc-4989-9fcb-66cce8adf16b. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:53:08 user nova-compute[75247]: DEBUG nova.network.neutron [req-76b20ffa-ee20-4228-83c2-1ce9cbfd9489 req-a9cd0c6e-5dfd-4d77-9843-f8f97dee60bd service nova] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Updating instance_info_cache with network_info: [{"id": "8a76a9ce-2bbc-4989-9fcb-66cce8adf16b", "address": "fa:16:3e:67:2a:53", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a76a9ce-2b", "ovs_interfaceid": "8a76a9ce-2bbc-4989-9fcb-66cce8adf16b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:53:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-76b20ffa-ee20-4228-83c2-1ce9cbfd9489 req-a9cd0c6e-5dfd-4d77-9843-f8f97dee60bd service nova] Releasing lock "refresh_cache-0e7f8114-2e5d-4bf6-bb31-b00666f0d901" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:53:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "504791a2-9892-4721-856a-e0b77a395d01" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "504791a2-9892-4721-856a-e0b77a395d01" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:08 user nova-compute[75247]: INFO nova.compute.manager [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Detaching volume f637e7a5-35e1-4f16-aa0c-327428b35034
Dec 06 12:53:08 user nova-compute[75247]: INFO nova.virt.block_device [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Attempting to driver detach volume f637e7a5-35e1-4f16-aa0c-327428b35034 from mountpoint /dev/vdb
Dec 06 12:53:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Attempting to detach device vdb from instance 504791a2-9892-4721-856a-e0b77a395d01 from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 12:53:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:53:08 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:53:08 user nova-compute[75247]:   <source dev="/dev/sdg"/>
Dec 06 12:53:08 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:53:08 user nova-compute[75247]:   <serial>f637e7a5-35e1-4f16-aa0c-327428b35034</serial>
Dec 06 12:53:08 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:53:08 user nova-compute[75247]: </disk>
Dec 06 12:53:08 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:53:08 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Successfully detached device vdb from instance 504791a2-9892-4721-856a-e0b77a395d01 from the persistent domain config.
Dec 06 12:53:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 504791a2-9892-4721-856a-e0b77a395d01 from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 12:53:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:53:08 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:53:08 user nova-compute[75247]:   <source dev="/dev/sdg"/>
Dec 06 12:53:08 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:53:08 user nova-compute[75247]:   <serial>f637e7a5-35e1-4f16-aa0c-327428b35034</serial>
Dec 06 12:53:08 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:53:08 user nova-compute[75247]: </disk>
Dec 06 12:53:08 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:53:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 504791a2-9892-4721-856a-e0b77a395d01 {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 12:53:09 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'flavor' on Instance uuid 0e7f8114-2e5d-4bf6-bb31-b00666f0d901 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:11 user nova-compute[75247]: INFO nova.compute.manager [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Attaching volume a63b8f38-a8df-4057-989f-91a441657c1c to /dev/vdb
Dec 06 12:53:11 user nova-compute[75247]: DEBUG os_brick.utils [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[49045866-ab17-4a01-80ff-2df76097f2c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a99030-7f68-482e-b581-6b46e5fcc236]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5a11a6-82ae-4e19-ae01-9442cf819295]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef0e396-21f6-4f8b-9e4a-f9ad473045ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:53:11 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:53:11 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf94663d-0cf0-4f02-8a57-18b4038d543e]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG os_brick.utils [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Updating existing volume attachment record: f5c19416-8603-4fa6-a568-7ec51b62a029 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:53:11 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:53:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bb6fed24-2683-4a83-aa16-0c94d5ab7d0d tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Acquiring lock "db837c7a-c52d-469b-abf7-cea107454c60" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bb6fed24-2683-4a83-aa16-0c94d5ab7d0d tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "db837c7a-c52d-469b-abf7-cea107454c60" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bb6fed24-2683-4a83-aa16-0c94d5ab7d0d tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Acquiring lock "db837c7a-c52d-469b-abf7-cea107454c60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bb6fed24-2683-4a83-aa16-0c94d5ab7d0d tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "db837c7a-c52d-469b-abf7-cea107454c60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bb6fed24-2683-4a83-aa16-0c94d5ab7d0d tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "db837c7a-c52d-469b-abf7-cea107454c60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:12 user nova-compute[75247]: INFO nova.compute.manager [None req-bb6fed24-2683-4a83-aa16-0c94d5ab7d0d tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Terminating instance
Dec 06 12:53:12 user nova-compute[75247]: DEBUG nova.compute.manager [None req-bb6fed24-2683-4a83-aa16-0c94d5ab7d0d tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:53:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:12 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:53:12 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:53:12 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 12:53:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-f4e19a5d-a540-4b9c-9675-f45e38f23600 req-fe8b7c7e-3d4c-4a1f-8496-6c107dc98695 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received event network-vif-unplugged-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:53:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f4e19a5d-a540-4b9c-9675-f45e38f23600 req-fe8b7c7e-3d4c-4a1f-8496-6c107dc98695 service nova] Acquiring lock "db837c7a-c52d-469b-abf7-cea107454c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f4e19a5d-a540-4b9c-9675-f45e38f23600 req-fe8b7c7e-3d4c-4a1f-8496-6c107dc98695 service nova] Lock "db837c7a-c52d-469b-abf7-cea107454c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f4e19a5d-a540-4b9c-9675-f45e38f23600 req-fe8b7c7e-3d4c-4a1f-8496-6c107dc98695 service nova] Lock "db837c7a-c52d-469b-abf7-cea107454c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-f4e19a5d-a540-4b9c-9675-f45e38f23600 req-fe8b7c7e-3d4c-4a1f-8496-6c107dc98695 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] No waiting events found dispatching network-vif-unplugged-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:53:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-f4e19a5d-a540-4b9c-9675-f45e38f23600 req-fe8b7c7e-3d4c-4a1f-8496-6c107dc98695 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received event network-vif-unplugged-861bfd56-2888-46b4-b583-08526d05bcd6 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:53:13 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Instance destroyed successfully.
Dec 06 12:53:13 user nova-compute[75247]: DEBUG nova.objects.instance [None req-bb6fed24-2683-4a83-aa16-0c94d5ab7d0d tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lazy-loading 'resources' on Instance uuid db837c7a-c52d-469b-abf7-cea107454c60 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:53:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-bb6fed24-2683-4a83-aa16-0c94d5ab7d0d tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:45:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1896743252',display_name='tempest-ServerStableDeviceRescueTest-server-1896743252',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1896743252',id=19,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvhU73cJfUZBM75WAXDtUdapcw/hxet4znGmOMjhn8KYsa3efoegt+QlsaxBfHHhjJbHGSMnEJuDsqMQgNWlux0I/2LXEwJscpwT1hYARyfH0pcXijK2MYWQok7t1Mf2Q==',key_name='tempest-keypair-203231955',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:50:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e8f578ae9d44706b68eaac234ae6d65',ramdisk_id='',reservation_id='r-1s4hdg20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-374729134',owner_user_name='tempest-ServerStableDeviceRescueTest-374729134-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:51:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4741ba4fd4f48d9a91b5c9d31b7a3ac',uuid=db837c7a-c52d-469b-abf7-cea107454c60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "861bfd56-2888-46b4-b583-08526d05bcd6", "address": "fa:16:3e:eb:bc:82", "network": {"id": "52a97bc9-88b7-430a-80c8-3d6210441943", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1761062078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8f578ae9d44706b68eaac234ae6d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861bfd56-28", "ovs_interfaceid": "861bfd56-2888-46b4-b583-08526d05bcd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:53:13 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-bb6fed24-2683-4a83-aa16-0c94d5ab7d0d tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Converting VIF {"id": "861bfd56-2888-46b4-b583-08526d05bcd6", "address": "fa:16:3e:eb:bc:82", "network": {"id": "52a97bc9-88b7-430a-80c8-3d6210441943", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1761062078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8f578ae9d44706b68eaac234ae6d65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861bfd56-28", "ovs_interfaceid": "861bfd56-2888-46b4-b583-08526d05bcd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:53:13 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-bb6fed24-2683-4a83-aa16-0c94d5ab7d0d tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:bc:82,bridge_name='br-int',has_traffic_filtering=True,id=861bfd56-2888-46b4-b583-08526d05bcd6,network=Network(52a97bc9-88b7-430a-80c8-3d6210441943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap861bfd56-28') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:53:13 user nova-compute[75247]: DEBUG os_vif [None req-bb6fed24-2683-4a83-aa16-0c94d5ab7d0d tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:bc:82,bridge_name='br-int',has_traffic_filtering=True,id=861bfd56-2888-46b4-b583-08526d05bcd6,network=Network(52a97bc9-88b7-430a-80c8-3d6210441943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap861bfd56-28') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:53:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap861bfd56-28, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:53:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5e7a2497-f77f-48e2-b078-caa7cbc382e7) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:53:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:13 user nova-compute[75247]: INFO os_vif [None req-bb6fed24-2683-4a83-aa16-0c94d5ab7d0d tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:bc:82,bridge_name='br-int',has_traffic_filtering=True,id=861bfd56-2888-46b4-b583-08526d05bcd6,network=Network(52a97bc9-88b7-430a-80c8-3d6210441943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap861bfd56-28')
Dec 06 12:53:13 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-bb6fed24-2683-4a83-aa16-0c94d5ab7d0d tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Deleting instance files /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60_del
Dec 06 12:53:13 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-bb6fed24-2683-4a83-aa16-0c94d5ab7d0d tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Deletion of /opt/stack/data/nova/instances/db837c7a-c52d-469b-abf7-cea107454c60_del complete
Dec 06 12:53:13 user nova-compute[75247]: INFO nova.compute.manager [None req-bb6fed24-2683-4a83-aa16-0c94d5ab7d0d tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Took 0.97 seconds to destroy the instance on the hypervisor.
Dec 06 12:53:13 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-bb6fed24-2683-4a83-aa16-0c94d5ab7d0d tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:53:13 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:53:13 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: db837c7a-c52d-469b-abf7-cea107454c60] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:53:13 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:53:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:14 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:53:14 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Took 1.02 seconds to deallocate network for instance.
Dec 06 12:53:14 user nova-compute[75247]: DEBUG nova.compute.manager [req-6b86e891-2b03-416a-8b99-a6883ac84b6a req-582bc9be-994a-4a25-985f-f8a263cc10d5 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received event network-vif-deleted-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:53:14 user nova-compute[75247]: INFO nova.compute.manager [req-6b86e891-2b03-416a-8b99-a6883ac84b6a req-582bc9be-994a-4a25-985f-f8a263cc10d5 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Neutron deleted interface 861bfd56-2888-46b4-b583-08526d05bcd6; detaching it from the instance and deleting it from the info cache
Dec 06 12:53:14 user nova-compute[75247]: DEBUG nova.network.neutron [req-6b86e891-2b03-416a-8b99-a6883ac84b6a req-582bc9be-994a-4a25-985f-f8a263cc10d5 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:53:14 user nova-compute[75247]: DEBUG nova.compute.manager [req-6b86e891-2b03-416a-8b99-a6883ac84b6a req-582bc9be-994a-4a25-985f-f8a263cc10d5 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Detach interface failed, port_id=861bfd56-2888-46b4-b583-08526d05bcd6, reason: Instance db837c7a-c52d-469b-abf7-cea107454c60 could not be found. {{(pid=75247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 12:53:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bb6fed24-2683-4a83-aa16-0c94d5ab7d0d tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bb6fed24-2683-4a83-aa16-0c94d5ab7d0d tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:15 user nova-compute[75247]: DEBUG nova.compute.manager [req-61417dc2-2596-43d3-abbc-bb3361e524b3 req-2f8a33fd-7fdd-456a-955e-b6dd3dc9de37 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received event network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:53:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-61417dc2-2596-43d3-abbc-bb3361e524b3 req-2f8a33fd-7fdd-456a-955e-b6dd3dc9de37 service nova] Acquiring lock "db837c7a-c52d-469b-abf7-cea107454c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-61417dc2-2596-43d3-abbc-bb3361e524b3 req-2f8a33fd-7fdd-456a-955e-b6dd3dc9de37 service nova] Lock "db837c7a-c52d-469b-abf7-cea107454c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-61417dc2-2596-43d3-abbc-bb3361e524b3 req-2f8a33fd-7fdd-456a-955e-b6dd3dc9de37 service nova] Lock "db837c7a-c52d-469b-abf7-cea107454c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:15 user nova-compute[75247]: DEBUG nova.compute.manager [req-61417dc2-2596-43d3-abbc-bb3361e524b3 req-2f8a33fd-7fdd-456a-955e-b6dd3dc9de37 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] No waiting events found dispatching network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:53:15 user nova-compute[75247]: WARNING nova.compute.manager [req-61417dc2-2596-43d3-abbc-bb3361e524b3 req-2f8a33fd-7fdd-456a-955e-b6dd3dc9de37 service nova] [instance: db837c7a-c52d-469b-abf7-cea107454c60] Received unexpected event network-vif-plugged-861bfd56-2888-46b4-b583-08526d05bcd6 for instance with vm_state deleted and task_state None.
Dec 06 12:53:15 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-bb6fed24-2683-4a83-aa16-0c94d5ab7d0d tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:53:15 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-bb6fed24-2683-4a83-aa16-0c94d5ab7d0d tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:53:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bb6fed24-2683-4a83-aa16-0c94d5ab7d0d tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.504s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:15 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-bb6fed24-2683-4a83-aa16-0c94d5ab7d0d tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Deleted allocations for instance db837c7a-c52d-469b-abf7-cea107454c60
Dec 06 12:53:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bb6fed24-2683-4a83-aa16-0c94d5ab7d0d tempest-ServerStableDeviceRescueTest-374729134 tempest-ServerStableDeviceRescueTest-374729134-project-member] Lock "db837c7a-c52d-469b-abf7-cea107454c60" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.758s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:15 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:53:15 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 12:53:15 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 12:53:16 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Skipping network cache update for instance because it is being deleted. {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Dec 06 12:53:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-70c4664e-ae7a-47de-bba7-18300391d209" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:53:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-70c4664e-ae7a-47de-bba7-18300391d209" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:53:16 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 12:53:16 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lazy-loading 'info_cache' on Instance uuid 70c4664e-ae7a-47de-bba7-18300391d209 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:53:16 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Updating instance_info_cache with network_info: [{"id": "4f46192c-414a-4af4-b5de-5bd99d31d1fe", "address": "fa:16:3e:b5:83:aa", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f46192c-41", "ovs_interfaceid": "4f46192c-414a-4af4-b5de-5bd99d31d1fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:53:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-70c4664e-ae7a-47de-bba7-18300391d209" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:53:16 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 12:53:17 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:53:17 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:53:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:17 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:18 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 56f7d945-3eae-4dbe-928e-389620e62353 is timed out.
Dec 06 12:53:18 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Successfully detached device vdb from instance 56f7d945-3eae-4dbe-928e-389620e62353 from the live domain config.
Dec 06 12:53:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQzXhTyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:53:18 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:53:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[68601540-0c1b-43fe-a2ab-bb239fbb6e0f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:53:18 user nova-compute[75247]: No targets found.
Dec 06 12:53:18 user nova-compute[75247]: iSNS:
Dec 06 12:53:18 user nova-compute[75247]: No targets found.
Dec 06 12:53:18 user nova-compute[75247]: STATIC:
Dec 06 12:53:18 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd
Dec 06 12:53:18 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:53:18 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:53:18 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:53:18 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:53:18 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:53:18 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33
Dec 06 12:53:18 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:53:18 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:53:18 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31
Dec 06 12:53:18 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:53:18 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:53:18 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0
Dec 06 12:53:18 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:53:18 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:53:18 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034
Dec 06 12:53:18 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:53:18 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:53:18 user nova-compute[75247]: FIRMWARE:
Dec 06 12:53:18 user nova-compute[75247]: No targets found.
Dec 06 12:53:18 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:53:18 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:53:18 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ea90d0-242b-47e4-9238-91d7417e0620]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dfc782-0c6c-4eec-aa44-3108daf2d521]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:53:18 user nova-compute[75247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)
Dec 06 12:53:18 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:53:18 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:53:18 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:53:18 user nova-compute[75247]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 (non-flash)
Dec 06 12:53:18 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:53:18 user nova-compute[75247]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 (non-flash)
Dec 06 12:53:18 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:53:18 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:53:18 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:53:18 user nova-compute[75247]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 (non-flash)
Dec 06 12:53:18 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c611bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0'): ({'sdc'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Removing single pathed devices sdc {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e337e13-e9b7-4821-bae4-30c9e2d7b492]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e44e906-e299-4e3a-b647-e77245cacbb5]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Flushing IO for device /dev/sdc {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[28af12ea-9f1f-439c-b774-7cdb105c42ff]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0971b519-413a-4ec0-8826-55ae7c256b6b]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] SCSI volumes sdc have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[db21e42f-a0ef-4a0d-95bd-61e05de88eb9]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d04f36b-feb6-4fe9-8648-5ec51a6b7f7b]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0, portal: 172.16.0.220,3260]
Dec 06 12:53:18 user nova-compute[75247]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0, portal: 172.16.0.220,3260] successful.
Dec 06 12:53:18 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[084a31a8-2136-4ada-a0ca-9332e5d8c881]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] <== disconnect_volume: return (418ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/504791a2-9892-4721-856a-e0b77a395d01/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/504791a2-9892-4721-856a-e0b77a395d01/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/504791a2-9892-4721-856a-e0b77a395d01/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/504791a2-9892-4721-856a-e0b77a395d01/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:19 user nova-compute[75247]: DEBUG nova.objects.instance [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lazy-loading 'flavor' on Instance uuid 56f7d945-3eae-4dbe-928e-389620e62353 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:53:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-91d91f57-6247-4f1e-81a8-0b5d2e6aa321 tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "56f7d945-3eae-4dbe-928e-389620e62353" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.998s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "56f7d945-3eae-4dbe-928e-389620e62353" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.831s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "56f7d945-3eae-4dbe-928e-389620e62353-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "56f7d945-3eae-4dbe-928e-389620e62353-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "56f7d945-3eae-4dbe-928e-389620e62353-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:19 user nova-compute[75247]: INFO nova.compute.manager [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Terminating instance
Dec 06 12:53:19 user nova-compute[75247]: DEBUG nova.compute.manager [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:53:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:19 user nova-compute[75247]: DEBUG nova.compute.manager [req-1699f6d4-0b7b-4868-b4fd-4e223b7bd0b3 req-0a65a2e9-4008-44ec-a4e4-5f2ec386a8fd service nova] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Received event network-vif-unplugged-e534a6f8-8e4b-4932-a4fc-bb5457532884 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:53:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1699f6d4-0b7b-4868-b4fd-4e223b7bd0b3 req-0a65a2e9-4008-44ec-a4e4-5f2ec386a8fd service nova] Acquiring lock "56f7d945-3eae-4dbe-928e-389620e62353-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1699f6d4-0b7b-4868-b4fd-4e223b7bd0b3 req-0a65a2e9-4008-44ec-a4e4-5f2ec386a8fd service nova] Lock "56f7d945-3eae-4dbe-928e-389620e62353-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1699f6d4-0b7b-4868-b4fd-4e223b7bd0b3 req-0a65a2e9-4008-44ec-a4e4-5f2ec386a8fd service nova] Lock "56f7d945-3eae-4dbe-928e-389620e62353-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:19 user nova-compute[75247]: DEBUG nova.compute.manager [req-1699f6d4-0b7b-4868-b4fd-4e223b7bd0b3 req-0a65a2e9-4008-44ec-a4e4-5f2ec386a8fd service nova] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] No waiting events found dispatching network-vif-unplugged-e534a6f8-8e4b-4932-a4fc-bb5457532884 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:53:19 user nova-compute[75247]: DEBUG nova.compute.manager [req-1699f6d4-0b7b-4868-b4fd-4e223b7bd0b3 req-0a65a2e9-4008-44ec-a4e4-5f2ec386a8fd service nova] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Received event network-vif-unplugged-e534a6f8-8e4b-4932-a4fc-bb5457532884 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:20 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Instance destroyed successfully.
Dec 06 12:53:20 user nova-compute[75247]: DEBUG nova.objects.instance [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lazy-loading 'resources' on Instance uuid 56f7d945-3eae-4dbe-928e-389620e62353 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1851817514',display_name='tempest-VolumesSnapshotTestJSON-instance-1851817514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1851817514',id=27,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlaEQxmoA0L3aug9ccwc8KvY1t5swd1/gga557TcuwVpi+fT39pH/iAcfPvKjxl1HrLLZIn3Fk52w5DM6VLesOF2XN44zjUuPV0J4b6XeOweVgN7ZDlDjp+xCISQTVhjg==',key_name='tempest-keypair-261496105',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:50:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b58ba64f48e946098b72d7061d354ef3',ramdisk_id='',reservation_id='r-6t0bo18j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1940428801',owner_user_name='tempest-VolumesSnapshotTestJSON-1940428801-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:50:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35d1ce8c369941aab5effd18633a73b0',uuid=56f7d945-3eae-4dbe-928e-389620e62353,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e534a6f8-8e4b-4932-a4fc-bb5457532884", "address": "fa:16:3e:db:01:9e", "network": {"id": "24492570-dfe5-49d1-944e-7435cc85d347", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145359804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58ba64f48e946098b72d7061d354ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape534a6f8-8e", "ovs_interfaceid": "e534a6f8-8e4b-4932-a4fc-bb5457532884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Converting VIF {"id": "e534a6f8-8e4b-4932-a4fc-bb5457532884", "address": "fa:16:3e:db:01:9e", "network": {"id": "24492570-dfe5-49d1-944e-7435cc85d347", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145359804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58ba64f48e946098b72d7061d354ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape534a6f8-8e", "ovs_interfaceid": "e534a6f8-8e4b-4932-a4fc-bb5457532884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:01:9e,bridge_name='br-int',has_traffic_filtering=True,id=e534a6f8-8e4b-4932-a4fc-bb5457532884,network=Network(24492570-dfe5-49d1-944e-7435cc85d347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape534a6f8-8e') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG os_vif [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:01:9e,bridge_name='br-int',has_traffic_filtering=True,id=e534a6f8-8e4b-4932-a4fc-bb5457532884,network=Network(24492570-dfe5-49d1-944e-7435cc85d347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape534a6f8-8e') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape534a6f8-8e, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44878fb3-e538-4f79-abca-1a60655b1dbd) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:20 user nova-compute[75247]: INFO os_vif [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:01:9e,bridge_name='br-int',has_traffic_filtering=True,id=e534a6f8-8e4b-4932-a4fc-bb5457532884,network=Network(24492570-dfe5-49d1-944e-7435cc85d347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape534a6f8-8e')
Dec 06 12:53:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQzXhTyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:53:20 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:53:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34a669c-0f05-429b-ae42-e6e7a406e36c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:53:20 user nova-compute[75247]: No targets found.
Dec 06 12:53:20 user nova-compute[75247]: iSNS:
Dec 06 12:53:20 user nova-compute[75247]: No targets found.
Dec 06 12:53:20 user nova-compute[75247]: STATIC:
Dec 06 12:53:20 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd
Dec 06 12:53:20 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:53:20 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:53:20 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:53:20 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:53:20 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:53:20 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33
Dec 06 12:53:20 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:53:20 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:53:20 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31
Dec 06 12:53:20 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:53:20 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:53:20 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034
Dec 06 12:53:20 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:53:20 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:53:20 user nova-compute[75247]: FIRMWARE:
Dec 06 12:53:20 user nova-compute[75247]: No targets found.
Dec 06 12:53:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:53:20 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:53:20 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4b00d03-3331-4acd-aea3-9643c7e9d4c0', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66b895b-5856-4d91-ac83-ce8c7078362a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b52580d-4f35-496c-9ea7-49c22dbf1e3c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:53:20 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:53:20 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:53:20 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:53:20 user nova-compute[75247]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 (non-flash)
Dec 06 12:53:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:53:20 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:53:20 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:53:20 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:53:20 user nova-compute[75247]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 (non-flash)
Dec 06 12:53:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c644430>, {}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Disconnecting from: [] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] <== disconnect_volume: return (85ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:53:20 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Deleting instance files /opt/stack/data/nova/instances/56f7d945-3eae-4dbe-928e-389620e62353_del
Dec 06 12:53:20 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Deletion of /opt/stack/data/nova/instances/56f7d945-3eae-4dbe-928e-389620e62353_del complete
Dec 06 12:53:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7f8114-2e5d-4bf6-bb31-b00666f0d901/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:20 user nova-compute[75247]: INFO nova.compute.manager [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Took 1.07 seconds to destroy the instance on the hypervisor.
Dec 06 12:53:20 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7f8114-2e5d-4bf6-bb31-b00666f0d901/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7f8114-2e5d-4bf6-bb31-b00666f0d901/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7f8114-2e5d-4bf6-bb31-b00666f0d901/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:21 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Error from libvirt while getting description of instance-0000001b: [Error Code 42] Domain not found: no domain with matching uuid '56f7d945-3eae-4dbe-928e-389620e62353' (instance-0000001b): libvirt.libvirtError: Domain not found: no domain with matching uuid '56f7d945-3eae-4dbe-928e-389620e62353' (instance-0000001b)
Dec 06 12:53:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:53:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:53:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:53:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-6240175e-bf7f-47c3-b92f-4854be1b2ceb req-d8783c41-d117-4f1a-bc46-afa9de7df775 service nova] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Received event network-vif-plugged-e534a6f8-8e4b-4932-a4fc-bb5457532884 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6240175e-bf7f-47c3-b92f-4854be1b2ceb req-d8783c41-d117-4f1a-bc46-afa9de7df775 service nova] Acquiring lock "56f7d945-3eae-4dbe-928e-389620e62353-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6240175e-bf7f-47c3-b92f-4854be1b2ceb req-d8783c41-d117-4f1a-bc46-afa9de7df775 service nova] Lock "56f7d945-3eae-4dbe-928e-389620e62353-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6240175e-bf7f-47c3-b92f-4854be1b2ceb req-d8783c41-d117-4f1a-bc46-afa9de7df775 service nova] Lock "56f7d945-3eae-4dbe-928e-389620e62353-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-6240175e-bf7f-47c3-b92f-4854be1b2ceb req-d8783c41-d117-4f1a-bc46-afa9de7df775 service nova] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] No waiting events found dispatching network-vif-plugged-e534a6f8-8e4b-4932-a4fc-bb5457532884 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:53:22 user nova-compute[75247]: WARNING nova.compute.manager [req-6240175e-bf7f-47c3-b92f-4854be1b2ceb req-d8783c41-d117-4f1a-bc46-afa9de7df775 service nova] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Received unexpected event network-vif-plugged-e534a6f8-8e4b-4932-a4fc-bb5457532884 for instance with vm_state active and task_state deleting.
Dec 06 12:53:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-6240175e-bf7f-47c3-b92f-4854be1b2ceb req-d8783c41-d117-4f1a-bc46-afa9de7df775 service nova] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Received event network-vif-deleted-e534a6f8-8e4b-4932-a4fc-bb5457532884 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:53:22 user nova-compute[75247]: INFO nova.compute.manager [req-6240175e-bf7f-47c3-b92f-4854be1b2ceb req-d8783c41-d117-4f1a-bc46-afa9de7df775 service nova] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Neutron deleted interface e534a6f8-8e4b-4932-a4fc-bb5457532884; detaching it from the instance and deleting it from the info cache
Dec 06 12:53:22 user nova-compute[75247]: DEBUG nova.network.neutron [req-6240175e-bf7f-47c3-b92f-4854be1b2ceb req-d8783c41-d117-4f1a-bc46-afa9de7df775 service nova] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:53:22 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:53:22 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:53:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=7312MB free_disk=24.997196197509766GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:22 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Took 1.67 seconds to deallocate network for instance.
Dec 06 12:53:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-6240175e-bf7f-47c3-b92f-4854be1b2ceb req-d8783c41-d117-4f1a-bc46-afa9de7df775 service nova] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Detach interface failed, port_id=e534a6f8-8e4b-4932-a4fc-bb5457532884, reason: Instance 56f7d945-3eae-4dbe-928e-389620e62353 could not be found. {{(pid=75247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 12:53:22 user nova-compute[75247]: WARNING nova.volume.cinder [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Attachment 7ee97b1e-238e-4afd-8dee-f7297ffcedf4 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7ee97b1e-238e-4afd-8dee-f7297ffcedf4. (HTTP 404) (Request-ID: req-6534468f-1ad2-46c6-80f3-115309dda377)
Dec 06 12:53:22 user nova-compute[75247]: INFO nova.compute.manager [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] [instance: 56f7d945-3eae-4dbe-928e-389620e62353] Took 0.03 seconds to detach 1 volumes for instance.
Dec 06 12:53:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 70c4664e-ae7a-47de-bba7-18300391d209 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 782289e2-91cd-4aee-9a08-eadfb2a5965b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 3e1b5197-dc38-48a5-b9f9-e053be499433 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance bc3ddb40-b05f-4170-b269-d44dec6ecdaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 530cfb75-7aa8-4e57-b282-8f7a21401b34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 56f7d945-3eae-4dbe-928e-389620e62353 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 92d215fd-8411-430c-b91e-b6e62e02a994 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 504791a2-9892-4721-856a-e0b77a395d01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 0e7f8114-2e5d-4bf6-bb31-b00666f0d901 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 6d767ae1-4df2-4e87-b991-729fabd467f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance b3720cc0-ff80-4ca2-8b13-d83dded593ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LkiFXwZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:53:22 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:53:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:53:22 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:53:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:53:22 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:53:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b2c9d6-ffe5-40f4-9958-60bb2c103bdc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:53:22 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d11f0a0-e9c0-478b-ac92-e2f58fac908a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c] added
Dec 06 12:53:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd939e4-cf21-441b-9b03-6573958f9eb6]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6fcb61-f1df-4324-9273-bfd1de264376]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LkiFXwZC {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.657s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.557s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LkiFXwZC" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[25628a66-8f4f-4119-9f20-612cb8026aab]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LkiFXwZC'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09cd139-7d83-4363-8d52-98dd0d40a150]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bf0ff3-b7a1-4e16-8312-f58f46b032fc]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:53:23 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:53:23 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:53:23 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:53:23 user nova-compute[75247]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 (non-flash)
Dec 06 12:53:23 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:53:23 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:53:23 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:53:23 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:53:23 user nova-compute[75247]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 (non-flash)
Dec 06 12:53:23 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dfe168-9d8a-4416-b5a8-6dc24a906eaa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c, portal: 172.16.0.220,3260]
Dec 06 12:53:23 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c, portal: 172.16.0.220,3260] successful.
Dec 06 12:53:23 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b14e4b-887f-4ad0-b101-5d8c70358bd3]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef32a1d-d028-454d-8177-b55a636260ff]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:53:23 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:53:23 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:53:23 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:53:23 user nova-compute[75247]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 (non-flash)
Dec 06 12:53:23 user nova-compute[75247]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c (non-flash)
Dec 06 12:53:23 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:53:23 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:53:23 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:53:23 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:53:23 user nova-compute[75247]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 (non-flash)
Dec 06 12:53:23 user nova-compute[75247]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c (non-flash)
Dec 06 12:53:23 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6706be82-32a8-415e-91b7-9b21bf01d629]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LkiFXwZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:23 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Deleted allocations for instance 56f7d945-3eae-4dbe-928e-389620e62353
Dec 06 12:53:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8a18d4c5-7548-4303-a011-da4a71617f4f tempest-VolumesSnapshotTestJSON-1940428801 tempest-VolumesSnapshotTestJSON-1940428801-project-member] Lock "56f7d945-3eae-4dbe-928e-389620e62353" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.949s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:24 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:53:24 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23739663134396230', 'path': '/dev/sdc'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:53:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739663134396230', 'path': '/dev/sdc'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:53:24 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'flavor' on Instance uuid 0e7f8114-2e5d-4bf6-bb31-b00666f0d901 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:53:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 12:53:24 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:53:24 user nova-compute[75247]:   <source dev="/dev/sdc"/>
Dec 06 12:53:24 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:53:24 user nova-compute[75247]:   <serial>a63b8f38-a8df-4057-989f-91a441657c1c</serial>
Dec 06 12:53:24 user nova-compute[75247]: </disk>
Dec 06 12:53:24 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 12:53:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:53:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:53:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] No VIF found with MAC fa:16:3e:67:2a:53, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:53:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4a13854-e7c5-4c47-ae9f-32bc39f415a7 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.231s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG nova.objects.instance [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'flavor' on Instance uuid 0e7f8114-2e5d-4bf6-bb31-b00666f0d901 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:28 user nova-compute[75247]: INFO nova.compute.manager [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Attaching volume e2e60d9f-2968-4c23-85e4-3c59d1d206e6 to /dev/vdc
Dec 06 12:53:28 user nova-compute[75247]: DEBUG os_brick.utils [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[96df0c62-537f-477d-82be-d29fc9be7057]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9e501f-1b81-4fff-9bda-60dffb63f673]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[581b502a-e9b5-4338-9fd8-edfdbfd9358c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e2c75e-a238-430d-bcd0-bf8ed324c0d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:53:28 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:53:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b961d31-81a2-490a-b3f3-a04b6374c291]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG os_brick.utils [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:53:28 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Updating existing volume attachment record: 51e47be2-c7b3-4792-94d7-0b8ba9046719 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:29 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 504791a2-9892-4721-856a-e0b77a395d01 is timed out.
Dec 06 12:53:29 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Successfully detached device vdb from instance 504791a2-9892-4721-856a-e0b77a395d01 from the live domain config.
Dec 06 12:53:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xmiMYVRK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:53:29 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:53:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e853c8f-6f80-4fd0-b523-8db48f3e94a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:53:29 user nova-compute[75247]: No targets found.
Dec 06 12:53:29 user nova-compute[75247]: iSNS:
Dec 06 12:53:29 user nova-compute[75247]: No targets found.
Dec 06 12:53:29 user nova-compute[75247]: STATIC:
Dec 06 12:53:29 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd
Dec 06 12:53:29 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:53:29 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:53:29 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:53:29 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:53:29 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:53:29 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33
Dec 06 12:53:29 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:53:29 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:53:29 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31
Dec 06 12:53:29 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:53:29 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:53:29 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034
Dec 06 12:53:29 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:53:29 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:53:29 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c
Dec 06 12:53:29 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:53:29 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:53:29 user nova-compute[75247]: FIRMWARE:
Dec 06 12:53:29 user nova-compute[75247]: No targets found.
Dec 06 12:53:29 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:53:29 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:53:29 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c493ab6-3135-4411-86a3-f411fa438e4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea466c27-505c-4980-a114-88b30b290da9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:53:29 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:53:29 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:53:29 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:53:29 user nova-compute[75247]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 (non-flash)
Dec 06 12:53:29 user nova-compute[75247]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c (non-flash)
Dec 06 12:53:29 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:53:29 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:53:29 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:53:29 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:53:29 user nova-compute[75247]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 (non-flash)
Dec 06 12:53:29 user nova-compute[75247]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c (non-flash)
Dec 06 12:53:29 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd73060dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034'): ({'sdg'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Removing single pathed devices sdg {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[618a6afc-b596-40a5-8c2c-c6ebbb67615b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bf3ffe-1337-4988-901a-5bed8dabf8f0]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Flushing IO for device /dev/sdg {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[36643489-ea89-4437-9801-436a4ce9d4e1]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[08820a1f-c829-4966-9323-b72a49c39b94]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] SCSI volumes sdg have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7464d1ac-c911-402e-8ab4-5e09fa1b44d6]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[354fbb62-ea8f-44b7-bcb5-6acf5b6aa5be]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034, portal: 172.16.0.220,3260]
Dec 06 12:53:29 user nova-compute[75247]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034, portal: 172.16.0.220,3260] successful.
Dec 06 12:53:29 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f637e7a5-35e1-4f16-aa0c-327428b35034 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e940e8-413b-4e38-b4b8-cc8e794713cf]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] <== disconnect_volume: return (351ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:53:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:53:30 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lazy-loading 'flavor' on Instance uuid 504791a2-9892-4721-856a-e0b77a395d01 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:53:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c161a839-6840-4345-8071-a867d8a85fd6 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "504791a2-9892-4721-856a-e0b77a395d01" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.193s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:36 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:38 user nova-compute[75247]: INFO nova.compute.manager [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Rescuing
Dec 06 12:53:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "refresh_cache-6d767ae1-4df2-4e87-b991-729fabd467f8" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:53:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquired lock "refresh_cache-6d767ae1-4df2-4e87-b991-729fabd467f8" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:53:38 user nova-compute[75247]: DEBUG nova.network.neutron [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:53:38 user nova-compute[75247]: DEBUG nova.network.neutron [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Updating instance_info_cache with network_info: [{"id": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "address": "fa:16:3e:73:5b:1b", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f9635e-3e", "ovs_interfaceid": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:53:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Releasing lock "refresh_cache-6d767ae1-4df2-4e87-b991-729fabd467f8" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG nova.compute.manager [req-d771dc63-cb50-43e7-bb45-d37459fb2af9 req-acd79ec7-fefc-4925-9b52-17bebc3d815c service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Received event network-vif-unplugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d771dc63-cb50-43e7-bb45-d37459fb2af9 req-acd79ec7-fefc-4925-9b52-17bebc3d815c service nova] Acquiring lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d771dc63-cb50-43e7-bb45-d37459fb2af9 req-acd79ec7-fefc-4925-9b52-17bebc3d815c service nova] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d771dc63-cb50-43e7-bb45-d37459fb2af9 req-acd79ec7-fefc-4925-9b52-17bebc3d815c service nova] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG nova.compute.manager [req-d771dc63-cb50-43e7-bb45-d37459fb2af9 req-acd79ec7-fefc-4925-9b52-17bebc3d815c service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] No waiting events found dispatching network-vif-unplugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:53:39 user nova-compute[75247]: WARNING nova.compute.manager [req-d771dc63-cb50-43e7-bb45-d37459fb2af9 req-acd79ec7-fefc-4925-9b52-17bebc3d815c service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Received unexpected event network-vif-unplugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 for instance with vm_state active and task_state rescuing.
Dec 06 12:53:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RiLetyHw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:53:39 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:53:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:53:39 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:53:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:53:39 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa047f5-2d63-4569-ba8d-985fa508961b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:53:39 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[961564d8-6ab7-48ea-8875-0ef120c11da9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6] added
Dec 06 12:53:39 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d401d62-bfe2-48a3-9136-077c788c77f4]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefb8d3f-0971-4838-8844-eccb867d4b45]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RiLetyHw {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RiLetyHw" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[58766954-8cf2-40c3-bc08-fdf369b5a970]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RiLetyHw'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7d294b-a683-4a23-aac0-80551710b0e8]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f5d19d-466e-4ac3-97f9-860348fa8bdb]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:53:39 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:53:39 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:53:39 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:53:39 user nova-compute[75247]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c (non-flash)
Dec 06 12:53:39 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:53:39 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:53:39 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:53:39 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:53:39 user nova-compute[75247]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c (non-flash)
Dec 06 12:53:39 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7ee759-73fd-4d2e-9d7e-89a733bf4e68]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6, portal: 172.16.0.220,3260]
Dec 06 12:53:39 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6, portal: 172.16.0.220,3260] successful.
Dec 06 12:53:39 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff4f386-ae08-4ecb-ab8a-ae175cecad13]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[33433a6a-cf2a-4064-99a5-a37b02112b96]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:53:39 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:53:39 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:53:39 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:53:39 user nova-compute[75247]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c (non-flash)
Dec 06 12:53:39 user nova-compute[75247]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 (non-flash)
Dec 06 12:53:39 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:53:39 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:53:39 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:53:39 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:53:39 user nova-compute[75247]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c (non-flash)
Dec 06 12:53:39 user nova-compute[75247]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 (non-flash)
Dec 06 12:53:39 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] HCTL ('38', '-', '-', 0) found on session 39 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[89be6fa6-9107-4a12-a679-585372c6cb90]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Searching for a device in session 39 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RiLetyHw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:53:39 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Instance destroyed successfully.
Dec 06 12:53:39 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Attempting a stable device rescue
Dec 06 12:53:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75247) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Instance directory exists: not creating {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 06 12:53:39 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Creating image(s)
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "/opt/stack/data/nova/instances/6d767ae1-4df2-4e87-b991-729fabd467f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "/opt/stack/data/nova/instances/6d767ae1-4df2-4e87-b991-729fabd467f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "/opt/stack/data/nova/instances/6d767ae1-4df2-4e87-b991-729fabd467f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG nova.objects.instance [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6d767ae1-4df2-4e87-b991-729fabd467f8 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "85498f59af7f998ff24c965b648b4eeb513cfda5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "85498f59af7f998ff24c965b648b4eeb513cfda5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85498f59af7f998ff24c965b648b4eeb513cfda5.part --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.786s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:53:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] <== connect_volume: return (1789ms) {'type': 'block', 'scsi_wwn': '23234303731363234', 'path': '/dev/sdg'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:53:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234303731363234', 'path': '/dev/sdg'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:53:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:41 user nova-compute[75247]: DEBUG nova.objects.instance [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'flavor' on Instance uuid 0e7f8114-2e5d-4bf6-bb31-b00666f0d901 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:53:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 12:53:41 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:53:41 user nova-compute[75247]:   <source dev="/dev/sdg"/>
Dec 06 12:53:41 user nova-compute[75247]:   <target dev="vdc" bus="virtio"/>
Dec 06 12:53:41 user nova-compute[75247]:   <serial>e2e60d9f-2968-4c23-85e4-3c59d1d206e6</serial>
Dec 06 12:53:41 user nova-compute[75247]: </disk>
Dec 06 12:53:41 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 12:53:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85498f59af7f998ff24c965b648b4eeb513cfda5.part --force-share --output=json" returned: 0 in 0.179s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:41 user nova-compute[75247]: DEBUG nova.virt.images [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] 1f7ee737-b8a8-4362-9535-efb325d0558b was qcow2, converting to raw {{(pid=75247) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 12:53:41 user nova-compute[75247]: DEBUG nova.privsep.utils [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 12:53:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/85498f59af7f998ff24c965b648b4eeb513cfda5.part /opt/stack/data/nova/instances/_base/85498f59af7f998ff24c965b648b4eeb513cfda5.converted {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:41 user nova-compute[75247]: DEBUG nova.compute.manager [req-02f9782b-6cf7-41c1-9009-46ac572fb5c3 req-62b6394d-5506-4879-b3c6-377fe991e2b9 service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Received event network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:53:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-02f9782b-6cf7-41c1-9009-46ac572fb5c3 req-62b6394d-5506-4879-b3c6-377fe991e2b9 service nova] Acquiring lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-02f9782b-6cf7-41c1-9009-46ac572fb5c3 req-62b6394d-5506-4879-b3c6-377fe991e2b9 service nova] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-02f9782b-6cf7-41c1-9009-46ac572fb5c3 req-62b6394d-5506-4879-b3c6-377fe991e2b9 service nova] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:41 user nova-compute[75247]: DEBUG nova.compute.manager [req-02f9782b-6cf7-41c1-9009-46ac572fb5c3 req-62b6394d-5506-4879-b3c6-377fe991e2b9 service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] No waiting events found dispatching network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:53:41 user nova-compute[75247]: WARNING nova.compute.manager [req-02f9782b-6cf7-41c1-9009-46ac572fb5c3 req-62b6394d-5506-4879-b3c6-377fe991e2b9 service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Received unexpected event network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 for instance with vm_state active and task_state rescuing.
Dec 06 12:53:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:53:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:53:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:53:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] No VIF found with MAC fa:16:3e:67:2a:53, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:53:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/85498f59af7f998ff24c965b648b4eeb513cfda5.part /opt/stack/data/nova/instances/_base/85498f59af7f998ff24c965b648b4eeb513cfda5.converted" returned: 0 in 0.463s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85498f59af7f998ff24c965b648b4eeb513cfda5.converted --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6573d42f-4102-488a-9a08-b9d0746013e3 tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.259s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85498f59af7f998ff24c965b648b4eeb513cfda5.converted --force-share --output=json" returned: 0 in 0.195s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "85498f59af7f998ff24c965b648b4eeb513cfda5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.115s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "85498f59af7f998ff24c965b648b4eeb513cfda5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "85498f59af7f998ff24c965b648b4eeb513cfda5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85498f59af7f998ff24c965b648b4eeb513cfda5 --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85498f59af7f998ff24c965b648b4eeb513cfda5 --force-share --output=json" returned: 0 in 0.193s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/85498f59af7f998ff24c965b648b4eeb513cfda5,backing_fmt=raw /opt/stack/data/nova/instances/6d767ae1-4df2-4e87-b991-729fabd467f8/disk.rescue {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/85498f59af7f998ff24c965b648b4eeb513cfda5,backing_fmt=raw /opt/stack/data/nova/instances/6d767ae1-4df2-4e87-b991-729fabd467f8/disk.rescue" returned: 0 in 0.057s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "85498f59af7f998ff24c965b648b4eeb513cfda5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.objects.instance [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lazy-loading 'migration_context' on Instance uuid 6d767ae1-4df2-4e87-b991-729fabd467f8 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.objects.base [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Object Instance<6d767ae1-4df2-4e87-b991-729fabd467f8> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Start _get_guest_xml network_info=[{"id": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "address": "fa:16:3e:73:5b:1b", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "vif_mac": "fa:16:3e:73:5b:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f9635e-3e", "ovs_interfaceid": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1f7ee737-b8a8-4362-9535-efb325d0558b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'b3e518e4-c16c-4a1c-a5b3-d6a787524d60', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcQpUNhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '6d767ae1-4df2-4e87-b991-729fabd467f8', 'attached_at': '', 'detached_at': '', 'volume_id': '5d5e4e7c-239f-4371-b595-68e70bd0cd33', 'serial': '5d5e4e7c-239f-4371-b595-68e70bd0cd33'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.objects.instance [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lazy-loading 'resources' on Instance uuid 6d767ae1-4df2-4e87-b991-729fabd467f8 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.objects.base [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Object Instance<6d767ae1-4df2-4e87-b991-729fabd467f8> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.objects.instance [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lazy-loading 'numa_topology' on Instance uuid 6d767ae1-4df2-4e87-b991-729fabd467f8 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.objects.base [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Object Instance<6d767ae1-4df2-4e87-b991-729fabd467f8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:53:42 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:53:42 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.objects.instance [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6d767ae1-4df2-4e87-b991-729fabd467f8 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.objects.base [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Object Instance<6d767ae1-4df2-4e87-b991-729fabd467f8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcQpUNhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:53:42 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:53:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:53:42 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:53:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:53:42 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ac24b7-e62b-4aa8-bdbe-2b538aecacd6]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = dcQpUNhr\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 06 12:53:42 user nova-compute[75247]: node.name = iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33
Dec 06 12:53:42 user nova-compute[75247]: node.tpgt = -1
Dec 06 12:53:42 user nova-compute[75247]: node.startup = automatic
Dec 06 12:53:42 user nova-compute[75247]: node.leading_login = No
Dec 06 12:53:42 user nova-compute[75247]: iface.iscsi_ifacename = default
Dec 06 12:53:42 user nova-compute[75247]: iface.net_ifacename = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.ipaddress = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.prefix_len = 0
Dec 06 12:53:42 user nova-compute[75247]: iface.hwaddress = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.transport_name = tcp
Dec 06 12:53:42 user nova-compute[75247]: iface.initiatorname = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.state = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.vlan_id = 0
Dec 06 12:53:42 user nova-compute[75247]: iface.vlan_priority = 0
Dec 06 12:53:42 user nova-compute[75247]: iface.vlan_state = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.iface_num = 0
Dec 06 12:53:42 user nova-compute[75247]: iface.mtu = 0
Dec 06 12:53:42 user nova-compute[75247]: iface.port = 0
Dec 06 12:53:42 user nova-compute[75247]: iface.bootproto = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.subnet_mask = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.gateway = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.dhcp_alt_client_id_state = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.dhcp_alt_client_id = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.dhcp_dns = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.dhcp_learn_iqn = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.dhcp_req_vendor_id_state = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.dhcp_vendor_id_state = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.dhcp_vendor_id = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.dhcp_slp_da = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.fragmentation = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.gratuitous_arp = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.incoming_forwarding = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.tos_state = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.tos = 0
Dec 06 12:53:42 user nova-compute[75247]: iface.ttl = 0
Dec 06 12:53:42 user nova-compute[75247]: iface.delayed_ack = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.tcp_nagle = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.tcp_wsf_state = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.tcp_wsf = 0
Dec 06 12:53:42 user nova-compute[75247]: iface.tcp_timer_scale = 0
Dec 06 12:53:42 user nova-compute[75247]: iface.tcp_timestamp = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.redirect = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.def_task_mgmt_timeout = 0
Dec 06 12:53:42 user nova-compute[75247]: iface.header_digest = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.data_digest = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.immediate_data = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.initial_r2t = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.data_seq_inorder = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.data_pdu_inorder = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.erl = 0
Dec 06 12:53:42 user nova-compute[75247]: iface.max_receive_data_len = 0
Dec 06 12:53:42 user nova-compute[75247]: iface.first_burst_len = 0
Dec 06 12:53:42 user nova-compute[75247]: iface.max_outstanding_r2t = 0
Dec 06 12:53:42 user nova-compute[75247]: iface.max_burst_len = 0
Dec 06 12:53:42 user nova-compute[75247]: iface.chap_auth = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.bidi_chap = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.strict_login_compliance = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.discovery_auth = <empty>
Dec 06 12:53:42 user nova-compute[75247]: iface.discovery_logout = <empty>
Dec 06 12:53:42 user nova-compute[75247]: node.discovery_address = <empty>
Dec 06 12:53:42 user nova-compute[75247]: node.discovery_port = 0
Dec 06 12:53:42 user nova-compute[75247]: node.discovery_type = static
Dec 06 12:53:42 user nova-compute[75247]: node.session.initial_cmdsn = 0
Dec 06 12:53:42 user nova-compute[75247]: node.session.initial_login_retry_max = 8
Dec 06 12:53:42 user nova-compute[75247]: node.session.xmit_thread_priority = -20
Dec 06 12:53:42 user nova-compute[75247]: node.session.cmds_max = 128
Dec 06 12:53:42 user nova-compute[75247]: node.session.queue_depth = 32
Dec 06 12:53:42 user nova-compute[75247]: node.session.nr_sessions = 1
Dec 06 12:53:42 user nova-compute[75247]: node.session.auth.authmethod = CHAP
Dec 06 12:53:42 user nova-compute[75247]: node.session.auth.username = dcQpUNhr
Dec 06 12:53:42 user nova-compute[75247]: node.session.auth.password = ***
Dec 06 12:53:42 user nova-compute[75247]: node.session.auth.username_in = <empty>
Dec 06 12:53:42 user nova-compute[75247]: node.session.auth.password_in = <empty>
Dec 06 12:53:42 user nova-compute[75247]: node.session.auth.chap_algs = MD5
Dec 06 12:53:42 user nova-compute[75247]: node.session.timeo.replacement_timeout = 120
Dec 06 12:53:42 user nova-compute[75247]: node.session.err_timeo.abort_timeout = 15
Dec 06 12:53:42 user nova-compute[75247]: node.session.err_timeo.lu_reset_timeout = 30
Dec 06 12:53:42 user nova-compute[75247]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 06 12:53:42 user nova-compute[75247]: node.session.err_timeo.host_reset_timeout = 60
Dec 06 12:53:42 user nova-compute[75247]: node.session.iscsi.FastAbort = Yes
Dec 06 12:53:42 user nova-compute[75247]: node.session.iscsi.InitialR2T = No
Dec 06 12:53:42 user nova-compute[75247]: node.session.iscsi.ImmediateData = Yes
Dec 06 12:53:42 user nova-compute[75247]: node.session.iscsi.FirstBurstLength = 262144
Dec 06 12:53:42 user nova-compute[75247]: node.session.iscsi.MaxBurstLength = 16776192
Dec 06 12:53:42 user nova-compute[75247]: node.session.iscsi.DefaultTime2Retain = 0
Dec 06 12:53:42 user nova-compute[75247]: node.session.iscsi.DefaultTime2Wait = 2
Dec 06 12:53:42 user nova-compute[75247]: node.session.iscsi.MaxConnections = 1
Dec 06 12:53:42 user nova-compute[75247]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 06 12:53:42 user nova-compute[75247]: node.session.iscsi.ERL = 0
Dec 06 12:53:42 user nova-compute[75247]: node.session.scan = manual
Dec 06 12:53:42 user nova-compute[75247]: node.session.reopen_max = 0
Dec 06 12:53:42 user nova-compute[75247]: node.conn[0].address = 172.16.0.220
Dec 06 12:53:42 user nova-compute[75247]: node.conn[0].port = 3260
Dec 06 12:53:42 user nova-compute[75247]: node.conn[0].startup = manual
Dec 06 12:53:42 user nova-compute[75247]: node.conn[0].tcp.window_size = 524288
Dec 06 12:53:42 user nova-compute[75247]: node.conn[0].tcp.type_of_service = 0
Dec 06 12:53:42 user nova-compute[75247]: node.conn[0].timeo.logout_timeout = 15
Dec 06 12:53:42 user nova-compute[75247]: node.conn[0].timeo.login_timeout = 15
Dec 06 12:53:42 user nova-compute[75247]: node.conn[0].timeo.auth_timeout = 45
Dec 06 12:53:42 user nova-compute[75247]: node.conn[0].timeo.noop_out_interval = 5
Dec 06 12:53:42 user nova-compute[75247]: node.conn[0].timeo.noop_out_timeout = 5
Dec 06 12:53:42 user nova-compute[75247]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 06 12:53:42 user nova-compute[75247]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 06 12:53:42 user nova-compute[75247]: node.conn[0].iscsi.HeaderDigest = None
Dec 06 12:53:42 user nova-compute[75247]: node.conn[0].iscsi.DataDigest = None
Dec 06 12:53:42 user nova-compute[75247]: node.conn[0].iscsi.IFMarker = No
Dec 06 12:53:42 user nova-compute[75247]: node.conn[0].iscsi.OFMarker = No
Dec 06 12:53:42 user nova-compute[75247]: # END RECORD
Dec 06 12:53:42 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9564c289-f5b0-4355-8392-8756777df6d1]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4166c862-4208-4715-8f5d-79ed2856d25e]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dcQpUNhr {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dcQpUNhr" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b111e4-2a3c-4763-bd06-651a181bf4f0]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dcQpUNhr'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa95b6e4-8892-4c6a-bde7-a3b04d2752ea]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff95aa7a-3213-4e02-8bed-be3910c7f663]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:53:42 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:53:42 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:53:42 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:53:42 user nova-compute[75247]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c (non-flash)
Dec 06 12:53:42 user nova-compute[75247]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 (non-flash)
Dec 06 12:53:42 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:53:42 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:53:42 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:53:42 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:53:42 user nova-compute[75247]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c (non-flash)
Dec 06 12:53:42 user nova-compute[75247]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 (non-flash)
Dec 06 12:53:42 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.152s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] HCTL ('36', '0', '0', 0) found on session 34 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ce76fb-5586-4f4c-b078-466ca3a746f2]: (4, ('0 0 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Searching for a device in session 34 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcQpUNhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.176s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] <== connect_volume: return (177ms) {'type': 'block', 'scsi_wwn': '23932633965323938', 'path': '/dev/sde'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932633965323938', 'path': '/dev/sde'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1519077913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1519077913',id=31,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:52:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='222da79e3583495d90d5442029996343',ramdisk_id='',reservation_id='r-9fiavbvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:52:27Z,user_data=None,user_id='d0efa55fc4754d96a33d07d52342d8f7',uuid=6d767ae1-4df2-4e87-b991-729fabd467f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "address": "fa:16:3e:73:5b:1b", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "vif_mac": "fa:16:3e:73:5b:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f9635e-3e", "ovs_interfaceid": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converting VIF {"id": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "address": "fa:16:3e:73:5b:1b", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "vif_mac": "fa:16:3e:73:5b:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f9635e-3e", "ovs_interfaceid": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:5b:1b,bridge_name='br-int',has_traffic_filtering=True,id=63f9635e-3eb4-4d2b-b289-e219ade9fb28,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f9635e-3e') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.objects.instance [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d767ae1-4df2-4e87-b991-729fabd467f8 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.objects.base [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Object Instance<6d767ae1-4df2-4e87-b991-729fabd467f8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:53:42 user nova-compute[75247]:   <uuid>6d767ae1-4df2-4e87-b991-729fabd467f8</uuid>
Dec 06 12:53:42 user nova-compute[75247]:   <name>instance-0000001f</name>
Dec 06 12:53:42 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:53:42 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:53:42 user nova-compute[75247]:   <metadata>
Dec 06 12:53:42 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:53:42 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:53:42 user nova-compute[75247]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1519077913</nova:name>
Dec 06 12:53:42 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:53:42</nova:creationTime>
Dec 06 12:53:42 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:53:42 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:53:42 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:53:42 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:53:42 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:53:42 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:53:42 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:53:42 user nova-compute[75247]:       <nova:owner>
Dec 06 12:53:42 user nova-compute[75247]:         <nova:user uuid="d0efa55fc4754d96a33d07d52342d8f7">tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member</nova:user>
Dec 06 12:53:42 user nova-compute[75247]:         <nova:project uuid="222da79e3583495d90d5442029996343">tempest-ServerBootFromVolumeStableRescueTest-1200643969</nova:project>
Dec 06 12:53:42 user nova-compute[75247]:       </nova:owner>
Dec 06 12:53:42 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:53:42 user nova-compute[75247]:       <nova:ports>
Dec 06 12:53:42 user nova-compute[75247]:         <nova:port uuid="63f9635e-3eb4-4d2b-b289-e219ade9fb28">
Dec 06 12:53:42 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 06 12:53:42 user nova-compute[75247]:         </nova:port>
Dec 06 12:53:42 user nova-compute[75247]:       </nova:ports>
Dec 06 12:53:42 user nova-compute[75247]:     </nova:instance>
Dec 06 12:53:42 user nova-compute[75247]:   </metadata>
Dec 06 12:53:42 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:53:42 user nova-compute[75247]:     <system>
Dec 06 12:53:42 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:53:42 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:53:42 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:53:42 user nova-compute[75247]:       <entry name="serial">6d767ae1-4df2-4e87-b991-729fabd467f8</entry>
Dec 06 12:53:42 user nova-compute[75247]:       <entry name="uuid">6d767ae1-4df2-4e87-b991-729fabd467f8</entry>
Dec 06 12:53:42 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:53:42 user nova-compute[75247]:     </system>
Dec 06 12:53:42 user nova-compute[75247]:   </sysinfo>
Dec 06 12:53:42 user nova-compute[75247]:   <os>
Dec 06 12:53:42 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:53:42 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:53:42 user nova-compute[75247]:   </os>
Dec 06 12:53:42 user nova-compute[75247]:   <features>
Dec 06 12:53:42 user nova-compute[75247]:     <acpi/>
Dec 06 12:53:42 user nova-compute[75247]:     <apic/>
Dec 06 12:53:42 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:53:42 user nova-compute[75247]:   </features>
Dec 06 12:53:42 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:53:42 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:53:42 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:53:42 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:53:42 user nova-compute[75247]:   </clock>
Dec 06 12:53:42 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:53:42 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:53:42 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:53:42 user nova-compute[75247]:   </cpu>
Dec 06 12:53:42 user nova-compute[75247]:   <devices>
Dec 06 12:53:42 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 12:53:42 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:53:42 user nova-compute[75247]:       <source dev="/dev/sde"/>
Dec 06 12:53:42 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:53:42 user nova-compute[75247]:       <serial>5d5e4e7c-239f-4371-b595-68e70bd0cd33</serial>
Dec 06 12:53:42 user nova-compute[75247]:     </disk>
Dec 06 12:53:42 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:53:42 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:53:42 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/6d767ae1-4df2-4e87-b991-729fabd467f8/disk.rescue"/>
Dec 06 12:53:42 user nova-compute[75247]:       <target dev="vdb" bus="virtio"/>
Dec 06 12:53:42 user nova-compute[75247]:       <boot order="1"/>
Dec 06 12:53:42 user nova-compute[75247]:     </disk>
Dec 06 12:53:42 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:53:42 user nova-compute[75247]:       <mac address="fa:16:3e:73:5b:1b"/>
Dec 06 12:53:42 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:53:42 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:53:42 user nova-compute[75247]:       <target dev="tap63f9635e-3e"/>
Dec 06 12:53:42 user nova-compute[75247]:     </interface>
Dec 06 12:53:42 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:53:42 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/6d767ae1-4df2-4e87-b991-729fabd467f8/console.log" append="off"/>
Dec 06 12:53:42 user nova-compute[75247]:     </serial>
Dec 06 12:53:42 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:53:42 user nova-compute[75247]:     <video>
Dec 06 12:53:42 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:53:42 user nova-compute[75247]:     </video>
Dec 06 12:53:42 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:53:42 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:53:42 user nova-compute[75247]:     </rng>
Dec 06 12:53:42 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:53:42 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:53:42 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:53:42 user nova-compute[75247]:     </memballoon>
Dec 06 12:53:42 user nova-compute[75247]:   </devices>
Dec 06 12:53:42 user nova-compute[75247]: </domain>
Dec 06 12:53:42 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:53:42 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Instance destroyed successfully.
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:53:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] No VIF found with MAC fa:16:3e:73:5b:1b, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:53:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:43 user nova-compute[75247]: INFO nova.compute.manager [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Detaching volume a63b8f38-a8df-4057-989f-91a441657c1c
Dec 06 12:53:43 user nova-compute[75247]: INFO nova.virt.block_device [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Attempting to driver detach volume a63b8f38-a8df-4057-989f-91a441657c1c from mountpoint /dev/vdb
Dec 06 12:53:43 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Attempting to detach device vdb from instance 0e7f8114-2e5d-4bf6-bb31-b00666f0d901 from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 12:53:43 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:53:43 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:53:43 user nova-compute[75247]:   <source dev="/dev/sdc"/>
Dec 06 12:53:43 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:53:43 user nova-compute[75247]:   <serial>a63b8f38-a8df-4057-989f-91a441657c1c</serial>
Dec 06 12:53:43 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:53:43 user nova-compute[75247]: </disk>
Dec 06 12:53:43 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:53:43 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Successfully detached device vdb from instance 0e7f8114-2e5d-4bf6-bb31-b00666f0d901 from the persistent domain config.
Dec 06 12:53:43 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0e7f8114-2e5d-4bf6-bb31-b00666f0d901 from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 12:53:43 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:53:43 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:53:43 user nova-compute[75247]:   <source dev="/dev/sdc"/>
Dec 06 12:53:43 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:53:43 user nova-compute[75247]:   <serial>a63b8f38-a8df-4057-989f-91a441657c1c</serial>
Dec 06 12:53:43 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:53:43 user nova-compute[75247]: </disk>
Dec 06 12:53:43 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:53:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "f5b69324-579d-4833-9bb4-c43c511f820d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:43 user nova-compute[75247]: DEBUG nova.compute.manager [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:53:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:43 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:53:43 user nova-compute[75247]: INFO nova.compute.claims [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Claim successful on node user
Dec 06 12:53:44 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0e7f8114-2e5d-4bf6-bb31-b00666f0d901 {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG nova.compute.manager [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG nova.compute.manager [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG nova.network.neutron [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:53:44 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:53:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG nova.compute.manager [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG nova.policy [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5fbb18188b54408c82785f12ba5a8c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8439b54f294add9fb59befefd54456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG nova.compute.manager [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:53:44 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Creating image(s)
Dec 06 12:53:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "/opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "/opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.221s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG nova.compute.manager [req-61352d3a-e868-4bcc-9419-116aa1a5c92e req-c9d1838c-19ae-415e-8ce5-d6416479c59b service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Received event network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-61352d3a-e868-4bcc-9419-116aa1a5c92e req-c9d1838c-19ae-415e-8ce5-d6416479c59b service nova] Acquiring lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-61352d3a-e868-4bcc-9419-116aa1a5c92e req-c9d1838c-19ae-415e-8ce5-d6416479c59b service nova] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-61352d3a-e868-4bcc-9419-116aa1a5c92e req-c9d1838c-19ae-415e-8ce5-d6416479c59b service nova] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG nova.compute.manager [req-61352d3a-e868-4bcc-9419-116aa1a5c92e req-c9d1838c-19ae-415e-8ce5-d6416479c59b service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] No waiting events found dispatching network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:53:44 user nova-compute[75247]: WARNING nova.compute.manager [req-61352d3a-e868-4bcc-9419-116aa1a5c92e req-c9d1838c-19ae-415e-8ce5-d6416479c59b service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Received unexpected event network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 for instance with vm_state active and task_state rescuing.
Dec 06 12:53:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.191s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk 1073741824" returned: 0 in 0.060s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:45 user nova-compute[75247]: DEBUG nova.network.neutron [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Successfully created port: 818fb644-610d-4c88-b8fe-58ab34e6a02a {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:53:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.197s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:45 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:53:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:53:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:53:45 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Cannot resize image /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:53:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:53:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Ensure instance console log exists: /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:53:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:45 user nova-compute[75247]: DEBUG nova.network.neutron [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Successfully updated port: 818fb644-610d-4c88-b8fe-58ab34e6a02a {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:53:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "refresh_cache-f5b69324-579d-4833-9bb4-c43c511f820d" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:53:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquired lock "refresh_cache-f5b69324-579d-4833-9bb4-c43c511f820d" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:53:45 user nova-compute[75247]: DEBUG nova.network.neutron [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:53:45 user nova-compute[75247]: DEBUG nova.compute.manager [req-2c6e2dfa-fdb3-4f56-b495-b16307e2b8d2 req-4ba4b4a6-0f4e-4d15-bba2-b289dd96b104 service nova] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Received event network-changed-818fb644-610d-4c88-b8fe-58ab34e6a02a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:53:45 user nova-compute[75247]: DEBUG nova.compute.manager [req-2c6e2dfa-fdb3-4f56-b495-b16307e2b8d2 req-4ba4b4a6-0f4e-4d15-bba2-b289dd96b104 service nova] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Refreshing instance network info cache due to event network-changed-818fb644-610d-4c88-b8fe-58ab34e6a02a. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:53:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2c6e2dfa-fdb3-4f56-b495-b16307e2b8d2 req-4ba4b4a6-0f4e-4d15-bba2-b289dd96b104 service nova] Acquiring lock "refresh_cache-f5b69324-579d-4833-9bb4-c43c511f820d" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:53:45 user nova-compute[75247]: DEBUG nova.network.neutron [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.network.neutron [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Updating instance_info_cache with network_info: [{"id": "818fb644-610d-4c88-b8fe-58ab34e6a02a", "address": "fa:16:3e:88:16:dd", "network": {"id": "54586963-619a-439b-94a9-13ade1a28f3f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1711423376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8439b54f294add9fb59befefd54456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fb644-61", "ovs_interfaceid": "818fb644-610d-4c88-b8fe-58ab34e6a02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Releasing lock "refresh_cache-f5b69324-579d-4833-9bb4-c43c511f820d" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.compute.manager [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Instance network_info: |[{"id": "818fb644-610d-4c88-b8fe-58ab34e6a02a", "address": "fa:16:3e:88:16:dd", "network": {"id": "54586963-619a-439b-94a9-13ade1a28f3f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1711423376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8439b54f294add9fb59befefd54456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fb644-61", "ovs_interfaceid": "818fb644-610d-4c88-b8fe-58ab34e6a02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2c6e2dfa-fdb3-4f56-b495-b16307e2b8d2 req-4ba4b4a6-0f4e-4d15-bba2-b289dd96b104 service nova] Acquired lock "refresh_cache-f5b69324-579d-4833-9bb4-c43c511f820d" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.network.neutron [req-2c6e2dfa-fdb3-4f56-b495-b16307e2b8d2 req-4ba4b4a6-0f4e-4d15-bba2-b289dd96b104 service nova] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Refreshing network info cache for port 818fb644-610d-4c88-b8fe-58ab34e6a02a {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Start _get_guest_xml network_info=[{"id": "818fb644-610d-4c88-b8fe-58ab34e6a02a", "address": "fa:16:3e:88:16:dd", "network": {"id": "54586963-619a-439b-94a9-13ade1a28f3f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1711423376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8439b54f294add9fb59befefd54456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fb644-61", "ovs_interfaceid": "818fb644-610d-4c88-b8fe-58ab34e6a02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:53:46 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:53:46 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-484733800',display_name='tempest-SnapshotDataIntegrityTests-server-484733800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-484733800',id=33,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMWpUvaeN4HmhK4Uk0bG4MtL5152M8z6lVCrXyCIqDghTwoaBsKc+1k0bTKDLqNTNct8jWpQAs5/yZFGk5u5YG3aVafyEnXV+cTFgVzmFlrxedUgmxftW3vMLt1aOzemA==',key_name='tempest-keypair-1000707285',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd8439b54f294add9fb59befefd54456',ramdisk_id='',reservation_id='r-m17vn4o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1400142710',owner_user_name='tempest-SnapshotDataIntegrityTests-1400142710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:53:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fbb18188b54408c82785f12ba5a8c2d',uuid=f5b69324-579d-4833-9bb4-c43c511f820d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "818fb644-610d-4c88-b8fe-58ab34e6a02a", "address": "fa:16:3e:88:16:dd", "network": {"id": "54586963-619a-439b-94a9-13ade1a28f3f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1711423376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8439b54f294add9fb59befefd54456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fb644-61", "ovs_interfaceid": "818fb644-610d-4c88-b8fe-58ab34e6a02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Converting VIF {"id": "818fb644-610d-4c88-b8fe-58ab34e6a02a", "address": "fa:16:3e:88:16:dd", "network": {"id": "54586963-619a-439b-94a9-13ade1a28f3f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1711423376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8439b54f294add9fb59befefd54456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fb644-61", "ovs_interfaceid": "818fb644-610d-4c88-b8fe-58ab34e6a02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:16:dd,bridge_name='br-int',has_traffic_filtering=True,id=818fb644-610d-4c88-b8fe-58ab34e6a02a,network=Network(54586963-619a-439b-94a9-13ade1a28f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap818fb644-61') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.objects.instance [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lazy-loading 'pci_devices' on Instance uuid f5b69324-579d-4833-9bb4-c43c511f820d {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:53:46 user nova-compute[75247]:   <uuid>f5b69324-579d-4833-9bb4-c43c511f820d</uuid>
Dec 06 12:53:46 user nova-compute[75247]:   <name>instance-00000021</name>
Dec 06 12:53:46 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:53:46 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:53:46 user nova-compute[75247]:   <metadata>
Dec 06 12:53:46 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:53:46 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:53:46 user nova-compute[75247]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-484733800</nova:name>
Dec 06 12:53:46 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:53:46</nova:creationTime>
Dec 06 12:53:46 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:53:46 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:53:46 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:53:46 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:53:46 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:53:46 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:53:46 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:53:46 user nova-compute[75247]:       <nova:owner>
Dec 06 12:53:46 user nova-compute[75247]:         <nova:user uuid="5fbb18188b54408c82785f12ba5a8c2d">tempest-SnapshotDataIntegrityTests-1400142710-project-member</nova:user>
Dec 06 12:53:46 user nova-compute[75247]:         <nova:project uuid="cd8439b54f294add9fb59befefd54456">tempest-SnapshotDataIntegrityTests-1400142710</nova:project>
Dec 06 12:53:46 user nova-compute[75247]:       </nova:owner>
Dec 06 12:53:46 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:53:46 user nova-compute[75247]:       <nova:ports>
Dec 06 12:53:46 user nova-compute[75247]:         <nova:port uuid="818fb644-610d-4c88-b8fe-58ab34e6a02a">
Dec 06 12:53:46 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 06 12:53:46 user nova-compute[75247]:         </nova:port>
Dec 06 12:53:46 user nova-compute[75247]:       </nova:ports>
Dec 06 12:53:46 user nova-compute[75247]:     </nova:instance>
Dec 06 12:53:46 user nova-compute[75247]:   </metadata>
Dec 06 12:53:46 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:53:46 user nova-compute[75247]:     <system>
Dec 06 12:53:46 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:53:46 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:53:46 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:53:46 user nova-compute[75247]:       <entry name="serial">f5b69324-579d-4833-9bb4-c43c511f820d</entry>
Dec 06 12:53:46 user nova-compute[75247]:       <entry name="uuid">f5b69324-579d-4833-9bb4-c43c511f820d</entry>
Dec 06 12:53:46 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:53:46 user nova-compute[75247]:     </system>
Dec 06 12:53:46 user nova-compute[75247]:   </sysinfo>
Dec 06 12:53:46 user nova-compute[75247]:   <os>
Dec 06 12:53:46 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:53:46 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:53:46 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:53:46 user nova-compute[75247]:   </os>
Dec 06 12:53:46 user nova-compute[75247]:   <features>
Dec 06 12:53:46 user nova-compute[75247]:     <acpi/>
Dec 06 12:53:46 user nova-compute[75247]:     <apic/>
Dec 06 12:53:46 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:53:46 user nova-compute[75247]:   </features>
Dec 06 12:53:46 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:53:46 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:53:46 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:53:46 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:53:46 user nova-compute[75247]:   </clock>
Dec 06 12:53:46 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:53:46 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:53:46 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:53:46 user nova-compute[75247]:   </cpu>
Dec 06 12:53:46 user nova-compute[75247]:   <devices>
Dec 06 12:53:46 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:53:46 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:53:46 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk"/>
Dec 06 12:53:46 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:53:46 user nova-compute[75247]:     </disk>
Dec 06 12:53:46 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:53:46 user nova-compute[75247]:       <mac address="fa:16:3e:88:16:dd"/>
Dec 06 12:53:46 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:53:46 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:53:46 user nova-compute[75247]:       <target dev="tap818fb644-61"/>
Dec 06 12:53:46 user nova-compute[75247]:     </interface>
Dec 06 12:53:46 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:53:46 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/console.log" append="off"/>
Dec 06 12:53:46 user nova-compute[75247]:     </serial>
Dec 06 12:53:46 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:53:46 user nova-compute[75247]:     <video>
Dec 06 12:53:46 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:53:46 user nova-compute[75247]:     </video>
Dec 06 12:53:46 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:53:46 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:53:46 user nova-compute[75247]:     </rng>
Dec 06 12:53:46 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:53:46 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:53:46 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:53:46 user nova-compute[75247]:     </memballoon>
Dec 06 12:53:46 user nova-compute[75247]:   </devices>
Dec 06 12:53:46 user nova-compute[75247]: </domain>
Dec 06 12:53:46 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-484733800',display_name='tempest-SnapshotDataIntegrityTests-server-484733800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-484733800',id=33,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMWpUvaeN4HmhK4Uk0bG4MtL5152M8z6lVCrXyCIqDghTwoaBsKc+1k0bTKDLqNTNct8jWpQAs5/yZFGk5u5YG3aVafyEnXV+cTFgVzmFlrxedUgmxftW3vMLt1aOzemA==',key_name='tempest-keypair-1000707285',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd8439b54f294add9fb59befefd54456',ramdisk_id='',reservation_id='r-m17vn4o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1400142710',owner_user_name='tempest-SnapshotDataIntegrityTests-1400142710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:53:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fbb18188b54408c82785f12ba5a8c2d',uuid=f5b69324-579d-4833-9bb4-c43c511f820d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "818fb644-610d-4c88-b8fe-58ab34e6a02a", "address": "fa:16:3e:88:16:dd", "network": {"id": "54586963-619a-439b-94a9-13ade1a28f3f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1711423376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8439b54f294add9fb59befefd54456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fb644-61", "ovs_interfaceid": "818fb644-610d-4c88-b8fe-58ab34e6a02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Converting VIF {"id": "818fb644-610d-4c88-b8fe-58ab34e6a02a", "address": "fa:16:3e:88:16:dd", "network": {"id": "54586963-619a-439b-94a9-13ade1a28f3f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1711423376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8439b54f294add9fb59befefd54456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fb644-61", "ovs_interfaceid": "818fb644-610d-4c88-b8fe-58ab34e6a02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:16:dd,bridge_name='br-int',has_traffic_filtering=True,id=818fb644-610d-4c88-b8fe-58ab34e6a02a,network=Network(54586963-619a-439b-94a9-13ade1a28f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap818fb644-61') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG os_vif [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:16:dd,bridge_name='br-int',has_traffic_filtering=True,id=818fb644-610d-4c88-b8fe-58ab34e6a02a,network=Network(54586963-619a-439b-94a9-13ade1a28f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap818fb644-61') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d997783-7f70-5c87-bbc5-902e9c3fc9ef', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap818fb644-61, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap818fb644-61, col_values=(('qos', UUID('361c636d-85ea-447b-8c8d-8a166c8d2924')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap818fb644-61, col_values=(('external_ids', {'iface-id': '818fb644-610d-4c88-b8fe-58ab34e6a02a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:16:dd', 'vm-uuid': 'f5b69324-579d-4833-9bb4-c43c511f820d'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:46 user nova-compute[75247]: INFO os_vif [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:16:dd,bridge_name='br-int',has_traffic_filtering=True,id=818fb644-610d-4c88-b8fe-58ab34e6a02a,network=Network(54586963-619a-439b-94a9-13ade1a28f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap818fb644-61')
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] No VIF found with MAC fa:16:3e:88:16:dd, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.network.neutron [req-2c6e2dfa-fdb3-4f56-b495-b16307e2b8d2 req-4ba4b4a6-0f4e-4d15-bba2-b289dd96b104 service nova] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Updated VIF entry in instance network info cache for port 818fb644-610d-4c88-b8fe-58ab34e6a02a. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.network.neutron [req-2c6e2dfa-fdb3-4f56-b495-b16307e2b8d2 req-4ba4b4a6-0f4e-4d15-bba2-b289dd96b104 service nova] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Updating instance_info_cache with network_info: [{"id": "818fb644-610d-4c88-b8fe-58ab34e6a02a", "address": "fa:16:3e:88:16:dd", "network": {"id": "54586963-619a-439b-94a9-13ade1a28f3f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1711423376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8439b54f294add9fb59befefd54456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fb644-61", "ovs_interfaceid": "818fb644-610d-4c88-b8fe-58ab34e6a02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2c6e2dfa-fdb3-4f56-b495-b16307e2b8d2 req-4ba4b4a6-0f4e-4d15-bba2-b289dd96b104 service nova] Releasing lock "refresh_cache-f5b69324-579d-4833-9bb4-c43c511f820d" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.compute.manager [None req-92287124-cfae-4edf-bf7c-98d72194ee70 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.compute.manager [req-e4b16078-6bf3-48a8-97ff-d73e92b72aea req-c279d52e-db48-462d-85a0-6afdae7265f7 service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Received event network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e4b16078-6bf3-48a8-97ff-d73e92b72aea req-c279d52e-db48-462d-85a0-6afdae7265f7 service nova] Acquiring lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e4b16078-6bf3-48a8-97ff-d73e92b72aea req-c279d52e-db48-462d-85a0-6afdae7265f7 service nova] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e4b16078-6bf3-48a8-97ff-d73e92b72aea req-c279d52e-db48-462d-85a0-6afdae7265f7 service nova] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:46 user nova-compute[75247]: DEBUG nova.compute.manager [req-e4b16078-6bf3-48a8-97ff-d73e92b72aea req-c279d52e-db48-462d-85a0-6afdae7265f7 service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] No waiting events found dispatching network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:53:46 user nova-compute[75247]: WARNING nova.compute.manager [req-e4b16078-6bf3-48a8-97ff-d73e92b72aea req-c279d52e-db48-462d-85a0-6afdae7265f7 service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Received unexpected event network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 for instance with vm_state rescued and task_state None.
Dec 06 12:53:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-7dfbf6e7-5644-49ba-b764-40727ede8228 req-8b87897f-75b1-4d54-8743-ae65e9ab94b2 service nova] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Received event network-vif-plugged-818fb644-610d-4c88-b8fe-58ab34e6a02a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:53:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7dfbf6e7-5644-49ba-b764-40727ede8228 req-8b87897f-75b1-4d54-8743-ae65e9ab94b2 service nova] Acquiring lock "f5b69324-579d-4833-9bb4-c43c511f820d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7dfbf6e7-5644-49ba-b764-40727ede8228 req-8b87897f-75b1-4d54-8743-ae65e9ab94b2 service nova] Lock "f5b69324-579d-4833-9bb4-c43c511f820d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7dfbf6e7-5644-49ba-b764-40727ede8228 req-8b87897f-75b1-4d54-8743-ae65e9ab94b2 service nova] Lock "f5b69324-579d-4833-9bb4-c43c511f820d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-7dfbf6e7-5644-49ba-b764-40727ede8228 req-8b87897f-75b1-4d54-8743-ae65e9ab94b2 service nova] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] No waiting events found dispatching network-vif-plugged-818fb644-610d-4c88-b8fe-58ab34e6a02a {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:53:47 user nova-compute[75247]: WARNING nova.compute.manager [req-7dfbf6e7-5644-49ba-b764-40727ede8228 req-8b87897f-75b1-4d54-8743-ae65e9ab94b2 service nova] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Received unexpected event network-vif-plugged-818fb644-610d-4c88-b8fe-58ab34e6a02a for instance with vm_state building and task_state spawning.
Dec 06 12:53:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:50 user nova-compute[75247]: DEBUG nova.compute.manager [req-e1a857ee-07b4-49ce-ab3d-d5668f95f2f3 req-3e827a3f-f91d-4c75-a504-2be4f09aa1c0 service nova] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Received event network-vif-plugged-818fb644-610d-4c88-b8fe-58ab34e6a02a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:53:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e1a857ee-07b4-49ce-ab3d-d5668f95f2f3 req-3e827a3f-f91d-4c75-a504-2be4f09aa1c0 service nova] Acquiring lock "f5b69324-579d-4833-9bb4-c43c511f820d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e1a857ee-07b4-49ce-ab3d-d5668f95f2f3 req-3e827a3f-f91d-4c75-a504-2be4f09aa1c0 service nova] Lock "f5b69324-579d-4833-9bb4-c43c511f820d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e1a857ee-07b4-49ce-ab3d-d5668f95f2f3 req-3e827a3f-f91d-4c75-a504-2be4f09aa1c0 service nova] Lock "f5b69324-579d-4833-9bb4-c43c511f820d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:50 user nova-compute[75247]: DEBUG nova.compute.manager [req-e1a857ee-07b4-49ce-ab3d-d5668f95f2f3 req-3e827a3f-f91d-4c75-a504-2be4f09aa1c0 service nova] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] No waiting events found dispatching network-vif-plugged-818fb644-610d-4c88-b8fe-58ab34e6a02a {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:53:50 user nova-compute[75247]: WARNING nova.compute.manager [req-e1a857ee-07b4-49ce-ab3d-d5668f95f2f3 req-3e827a3f-f91d-4c75-a504-2be4f09aa1c0 service nova] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Received unexpected event network-vif-plugged-818fb644-610d-4c88-b8fe-58ab34e6a02a for instance with vm_state building and task_state spawning.
Dec 06 12:53:50 user nova-compute[75247]: DEBUG nova.compute.manager [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:53:50 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:53:50 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Instance spawned successfully.
Dec 06 12:53:50 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:53:50 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:53:50 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:53:50 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:53:50 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:53:50 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:53:50 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:53:50 user nova-compute[75247]: INFO nova.compute.manager [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Took 5.95 seconds to spawn the instance on the hypervisor.
Dec 06 12:53:50 user nova-compute[75247]: DEBUG nova.compute.manager [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:53:50 user nova-compute[75247]: INFO nova.compute.manager [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Took 6.84 seconds to build instance.
Dec 06 12:53:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-068f6b20-1bc4-43de-9e56-dd7fff940161 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.973s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-586bd6c0-4a2c-497a-85ea-ed0a44b9b943 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "504791a2-9892-4721-856a-e0b77a395d01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-586bd6c0-4a2c-497a-85ea-ed0a44b9b943 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "504791a2-9892-4721-856a-e0b77a395d01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-586bd6c0-4a2c-497a-85ea-ed0a44b9b943 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "504791a2-9892-4721-856a-e0b77a395d01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-586bd6c0-4a2c-497a-85ea-ed0a44b9b943 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "504791a2-9892-4721-856a-e0b77a395d01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-586bd6c0-4a2c-497a-85ea-ed0a44b9b943 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "504791a2-9892-4721-856a-e0b77a395d01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.004s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:58 user nova-compute[75247]: INFO nova.compute.manager [None req-586bd6c0-4a2c-497a-85ea-ed0a44b9b943 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Terminating instance
Dec 06 12:53:58 user nova-compute[75247]: DEBUG nova.compute.manager [None req-586bd6c0-4a2c-497a-85ea-ed0a44b9b943 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:53:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:59 user nova-compute[75247]: DEBUG nova.compute.manager [req-d89aaae9-505a-4d68-8d38-55a827d090fb req-552b52a0-b177-4f7c-beed-14e179a68070 service nova] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Received event network-vif-unplugged-0d1f49fb-698e-43fd-8ef4-8ad8b2749f92 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:53:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d89aaae9-505a-4d68-8d38-55a827d090fb req-552b52a0-b177-4f7c-beed-14e179a68070 service nova] Acquiring lock "504791a2-9892-4721-856a-e0b77a395d01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:53:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d89aaae9-505a-4d68-8d38-55a827d090fb req-552b52a0-b177-4f7c-beed-14e179a68070 service nova] Lock "504791a2-9892-4721-856a-e0b77a395d01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:53:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d89aaae9-505a-4d68-8d38-55a827d090fb req-552b52a0-b177-4f7c-beed-14e179a68070 service nova] Lock "504791a2-9892-4721-856a-e0b77a395d01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:53:59 user nova-compute[75247]: DEBUG nova.compute.manager [req-d89aaae9-505a-4d68-8d38-55a827d090fb req-552b52a0-b177-4f7c-beed-14e179a68070 service nova] [instance: 504791a2-9892-4721-856a-e0b77a395d01] No waiting events found dispatching network-vif-unplugged-0d1f49fb-698e-43fd-8ef4-8ad8b2749f92 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:53:59 user nova-compute[75247]: DEBUG nova.compute.manager [req-d89aaae9-505a-4d68-8d38-55a827d090fb req-552b52a0-b177-4f7c-beed-14e179a68070 service nova] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Received event network-vif-unplugged-0d1f49fb-698e-43fd-8ef4-8ad8b2749f92 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:53:59 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Instance destroyed successfully.
Dec 06 12:53:59 user nova-compute[75247]: DEBUG nova.objects.instance [None req-586bd6c0-4a2c-497a-85ea-ed0a44b9b943 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lazy-loading 'resources' on Instance uuid 504791a2-9892-4721-856a-e0b77a395d01 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:53:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-586bd6c0-4a2c-497a-85ea-ed0a44b9b943 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-548460361',display_name='tempest-AttachVolumeNegativeTest-server-548460361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-548460361',id=29,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsDqGZfCQcpUWP7TOkMrEcJYJs1a9WJmNto1njU4Mkh724U/nMXqizmwABxywMuU6TvrnjH+lAogQGhP9oMRJHp6pHJQKLFwnckt9ggsCPlL+/raC3W58S4XV2iShNT4g==',key_name='tempest-keypair-968485742',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:51:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a6b077946334f1c8fd16d091a7738e1',ramdisk_id='',reservation_id='r-j5esl516',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2136789566',owner_user_name='tempest-AttachVolumeNegativeTest-2136789566-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:51:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d7becd4d5734bc2b652e6f37492eb5e',uuid=504791a2-9892-4721-856a-e0b77a395d01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d1f49fb-698e-43fd-8ef4-8ad8b2749f92", "address": "fa:16:3e:58:67:92", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d1f49fb-69", "ovs_interfaceid": "0d1f49fb-698e-43fd-8ef4-8ad8b2749f92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:53:59 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-586bd6c0-4a2c-497a-85ea-ed0a44b9b943 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Converting VIF {"id": "0d1f49fb-698e-43fd-8ef4-8ad8b2749f92", "address": "fa:16:3e:58:67:92", "network": {"id": "3e9e4a72-d987-4e46-b968-e38414857af6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1814857932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b077946334f1c8fd16d091a7738e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d1f49fb-69", "ovs_interfaceid": "0d1f49fb-698e-43fd-8ef4-8ad8b2749f92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:53:59 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-586bd6c0-4a2c-497a-85ea-ed0a44b9b943 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:67:92,bridge_name='br-int',has_traffic_filtering=True,id=0d1f49fb-698e-43fd-8ef4-8ad8b2749f92,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d1f49fb-69') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:53:59 user nova-compute[75247]: DEBUG os_vif [None req-586bd6c0-4a2c-497a-85ea-ed0a44b9b943 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:67:92,bridge_name='br-int',has_traffic_filtering=True,id=0d1f49fb-698e-43fd-8ef4-8ad8b2749f92,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d1f49fb-69') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:53:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d1f49fb-69, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:53:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:53:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b2f3eb5-f7b9-4e36-b0dd-70e48989d562) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:53:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:53:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:53:59 user nova-compute[75247]: INFO os_vif [None req-586bd6c0-4a2c-497a-85ea-ed0a44b9b943 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:67:92,bridge_name='br-int',has_traffic_filtering=True,id=0d1f49fb-698e-43fd-8ef4-8ad8b2749f92,network=Network(3e9e4a72-d987-4e46-b968-e38414857af6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d1f49fb-69')
Dec 06 12:53:59 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-586bd6c0-4a2c-497a-85ea-ed0a44b9b943 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Deleting instance files /opt/stack/data/nova/instances/504791a2-9892-4721-856a-e0b77a395d01_del
Dec 06 12:53:59 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-586bd6c0-4a2c-497a-85ea-ed0a44b9b943 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Deletion of /opt/stack/data/nova/instances/504791a2-9892-4721-856a-e0b77a395d01_del complete
Dec 06 12:53:59 user nova-compute[75247]: INFO nova.compute.manager [None req-586bd6c0-4a2c-497a-85ea-ed0a44b9b943 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Took 1.11 seconds to destroy the instance on the hypervisor.
Dec 06 12:53:59 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-586bd6c0-4a2c-497a-85ea-ed0a44b9b943 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:53:59 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:53:59 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 504791a2-9892-4721-856a-e0b77a395d01] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:54:00 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:54:00 user nova-compute[75247]: DEBUG nova.compute.manager [req-e024d1cb-2fd7-4943-bdbd-a98894eb1efb req-f34a6feb-f520-47f6-a1ad-1101362fd6ca service nova] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Received event network-vif-deleted-0d1f49fb-698e-43fd-8ef4-8ad8b2749f92 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:00 user nova-compute[75247]: INFO nova.compute.manager [req-e024d1cb-2fd7-4943-bdbd-a98894eb1efb req-f34a6feb-f520-47f6-a1ad-1101362fd6ca service nova] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Neutron deleted interface 0d1f49fb-698e-43fd-8ef4-8ad8b2749f92; detaching it from the instance and deleting it from the info cache
Dec 06 12:54:00 user nova-compute[75247]: DEBUG nova.network.neutron [req-e024d1cb-2fd7-4943-bdbd-a98894eb1efb req-f34a6feb-f520-47f6-a1ad-1101362fd6ca service nova] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:54:00 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Took 0.97 seconds to deallocate network for instance.
Dec 06 12:54:00 user nova-compute[75247]: DEBUG nova.compute.manager [req-e024d1cb-2fd7-4943-bdbd-a98894eb1efb req-f34a6feb-f520-47f6-a1ad-1101362fd6ca service nova] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Detach interface failed, port_id=0d1f49fb-698e-43fd-8ef4-8ad8b2749f92, reason: Instance 504791a2-9892-4721-856a-e0b77a395d01 could not be found. {{(pid=75247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 12:54:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-586bd6c0-4a2c-497a-85ea-ed0a44b9b943 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-586bd6c0-4a2c-497a-85ea-ed0a44b9b943 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:01 user nova-compute[75247]: DEBUG nova.compute.manager [req-256c461a-1eb2-4763-89cd-6e963075948f req-2a1c8c4b-8ac4-40eb-9e0c-eaeff2be271e service nova] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Received event network-vif-plugged-0d1f49fb-698e-43fd-8ef4-8ad8b2749f92 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-256c461a-1eb2-4763-89cd-6e963075948f req-2a1c8c4b-8ac4-40eb-9e0c-eaeff2be271e service nova] Acquiring lock "504791a2-9892-4721-856a-e0b77a395d01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-256c461a-1eb2-4763-89cd-6e963075948f req-2a1c8c4b-8ac4-40eb-9e0c-eaeff2be271e service nova] Lock "504791a2-9892-4721-856a-e0b77a395d01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-256c461a-1eb2-4763-89cd-6e963075948f req-2a1c8c4b-8ac4-40eb-9e0c-eaeff2be271e service nova] Lock "504791a2-9892-4721-856a-e0b77a395d01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:01 user nova-compute[75247]: DEBUG nova.compute.manager [req-256c461a-1eb2-4763-89cd-6e963075948f req-2a1c8c4b-8ac4-40eb-9e0c-eaeff2be271e service nova] [instance: 504791a2-9892-4721-856a-e0b77a395d01] No waiting events found dispatching network-vif-plugged-0d1f49fb-698e-43fd-8ef4-8ad8b2749f92 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:54:01 user nova-compute[75247]: WARNING nova.compute.manager [req-256c461a-1eb2-4763-89cd-6e963075948f req-2a1c8c4b-8ac4-40eb-9e0c-eaeff2be271e service nova] [instance: 504791a2-9892-4721-856a-e0b77a395d01] Received unexpected event network-vif-plugged-0d1f49fb-698e-43fd-8ef4-8ad8b2749f92 for instance with vm_state deleted and task_state None.
Dec 06 12:54:01 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-586bd6c0-4a2c-497a-85ea-ed0a44b9b943 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:54:01 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-586bd6c0-4a2c-497a-85ea-ed0a44b9b943 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:54:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-586bd6c0-4a2c-497a-85ea-ed0a44b9b943 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:01 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-586bd6c0-4a2c-497a-85ea-ed0a44b9b943 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Deleted allocations for instance 504791a2-9892-4721-856a-e0b77a395d01
Dec 06 12:54:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-586bd6c0-4a2c-497a-85ea-ed0a44b9b943 tempest-AttachVolumeNegativeTest-2136789566 tempest-AttachVolumeNegativeTest-2136789566-project-member] Lock "504791a2-9892-4721-856a-e0b77a395d01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.829s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:01 user nova-compute[75247]: INFO nova.compute.manager [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Rescuing
Dec 06 12:54:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "refresh_cache-bc3ddb40-b05f-4170-b269-d44dec6ecdaf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:54:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquired lock "refresh_cache-bc3ddb40-b05f-4170-b269-d44dec6ecdaf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:54:01 user nova-compute[75247]: DEBUG nova.network.neutron [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:54:02 user nova-compute[75247]: DEBUG nova.network.neutron [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Updating instance_info_cache with network_info: [{"id": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "address": "fa:16:3e:d5:71:f5", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e66d0f0-cc", "ovs_interfaceid": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:54:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Releasing lock "refresh_cache-bc3ddb40-b05f-4170-b269-d44dec6ecdaf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:54:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:03 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Instance destroyed successfully.
Dec 06 12:54:03 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Attempting rescue
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75247) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Instance directory exists: not creating {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 06 12:54:03 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Creating image(s)
Dec 06 12:54:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "/opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "/opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.objects.instance [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'trusted_certs' on Instance uuid bc3ddb40-b05f-4170-b269-d44dec6ecdaf {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Received event network-changed-b924c627-a11e-4fc4-8e23-d1a974c4de3d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Refreshing instance network info cache due to event network-changed-b924c627-a11e-4fc4-8e23-d1a974c4de3d. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] Acquiring lock "refresh_cache-782289e2-91cd-4aee-9a08-eadfb2a5965b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] Acquired lock "refresh_cache-782289e2-91cd-4aee-9a08-eadfb2a5965b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.network.neutron [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Refreshing network info cache for port b924c627-a11e-4fc4-8e23-d1a974c4de3d {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.215s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk.rescue {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk.rescue" returned: 0 in 0.061s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.objects.instance [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'migration_context' on Instance uuid bc3ddb40-b05f-4170-b269-d44dec6ecdaf {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.objects.base [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Object Instance<bc3ddb40-b05f-4170-b269-d44dec6ecdaf> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Start _get_guest_xml network_info=[{"id": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "address": "fa:16:3e:d5:71:f5", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "vif_mac": "fa:16:3e:d5:71:f5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e66d0f0-cc", "ovs_interfaceid": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.objects.instance [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'resources' on Instance uuid bc3ddb40-b05f-4170-b269-d44dec6ecdaf {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.objects.base [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Object Instance<bc3ddb40-b05f-4170-b269-d44dec6ecdaf> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.objects.instance [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'numa_topology' on Instance uuid bc3ddb40-b05f-4170-b269-d44dec6ecdaf {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.objects.base [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Object Instance<bc3ddb40-b05f-4170-b269-d44dec6ecdaf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:54:03 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:54:03 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.objects.instance [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'vcpu_model' on Instance uuid bc3ddb40-b05f-4170-b269-d44dec6ecdaf {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.objects.base [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Object Instance<bc3ddb40-b05f-4170-b269-d44dec6ecdaf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:49:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-404265289',display_name='tempest-ServerRescueNegativeTestJSON-server-404265289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-404265289',id=25,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:49:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b253fd3ef3284dd885d3a0efc1ec07d7',ramdisk_id='',reservation_id='r-66f8wdqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-295230580',owner_user_name='tempest-ServerRescueNegativeTestJSON-295230580-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:49:30Z,user_data=None,user_id='deac43cb03b440ff9de75801065ec9af',uuid=bc3ddb40-b05f-4170-b269-d44dec6ecdaf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "address": "fa:16:3e:d5:71:f5", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "vif_mac": "fa:16:3e:d5:71:f5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e66d0f0-cc", "ovs_interfaceid": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Converting VIF {"id": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "address": "fa:16:3e:d5:71:f5", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "vif_mac": "fa:16:3e:d5:71:f5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e66d0f0-cc", "ovs_interfaceid": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:71:f5,bridge_name='br-int',has_traffic_filtering=True,id=4e66d0f0-cc12-4e3a-8626-59f8a73862e8,network=Network(579972e2-9933-47d9-b56b-f64b5650d611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e66d0f0-cc') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.objects.instance [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'pci_devices' on Instance uuid bc3ddb40-b05f-4170-b269-d44dec6ecdaf {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.objects.base [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Object Instance<bc3ddb40-b05f-4170-b269-d44dec6ecdaf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:54:03 user nova-compute[75247]:   <uuid>bc3ddb40-b05f-4170-b269-d44dec6ecdaf</uuid>
Dec 06 12:54:03 user nova-compute[75247]:   <name>instance-00000019</name>
Dec 06 12:54:03 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:54:03 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:54:03 user nova-compute[75247]:   <metadata>
Dec 06 12:54:03 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:54:03 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:54:03 user nova-compute[75247]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-404265289</nova:name>
Dec 06 12:54:03 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:54:03</nova:creationTime>
Dec 06 12:54:03 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:54:03 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:54:03 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:54:03 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:54:03 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:54:03 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:54:03 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:54:03 user nova-compute[75247]:       <nova:owner>
Dec 06 12:54:03 user nova-compute[75247]:         <nova:user uuid="deac43cb03b440ff9de75801065ec9af">tempest-ServerRescueNegativeTestJSON-295230580-project-member</nova:user>
Dec 06 12:54:03 user nova-compute[75247]:         <nova:project uuid="b253fd3ef3284dd885d3a0efc1ec07d7">tempest-ServerRescueNegativeTestJSON-295230580</nova:project>
Dec 06 12:54:03 user nova-compute[75247]:       </nova:owner>
Dec 06 12:54:03 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:54:03 user nova-compute[75247]:       <nova:ports>
Dec 06 12:54:03 user nova-compute[75247]:         <nova:port uuid="4e66d0f0-cc12-4e3a-8626-59f8a73862e8">
Dec 06 12:54:03 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 12:54:03 user nova-compute[75247]:         </nova:port>
Dec 06 12:54:03 user nova-compute[75247]:       </nova:ports>
Dec 06 12:54:03 user nova-compute[75247]:     </nova:instance>
Dec 06 12:54:03 user nova-compute[75247]:   </metadata>
Dec 06 12:54:03 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:54:03 user nova-compute[75247]:     <system>
Dec 06 12:54:03 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:54:03 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:54:03 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:54:03 user nova-compute[75247]:       <entry name="serial">bc3ddb40-b05f-4170-b269-d44dec6ecdaf</entry>
Dec 06 12:54:03 user nova-compute[75247]:       <entry name="uuid">bc3ddb40-b05f-4170-b269-d44dec6ecdaf</entry>
Dec 06 12:54:03 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:54:03 user nova-compute[75247]:     </system>
Dec 06 12:54:03 user nova-compute[75247]:   </sysinfo>
Dec 06 12:54:03 user nova-compute[75247]:   <os>
Dec 06 12:54:03 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:54:03 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:54:03 user nova-compute[75247]:   </os>
Dec 06 12:54:03 user nova-compute[75247]:   <features>
Dec 06 12:54:03 user nova-compute[75247]:     <acpi/>
Dec 06 12:54:03 user nova-compute[75247]:     <apic/>
Dec 06 12:54:03 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:54:03 user nova-compute[75247]:   </features>
Dec 06 12:54:03 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:54:03 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:54:03 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:54:03 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:54:03 user nova-compute[75247]:   </clock>
Dec 06 12:54:03 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:54:03 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:54:03 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:54:03 user nova-compute[75247]:   </cpu>
Dec 06 12:54:03 user nova-compute[75247]:   <devices>
Dec 06 12:54:03 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:54:03 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:54:03 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk.rescue"/>
Dec 06 12:54:03 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:54:03 user nova-compute[75247]:     </disk>
Dec 06 12:54:03 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:54:03 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:54:03 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk"/>
Dec 06 12:54:03 user nova-compute[75247]:       <target dev="vdb" bus="virtio"/>
Dec 06 12:54:03 user nova-compute[75247]:     </disk>
Dec 06 12:54:03 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:54:03 user nova-compute[75247]:       <mac address="fa:16:3e:d5:71:f5"/>
Dec 06 12:54:03 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:54:03 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:54:03 user nova-compute[75247]:       <target dev="tap4e66d0f0-cc"/>
Dec 06 12:54:03 user nova-compute[75247]:     </interface>
Dec 06 12:54:03 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:54:03 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/console.log" append="off"/>
Dec 06 12:54:03 user nova-compute[75247]:     </serial>
Dec 06 12:54:03 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:54:03 user nova-compute[75247]:     <video>
Dec 06 12:54:03 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:54:03 user nova-compute[75247]:     </video>
Dec 06 12:54:03 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:54:03 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:54:03 user nova-compute[75247]:     </rng>
Dec 06 12:54:03 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:54:03 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:54:03 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:54:03 user nova-compute[75247]:     </memballoon>
Dec 06 12:54:03 user nova-compute[75247]:   </devices>
Dec 06 12:54:03 user nova-compute[75247]: </domain>
Dec 06 12:54:03 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:54:03 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Instance destroyed successfully.
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:54:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] No VIF found with MAC fa:16:3e:d5:71:f5, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:54:04 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0e7f8114-2e5d-4bf6-bb31-b00666f0d901 is timed out.
Dec 06 12:54:04 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Successfully detached device vdb from instance 0e7f8114-2e5d-4bf6-bb31-b00666f0d901 from the live domain config.
Dec 06 12:54:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LkiFXwZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:54:04 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:54:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34fbd80-f394-4fc2-ad5c-d0691b0f1350]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:54:04 user nova-compute[75247]: No targets found.
Dec 06 12:54:04 user nova-compute[75247]: iSNS:
Dec 06 12:54:04 user nova-compute[75247]: No targets found.
Dec 06 12:54:04 user nova-compute[75247]: STATIC:
Dec 06 12:54:04 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd
Dec 06 12:54:04 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:54:04 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:54:04 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:54:04 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:54:04 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:54:04 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6
Dec 06 12:54:04 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:54:04 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:54:04 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33
Dec 06 12:54:04 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:54:04 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:54:04 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31
Dec 06 12:54:04 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:54:04 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:54:04 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c
Dec 06 12:54:04 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:54:04 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:54:04 user nova-compute[75247]: FIRMWARE:
Dec 06 12:54:04 user nova-compute[75247]: No targets found.
Dec 06 12:54:04 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:54:04 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:54:04 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d37a92b-43e2-4789-b4c9-56749d593ab2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57cbc58-c8be-4ee6-a1b4-32b5e2ab6648]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:54:04 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:54:04 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:54:04 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:54:04 user nova-compute[75247]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c (non-flash)
Dec 06 12:54:04 user nova-compute[75247]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 (non-flash)
Dec 06 12:54:04 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:54:04 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:54:04 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:54:04 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:54:04 user nova-compute[75247]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c (non-flash)
Dec 06 12:54:04 user nova-compute[75247]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 (non-flash)
Dec 06 12:54:04 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd7304cc940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c'): ({'sdc'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Removing single pathed devices sdc {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[848d4389-c205-4939-b2fd-cdfaa477186b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG nova.compute.manager [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Stashing vm_state: active {{(pid=75247) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f46f2fd-dbf8-4743-91b5-9dce208eafb8]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Flushing IO for device /dev/sdc {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[415709e1-b8cb-4dfd-80de-f23fc486bf85]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[41863256-ee14-48b0-a4ea-8f8d445ad2bb]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] SCSI volumes sdc have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b8a355-64ba-48f6-93d5-51be8d262624]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:54:04 user nova-compute[75247]: INFO nova.compute.claims [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Claim successful on node user
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c83487-f08f-49a3-bcda-92a926597c5e]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c, portal: 172.16.0.220,3260]
Dec 06 12:54:04 user nova-compute[75247]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c, portal: 172.16.0.220,3260] successful.
Dec 06 12:54:04 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:04 user nova-compute[75247]: INFO nova.compute.resource_tracker [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Updating resource usage from migration a28e36c3-e15d-45e3-9f84-3ac928105559
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63b8f38-a8df-4057-989f-91a441657c1c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa41a7dd-a8de-40a7-b960-d02e16fc0f60]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] <== disconnect_volume: return (381ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG nova.network.neutron [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Updated VIF entry in instance network info cache for port b924c627-a11e-4fc4-8e23-d1a974c4de3d. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG nova.network.neutron [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Updating instance_info_cache with network_info: [{"id": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "address": "fa:16:3e:e4:cb:02", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924c627-a1", "ovs_interfaceid": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] Releasing lock "refresh_cache-782289e2-91cd-4aee-9a08-eadfb2a5965b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG nova.compute.manager [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Received event network-changed-41d8bb63-57dd-4479-9a1e-89e223d16677 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG nova.compute.manager [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Refreshing instance network info cache due to event network-changed-41d8bb63-57dd-4479-9a1e-89e223d16677. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] Acquiring lock "refresh_cache-b3720cc0-ff80-4ca2-8b13-d83dded593ad" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] Acquired lock "refresh_cache-b3720cc0-ff80-4ca2-8b13-d83dded593ad" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG nova.network.neutron [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Refreshing network info cache for port 41d8bb63-57dd-4479-9a1e-89e223d16677 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:54:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.647s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:04 user nova-compute[75247]: INFO nova.compute.manager [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Migrating
Dec 06 12:54:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "refresh_cache-b3720cc0-ff80-4ca2-8b13-d83dded593ad" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG nova.network.neutron [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Updated VIF entry in instance network info cache for port 41d8bb63-57dd-4479-9a1e-89e223d16677. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG nova.network.neutron [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Updating instance_info_cache with network_info: [{"id": "41d8bb63-57dd-4479-9a1e-89e223d16677", "address": "fa:16:3e:9a:8b:8a", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d8bb63-57", "ovs_interfaceid": "41d8bb63-57dd-4479-9a1e-89e223d16677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] Releasing lock "refresh_cache-b3720cc0-ff80-4ca2-8b13-d83dded593ad" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received event network-vif-unplugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] Acquiring lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] No waiting events found dispatching network-vif-unplugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:54:05 user nova-compute[75247]: WARNING nova.compute.manager [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received unexpected event network-vif-unplugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 for instance with vm_state active and task_state rescuing.
Dec 06 12:54:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received event network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] Acquiring lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] No waiting events found dispatching network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:54:05 user nova-compute[75247]: WARNING nova.compute.manager [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received unexpected event network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 for instance with vm_state active and task_state rescuing.
Dec 06 12:54:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received event network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] Acquiring lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] No waiting events found dispatching network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:54:05 user nova-compute[75247]: WARNING nova.compute.manager [req-7037c6b6-dde8-4912-b589-8b9dbc3e8874 req-dc8ad61a-a586-4d85-984a-fce6ff3bc8eb service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received unexpected event network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 for instance with vm_state active and task_state rescuing.
Dec 06 12:54:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquired lock "refresh_cache-b3720cc0-ff80-4ca2-8b13-d83dded593ad" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG nova.network.neutron [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG nova.objects.instance [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'flavor' on Instance uuid 0e7f8114-2e5d-4bf6-bb31-b00666f0d901 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-d7745339-fe50-4e6f-8e58-ad5d15b9061f req-38fb2127-bfc3-4783-b585-093b7e7127ec service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received event network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d7745339-fe50-4e6f-8e58-ad5d15b9061f req-38fb2127-bfc3-4783-b585-093b7e7127ec service nova] Acquiring lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d7745339-fe50-4e6f-8e58-ad5d15b9061f req-38fb2127-bfc3-4783-b585-093b7e7127ec service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d7745339-fe50-4e6f-8e58-ad5d15b9061f req-38fb2127-bfc3-4783-b585-093b7e7127ec service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-d7745339-fe50-4e6f-8e58-ad5d15b9061f req-38fb2127-bfc3-4783-b585-093b7e7127ec service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] No waiting events found dispatching network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:54:05 user nova-compute[75247]: WARNING nova.compute.manager [req-d7745339-fe50-4e6f-8e58-ad5d15b9061f req-38fb2127-bfc3-4783-b585-093b7e7127ec service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received unexpected event network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 for instance with vm_state active and task_state rescuing.
Dec 06 12:54:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-d7745339-fe50-4e6f-8e58-ad5d15b9061f req-38fb2127-bfc3-4783-b585-093b7e7127ec service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received event network-vif-unplugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d7745339-fe50-4e6f-8e58-ad5d15b9061f req-38fb2127-bfc3-4783-b585-093b7e7127ec service nova] Acquiring lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d7745339-fe50-4e6f-8e58-ad5d15b9061f req-38fb2127-bfc3-4783-b585-093b7e7127ec service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d7745339-fe50-4e6f-8e58-ad5d15b9061f req-38fb2127-bfc3-4783-b585-093b7e7127ec service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-d7745339-fe50-4e6f-8e58-ad5d15b9061f req-38fb2127-bfc3-4783-b585-093b7e7127ec service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] No waiting events found dispatching network-vif-unplugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:54:05 user nova-compute[75247]: WARNING nova.compute.manager [req-d7745339-fe50-4e6f-8e58-ad5d15b9061f req-38fb2127-bfc3-4783-b585-093b7e7127ec service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received unexpected event network-vif-unplugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 for instance with vm_state active and task_state rescuing.
Dec 06 12:54:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-d7745339-fe50-4e6f-8e58-ad5d15b9061f req-38fb2127-bfc3-4783-b585-093b7e7127ec service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received event network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d7745339-fe50-4e6f-8e58-ad5d15b9061f req-38fb2127-bfc3-4783-b585-093b7e7127ec service nova] Acquiring lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d7745339-fe50-4e6f-8e58-ad5d15b9061f req-38fb2127-bfc3-4783-b585-093b7e7127ec service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d7745339-fe50-4e6f-8e58-ad5d15b9061f req-38fb2127-bfc3-4783-b585-093b7e7127ec service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-d7745339-fe50-4e6f-8e58-ad5d15b9061f req-38fb2127-bfc3-4783-b585-093b7e7127ec service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] No waiting events found dispatching network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:54:05 user nova-compute[75247]: WARNING nova.compute.manager [req-d7745339-fe50-4e6f-8e58-ad5d15b9061f req-38fb2127-bfc3-4783-b585-093b7e7127ec service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received unexpected event network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 for instance with vm_state active and task_state rescuing.
Dec 06 12:54:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-2cc66a35-196f-4bdd-a9e6-6f37a65d6c1f tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.173s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG nova.network.neutron [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Updating instance_info_cache with network_info: [{"id": "41d8bb63-57dd-4479-9a1e-89e223d16677", "address": "fa:16:3e:9a:8b:8a", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d8bb63-57", "ovs_interfaceid": "41d8bb63-57dd-4479-9a1e-89e223d16677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Releasing lock "refresh_cache-b3720cc0-ff80-4ca2-8b13-d83dded593ad" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:54:05 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Starting migrate_disk_and_power_off {{(pid=75247) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11490}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:06 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Instance destroyed successfully.
Dec 06 12:54:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:52:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1873472062',display_name='tempest-ServerActionsTestOtherA-server-1873472062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1873472062',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1PSIn5waVLUBUVXmci26Bjo3OHYSVHL8/oxs3uvNoObvAgLe5HgiP5u61wX8nEvgm8XgeBjcCfcP/HNC/vep9hMtkBYH/Pz/i1rF8IkHYEtoKU1LHCX3Qi/2pvpu4Reg==',key_name='tempest-keypair-1071092699',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:52:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a0ccf15765714ca2a8c4700d2d6e3ed2',ramdisk_id='',reservation_id='r-80mdy70u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2075667053',owner_user_name='tempest-ServerActionsTestOtherA-2075667053-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:54:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13843d8f074da189dbd3e93750b811',uuid=b3720cc0-ff80-4ca2-8b13-d83dded593ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41d8bb63-57dd-4479-9a1e-89e223d16677", "address": "fa:16:3e:9a:8b:8a", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2059292391-network", "vif_mac": "fa:16:3e:9a:8b:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d8bb63-57", "ovs_interfaceid": "41d8bb63-57dd-4479-9a1e-89e223d16677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converting VIF {"id": "41d8bb63-57dd-4479-9a1e-89e223d16677", "address": "fa:16:3e:9a:8b:8a", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2059292391-network", "vif_mac": "fa:16:3e:9a:8b:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d8bb63-57", "ovs_interfaceid": "41d8bb63-57dd-4479-9a1e-89e223d16677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:8b:8a,bridge_name='br-int',has_traffic_filtering=True,id=41d8bb63-57dd-4479-9a1e-89e223d16677,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d8bb63-57') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG os_vif [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:8b:8a,bridge_name='br-int',has_traffic_filtering=True,id=41d8bb63-57dd-4479-9a1e-89e223d16677,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d8bb63-57') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41d8bb63-57, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f277c676-6168-4d53-8a5c-a691071f6e08) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:54:06 user nova-compute[75247]: INFO os_vif [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:8b:8a,bridge_name='br-int',has_traffic_filtering=True,id=41d8bb63-57dd-4479-9a1e-89e223d16677,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d8bb63-57')
Dec 06 12:54:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmYCPVNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:54:06 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:54:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.036s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2ef4d2-1936-454d-9a21-b53e24c95d08]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:54:06 user nova-compute[75247]: No targets found.
Dec 06 12:54:06 user nova-compute[75247]: iSNS:
Dec 06 12:54:06 user nova-compute[75247]: No targets found.
Dec 06 12:54:06 user nova-compute[75247]: STATIC:
Dec 06 12:54:06 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd
Dec 06 12:54:06 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:54:06 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:54:06 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:54:06 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:54:06 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:54:06 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6
Dec 06 12:54:06 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:54:06 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:54:06 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33
Dec 06 12:54:06 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:54:06 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:54:06 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31
Dec 06 12:54:06 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:54:06 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:54:06 user nova-compute[75247]: FIRMWARE:
Dec 06 12:54:06 user nova-compute[75247]: No targets found.
Dec 06 12:54:06 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:54:06 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:54:06 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:06 user nova-compute[75247]: INFO nova.compute.manager [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Detaching volume e2e60d9f-2968-4c23-85e4-3c59d1d206e6
Dec 06 12:54:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47576ba-84b4-4c82-bef6-46dd33f36af9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8137221-80b7-42d9-b24a-19d2d5438c1f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:54:06 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:54:06 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:54:06 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:54:06 user nova-compute[75247]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 (non-flash)
Dec 06 12:54:06 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:54:06 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:54:06 user nova-compute[75247]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:54:06 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:54:06 user nova-compute[75247]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 (non-flash)
Dec 06 12:54:06 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c6b5bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31'): ({'sdf'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Removing single pathed devices sdf {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:06 user nova-compute[75247]: INFO nova.virt.block_device [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Attempting to driver detach volume e2e60d9f-2968-4c23-85e4-3c59d1d206e6 from mountpoint /dev/vdc
Dec 06 12:54:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Attempting to detach device vdc from instance 0e7f8114-2e5d-4bf6-bb31-b00666f0d901 from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:54:06 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:54:06 user nova-compute[75247]:   <source dev="/dev/sdg"/>
Dec 06 12:54:06 user nova-compute[75247]:   <target dev="vdc" bus="virtio"/>
Dec 06 12:54:06 user nova-compute[75247]:   <serial>e2e60d9f-2968-4c23-85e4-3c59d1d206e6</serial>
Dec 06 12:54:06 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 06 12:54:06 user nova-compute[75247]: </disk>
Dec 06 12:54:06 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e205dea2-dab6-4c1d-8346-1e9f319894ab]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:06 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Successfully detached device vdc from instance 0e7f8114-2e5d-4bf6-bb31-b00666f0d901 from the persistent domain config.
Dec 06 12:54:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0e7f8114-2e5d-4bf6-bb31-b00666f0d901 from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:54:06 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:54:06 user nova-compute[75247]:   <source dev="/dev/sdg"/>
Dec 06 12:54:06 user nova-compute[75247]:   <target dev="vdc" bus="virtio"/>
Dec 06 12:54:06 user nova-compute[75247]:   <serial>e2e60d9f-2968-4c23-85e4-3c59d1d206e6</serial>
Dec 06 12:54:06 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 06 12:54:06 user nova-compute[75247]: </disk>
Dec 06 12:54:06 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35e5da0-e101-488e-932b-3d35157cfbac]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Flushing IO for device /dev/sdf {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:54:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ae9026-92e1-4790-a055-c77abaa70590]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[68624f10-a4e2-4b2c-9f7d-9cf7de717faf]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] SCSI volumes sdf have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf4c5b5-f1b0-41ce-bb84-1366a62e2564]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e7f699-cd0d-46c0-aaf1-a6eadeef787a]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31, portal: 172.16.0.220,3260]
Dec 06 12:54:07 user nova-compute[75247]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31, portal: 172.16.0.220,3260] successful.
Dec 06 12:54:07 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9914f0f4-15aa-4aa3-8197-54c14eb24704]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.447s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] <== disconnect_volume: return (448ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0e7f8114-2e5d-4bf6-bb31-b00666f0d901 {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 12:54:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-9a924f23-bf17-4dd0-a7ab-8fc6fa196d12 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:54:08 user nova-compute[75247]: DEBUG nova.compute.manager [req-6464287f-41bd-4112-ba7f-1b1db6404650 req-967b9781-197b-4644-b9b0-fc443c488319 service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received event network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6464287f-41bd-4112-ba7f-1b1db6404650 req-967b9781-197b-4644-b9b0-fc443c488319 service nova] Acquiring lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6464287f-41bd-4112-ba7f-1b1db6404650 req-967b9781-197b-4644-b9b0-fc443c488319 service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6464287f-41bd-4112-ba7f-1b1db6404650 req-967b9781-197b-4644-b9b0-fc443c488319 service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:08 user nova-compute[75247]: DEBUG nova.compute.manager [req-6464287f-41bd-4112-ba7f-1b1db6404650 req-967b9781-197b-4644-b9b0-fc443c488319 service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] No waiting events found dispatching network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:54:08 user nova-compute[75247]: WARNING nova.compute.manager [req-6464287f-41bd-4112-ba7f-1b1db6404650 req-967b9781-197b-4644-b9b0-fc443c488319 service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received unexpected event network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 for instance with vm_state active and task_state rescuing.
Dec 06 12:54:08 user nova-compute[75247]: DEBUG nova.network.neutron [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Port 41d8bb63-57dd-4479-9a1e-89e223d16677 binding to destination host user is already ACTIVE {{(pid=75247) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Dec 06 12:54:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "refresh_cache-b3720cc0-ff80-4ca2-8b13-d83dded593ad" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:54:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquired lock "refresh_cache-b3720cc0-ff80-4ca2-8b13-d83dded593ad" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:54:08 user nova-compute[75247]: DEBUG nova.network.neutron [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:54:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:09 user nova-compute[75247]: DEBUG nova.network.neutron [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Updating instance_info_cache with network_info: [{"id": "41d8bb63-57dd-4479-9a1e-89e223d16677", "address": "fa:16:3e:9a:8b:8a", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d8bb63-57", "ovs_interfaceid": "41d8bb63-57dd-4479-9a1e-89e223d16677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:54:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Releasing lock "refresh_cache-b3720cc0-ff80-4ca2-8b13-d83dded593ad" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:54:09 user nova-compute[75247]: DEBUG os_brick.utils [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:54:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11538ba-47a0-44a1-b5e0-c2b3e02b9a7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a07658b-0a8d-4039-bce9-32bff6e4faf3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b1ea3a-3b16-4caf-be54-ed1291d70e1d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5755f9-4952-4641-868a-b2736bbeb981]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:54:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:54:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:54:09 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:54:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb411cf3-799c-4bdd-b6a3-bbb9bc954907]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:54:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:54:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:54:09 user nova-compute[75247]: DEBUG os_brick.utils [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:54:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-9e5d7f3a-8645-4bcc-af91-1402c6bbe9d3 req-6190c1e5-5d1d-4fad-a3db-656db5bbd695 service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received event network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-9e5d7f3a-8645-4bcc-af91-1402c6bbe9d3 req-6190c1e5-5d1d-4fad-a3db-656db5bbd695 service nova] Acquiring lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-9e5d7f3a-8645-4bcc-af91-1402c6bbe9d3 req-6190c1e5-5d1d-4fad-a3db-656db5bbd695 service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-9e5d7f3a-8645-4bcc-af91-1402c6bbe9d3 req-6190c1e5-5d1d-4fad-a3db-656db5bbd695 service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-9e5d7f3a-8645-4bcc-af91-1402c6bbe9d3 req-6190c1e5-5d1d-4fad-a3db-656db5bbd695 service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] No waiting events found dispatching network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:54:10 user nova-compute[75247]: WARNING nova.compute.manager [req-9e5d7f3a-8645-4bcc-af91-1402c6bbe9d3 req-6190c1e5-5d1d-4fad-a3db-656db5bbd695 service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received unexpected event network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 for instance with vm_state rescued and task_state None.
Dec 06 12:54:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-9e5d7f3a-8645-4bcc-af91-1402c6bbe9d3 req-6190c1e5-5d1d-4fad-a3db-656db5bbd695 service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Received event network-vif-unplugged-41d8bb63-57dd-4479-9a1e-89e223d16677 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-9e5d7f3a-8645-4bcc-af91-1402c6bbe9d3 req-6190c1e5-5d1d-4fad-a3db-656db5bbd695 service nova] Acquiring lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-9e5d7f3a-8645-4bcc-af91-1402c6bbe9d3 req-6190c1e5-5d1d-4fad-a3db-656db5bbd695 service nova] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-9e5d7f3a-8645-4bcc-af91-1402c6bbe9d3 req-6190c1e5-5d1d-4fad-a3db-656db5bbd695 service nova] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-9e5d7f3a-8645-4bcc-af91-1402c6bbe9d3 req-6190c1e5-5d1d-4fad-a3db-656db5bbd695 service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] No waiting events found dispatching network-vif-unplugged-41d8bb63-57dd-4479-9a1e-89e223d16677 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:54:10 user nova-compute[75247]: WARNING nova.compute.manager [req-9e5d7f3a-8645-4bcc-af91-1402c6bbe9d3 req-6190c1e5-5d1d-4fad-a3db-656db5bbd695 service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Received unexpected event network-vif-unplugged-41d8bb63-57dd-4479-9a1e-89e223d16677 for instance with vm_state active and task_state resize_finish.
Dec 06 12:54:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-9e5d7f3a-8645-4bcc-af91-1402c6bbe9d3 req-6190c1e5-5d1d-4fad-a3db-656db5bbd695 service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Received event network-vif-plugged-41d8bb63-57dd-4479-9a1e-89e223d16677 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-9e5d7f3a-8645-4bcc-af91-1402c6bbe9d3 req-6190c1e5-5d1d-4fad-a3db-656db5bbd695 service nova] Acquiring lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-9e5d7f3a-8645-4bcc-af91-1402c6bbe9d3 req-6190c1e5-5d1d-4fad-a3db-656db5bbd695 service nova] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-9e5d7f3a-8645-4bcc-af91-1402c6bbe9d3 req-6190c1e5-5d1d-4fad-a3db-656db5bbd695 service nova] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-9e5d7f3a-8645-4bcc-af91-1402c6bbe9d3 req-6190c1e5-5d1d-4fad-a3db-656db5bbd695 service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] No waiting events found dispatching network-vif-plugged-41d8bb63-57dd-4479-9a1e-89e223d16677 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:54:10 user nova-compute[75247]: WARNING nova.compute.manager [req-9e5d7f3a-8645-4bcc-af91-1402c6bbe9d3 req-6190c1e5-5d1d-4fad-a3db-656db5bbd695 service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Received unexpected event network-vif-plugged-41d8bb63-57dd-4479-9a1e-89e223d16677 for instance with vm_state active and task_state resize_finish.
Dec 06 12:54:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Acquiring lock "7d508276-60ac-4d77-a930-bfc8b745f243" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "7d508276-60ac-4d77-a930-bfc8b745f243" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:13 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:54:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:13 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:54:13 user nova-compute[75247]: INFO nova.compute.claims [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Claim successful on node user
Dec 06 12:54:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:14 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:54:14 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:54:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.735s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:14 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:54:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:14 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:54:14 user nova-compute[75247]: DEBUG nova.network.neutron [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:54:14 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:54:14 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:54:14 user nova-compute[75247]: DEBUG nova.policy [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d662e0050774501a04828dcd6d3b63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea74e3cf3f254f0b8b6eec14ecc8c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:54:15 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:54:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:54:15 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Creating image(s)
Dec 06 12:54:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d508276-60ac-4d77-a930-bfc8b745f243/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "/opt/stack/data/nova/instances/7d508276-60ac-4d77-a930-bfc8b745f243/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "/opt/stack/data/nova/instances/7d508276-60ac-4d77-a930-bfc8b745f243/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.251s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.253s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/7d508276-60ac-4d77-a930-bfc8b745f243/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/7d508276-60ac-4d77-a930-bfc8b745f243/disk 1073741824" returned: 0 in 0.071s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:15 user nova-compute[75247]: DEBUG nova.network.neutron [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Successfully created port: 74668015-d48f-4ebb-92a1-c0603025cdae {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:54:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.200s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:15 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d508276-60ac-4d77-a930-bfc8b745f243/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:54:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d508276-60ac-4d77-a930-bfc8b745f243/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d508276-60ac-4d77-a930-bfc8b745f243/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Cannot resize image /opt/stack/data/nova/instances/7d508276-60ac-4d77-a930-bfc8b745f243/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Ensure instance console log exists: /opt/stack/data/nova/instances/7d508276-60ac-4d77-a930-bfc8b745f243/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.network.neutron [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Successfully updated port: 74668015-d48f-4ebb-92a1-c0603025cdae {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Acquiring lock "refresh_cache-7d508276-60ac-4d77-a930-bfc8b745f243" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Acquired lock "refresh_cache-7d508276-60ac-4d77-a930-bfc8b745f243" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.network.neutron [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.compute.manager [req-1671bec8-0c13-4386-acf7-4aa804daedbf req-fe1111ac-d4ae-4b30-9847-fa384dfdd03f service nova] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Received event network-changed-74668015-d48f-4ebb-92a1-c0603025cdae {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.compute.manager [req-1671bec8-0c13-4386-acf7-4aa804daedbf req-fe1111ac-d4ae-4b30-9847-fa384dfdd03f service nova] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Refreshing instance network info cache due to event network-changed-74668015-d48f-4ebb-92a1-c0603025cdae. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1671bec8-0c13-4386-acf7-4aa804daedbf req-fe1111ac-d4ae-4b30-9847-fa384dfdd03f service nova] Acquiring lock "refresh_cache-7d508276-60ac-4d77-a930-bfc8b745f243" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.network.neutron [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.network.neutron [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Updating instance_info_cache with network_info: [{"id": "74668015-d48f-4ebb-92a1-c0603025cdae", "address": "fa:16:3e:3e:cc:2c", "network": {"id": "c46a4b1b-086d-48c6-83cb-a4b88077781f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-70878896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea74e3cf3f254f0b8b6eec14ecc8c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74668015-d4", "ovs_interfaceid": "74668015-d48f-4ebb-92a1-c0603025cdae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Releasing lock "refresh_cache-7d508276-60ac-4d77-a930-bfc8b745f243" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Instance network_info: |[{"id": "74668015-d48f-4ebb-92a1-c0603025cdae", "address": "fa:16:3e:3e:cc:2c", "network": {"id": "c46a4b1b-086d-48c6-83cb-a4b88077781f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-70878896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea74e3cf3f254f0b8b6eec14ecc8c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74668015-d4", "ovs_interfaceid": "74668015-d48f-4ebb-92a1-c0603025cdae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1671bec8-0c13-4386-acf7-4aa804daedbf req-fe1111ac-d4ae-4b30-9847-fa384dfdd03f service nova] Acquired lock "refresh_cache-7d508276-60ac-4d77-a930-bfc8b745f243" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.network.neutron [req-1671bec8-0c13-4386-acf7-4aa804daedbf req-fe1111ac-d4ae-4b30-9847-fa384dfdd03f service nova] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Refreshing network info cache for port 74668015-d48f-4ebb-92a1-c0603025cdae {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Start _get_guest_xml network_info=[{"id": "74668015-d48f-4ebb-92a1-c0603025cdae", "address": "fa:16:3e:3e:cc:2c", "network": {"id": "c46a4b1b-086d-48c6-83cb-a4b88077781f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-70878896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea74e3cf3f254f0b8b6eec14ecc8c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74668015-d4", "ovs_interfaceid": "74668015-d48f-4ebb-92a1-c0603025cdae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:54:16 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:54:16 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1134137317',display_name='tempest-VolumesActionsTest-instance-1134137317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1134137317',id=34,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea74e3cf3f254f0b8b6eec14ecc8c80e',ramdisk_id='',reservation_id='r-by1q06wx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-72234739',owner_user_name='tempest-VolumesActionsTest-72234739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:54:15Z,user_data=None,user_id='7d662e0050774501a04828dcd6d3b63f',uuid=7d508276-60ac-4d77-a930-bfc8b745f243,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74668015-d48f-4ebb-92a1-c0603025cdae", "address": "fa:16:3e:3e:cc:2c", "network": {"id": "c46a4b1b-086d-48c6-83cb-a4b88077781f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-70878896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea74e3cf3f254f0b8b6eec14ecc8c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74668015-d4", "ovs_interfaceid": "74668015-d48f-4ebb-92a1-c0603025cdae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Converting VIF {"id": "74668015-d48f-4ebb-92a1-c0603025cdae", "address": "fa:16:3e:3e:cc:2c", "network": {"id": "c46a4b1b-086d-48c6-83cb-a4b88077781f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-70878896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea74e3cf3f254f0b8b6eec14ecc8c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74668015-d4", "ovs_interfaceid": "74668015-d48f-4ebb-92a1-c0603025cdae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:cc:2c,bridge_name='br-int',has_traffic_filtering=True,id=74668015-d48f-4ebb-92a1-c0603025cdae,network=Network(c46a4b1b-086d-48c6-83cb-a4b88077781f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74668015-d4') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.objects.instance [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d508276-60ac-4d77-a930-bfc8b745f243 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:54:16 user nova-compute[75247]:   <uuid>7d508276-60ac-4d77-a930-bfc8b745f243</uuid>
Dec 06 12:54:16 user nova-compute[75247]:   <name>instance-00000022</name>
Dec 06 12:54:16 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:54:16 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:54:16 user nova-compute[75247]:   <metadata>
Dec 06 12:54:16 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:54:16 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:54:16 user nova-compute[75247]:       <nova:name>tempest-VolumesActionsTest-instance-1134137317</nova:name>
Dec 06 12:54:16 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:54:16</nova:creationTime>
Dec 06 12:54:16 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:54:16 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:54:16 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:54:16 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:54:16 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:54:16 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:54:16 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:54:16 user nova-compute[75247]:       <nova:owner>
Dec 06 12:54:16 user nova-compute[75247]:         <nova:user uuid="7d662e0050774501a04828dcd6d3b63f">tempest-VolumesActionsTest-72234739-project-member</nova:user>
Dec 06 12:54:16 user nova-compute[75247]:         <nova:project uuid="ea74e3cf3f254f0b8b6eec14ecc8c80e">tempest-VolumesActionsTest-72234739</nova:project>
Dec 06 12:54:16 user nova-compute[75247]:       </nova:owner>
Dec 06 12:54:16 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:54:16 user nova-compute[75247]:       <nova:ports>
Dec 06 12:54:16 user nova-compute[75247]:         <nova:port uuid="74668015-d48f-4ebb-92a1-c0603025cdae">
Dec 06 12:54:16 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 06 12:54:16 user nova-compute[75247]:         </nova:port>
Dec 06 12:54:16 user nova-compute[75247]:       </nova:ports>
Dec 06 12:54:16 user nova-compute[75247]:     </nova:instance>
Dec 06 12:54:16 user nova-compute[75247]:   </metadata>
Dec 06 12:54:16 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:54:16 user nova-compute[75247]:     <system>
Dec 06 12:54:16 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:54:16 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:54:16 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:54:16 user nova-compute[75247]:       <entry name="serial">7d508276-60ac-4d77-a930-bfc8b745f243</entry>
Dec 06 12:54:16 user nova-compute[75247]:       <entry name="uuid">7d508276-60ac-4d77-a930-bfc8b745f243</entry>
Dec 06 12:54:16 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:54:16 user nova-compute[75247]:     </system>
Dec 06 12:54:16 user nova-compute[75247]:   </sysinfo>
Dec 06 12:54:16 user nova-compute[75247]:   <os>
Dec 06 12:54:16 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:54:16 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:54:16 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:54:16 user nova-compute[75247]:   </os>
Dec 06 12:54:16 user nova-compute[75247]:   <features>
Dec 06 12:54:16 user nova-compute[75247]:     <acpi/>
Dec 06 12:54:16 user nova-compute[75247]:     <apic/>
Dec 06 12:54:16 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:54:16 user nova-compute[75247]:   </features>
Dec 06 12:54:16 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:54:16 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:54:16 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:54:16 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:54:16 user nova-compute[75247]:   </clock>
Dec 06 12:54:16 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:54:16 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:54:16 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:54:16 user nova-compute[75247]:   </cpu>
Dec 06 12:54:16 user nova-compute[75247]:   <devices>
Dec 06 12:54:16 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:54:16 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:54:16 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/7d508276-60ac-4d77-a930-bfc8b745f243/disk"/>
Dec 06 12:54:16 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:54:16 user nova-compute[75247]:     </disk>
Dec 06 12:54:16 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:54:16 user nova-compute[75247]:       <mac address="fa:16:3e:3e:cc:2c"/>
Dec 06 12:54:16 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:54:16 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:54:16 user nova-compute[75247]:       <target dev="tap74668015-d4"/>
Dec 06 12:54:16 user nova-compute[75247]:     </interface>
Dec 06 12:54:16 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:54:16 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/7d508276-60ac-4d77-a930-bfc8b745f243/console.log" append="off"/>
Dec 06 12:54:16 user nova-compute[75247]:     </serial>
Dec 06 12:54:16 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:54:16 user nova-compute[75247]:     <video>
Dec 06 12:54:16 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:54:16 user nova-compute[75247]:     </video>
Dec 06 12:54:16 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:54:16 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:54:16 user nova-compute[75247]:     </rng>
Dec 06 12:54:16 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:54:16 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:54:16 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:54:16 user nova-compute[75247]:     </memballoon>
Dec 06 12:54:16 user nova-compute[75247]:   </devices>
Dec 06 12:54:16 user nova-compute[75247]: </domain>
Dec 06 12:54:16 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1134137317',display_name='tempest-VolumesActionsTest-instance-1134137317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1134137317',id=34,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea74e3cf3f254f0b8b6eec14ecc8c80e',ramdisk_id='',reservation_id='r-by1q06wx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-72234739',owner_user_name='tempest-VolumesActionsTest-72234739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:54:15Z,user_data=None,user_id='7d662e0050774501a04828dcd6d3b63f',uuid=7d508276-60ac-4d77-a930-bfc8b745f243,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74668015-d48f-4ebb-92a1-c0603025cdae", "address": "fa:16:3e:3e:cc:2c", "network": {"id": "c46a4b1b-086d-48c6-83cb-a4b88077781f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-70878896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea74e3cf3f254f0b8b6eec14ecc8c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74668015-d4", "ovs_interfaceid": "74668015-d48f-4ebb-92a1-c0603025cdae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Converting VIF {"id": "74668015-d48f-4ebb-92a1-c0603025cdae", "address": "fa:16:3e:3e:cc:2c", "network": {"id": "c46a4b1b-086d-48c6-83cb-a4b88077781f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-70878896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea74e3cf3f254f0b8b6eec14ecc8c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74668015-d4", "ovs_interfaceid": "74668015-d48f-4ebb-92a1-c0603025cdae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:cc:2c,bridge_name='br-int',has_traffic_filtering=True,id=74668015-d48f-4ebb-92a1-c0603025cdae,network=Network(c46a4b1b-086d-48c6-83cb-a4b88077781f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74668015-d4') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG os_vif [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:cc:2c,bridge_name='br-int',has_traffic_filtering=True,id=74668015-d48f-4ebb-92a1-c0603025cdae,network=Network(c46a4b1b-086d-48c6-83cb-a4b88077781f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74668015-d4') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44125483-dc33-5333-bc30-d89cd718c6e1', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74668015-d4, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap74668015-d4, col_values=(('qos', UUID('85529a5b-313b-45f4-a7d4-c3ed054c0d8e')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap74668015-d4, col_values=(('external_ids', {'iface-id': '74668015-d48f-4ebb-92a1-c0603025cdae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:cc:2c', 'vm-uuid': '7d508276-60ac-4d77-a930-bfc8b745f243'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:16 user nova-compute[75247]: INFO os_vif [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:cc:2c,bridge_name='br-int',has_traffic_filtering=True,id=74668015-d48f-4ebb-92a1-c0603025cdae,network=Network(c46a4b1b-086d-48c6-83cb-a4b88077781f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74668015-d4')
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:54:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] No VIF found with MAC fa:16:3e:3e:cc:2c, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:54:17 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:54:17 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:54:17 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 12:54:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-782289e2-91cd-4aee-9a08-eadfb2a5965b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:54:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-782289e2-91cd-4aee-9a08-eadfb2a5965b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:54:17 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 12:54:17 user nova-compute[75247]: DEBUG nova.network.neutron [req-1671bec8-0c13-4386-acf7-4aa804daedbf req-fe1111ac-d4ae-4b30-9847-fa384dfdd03f service nova] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Updated VIF entry in instance network info cache for port 74668015-d48f-4ebb-92a1-c0603025cdae. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:54:17 user nova-compute[75247]: DEBUG nova.network.neutron [req-1671bec8-0c13-4386-acf7-4aa804daedbf req-fe1111ac-d4ae-4b30-9847-fa384dfdd03f service nova] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Updating instance_info_cache with network_info: [{"id": "74668015-d48f-4ebb-92a1-c0603025cdae", "address": "fa:16:3e:3e:cc:2c", "network": {"id": "c46a4b1b-086d-48c6-83cb-a4b88077781f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-70878896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea74e3cf3f254f0b8b6eec14ecc8c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74668015-d4", "ovs_interfaceid": "74668015-d48f-4ebb-92a1-c0603025cdae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:54:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1671bec8-0c13-4386-acf7-4aa804daedbf req-fe1111ac-d4ae-4b30-9847-fa384dfdd03f service nova] Releasing lock "refresh_cache-7d508276-60ac-4d77-a930-bfc8b745f243" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:54:17 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Updating instance_info_cache with network_info: [{"id": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "address": "fa:16:3e:e4:cb:02", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924c627-a1", "ovs_interfaceid": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:54:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-782289e2-91cd-4aee-9a08-eadfb2a5965b" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:54:17 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 12:54:17 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:54:17 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:54:17 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:54:17 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:54:17 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:54:17 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 12:54:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:18 user nova-compute[75247]: DEBUG nova.compute.manager [req-8f734ee3-39da-4ce8-8206-011823ebfdaa req-239d202b-eb8a-4045-9d2b-c7a110278748 service nova] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Received event network-vif-plugged-74668015-d48f-4ebb-92a1-c0603025cdae {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-8f734ee3-39da-4ce8-8206-011823ebfdaa req-239d202b-eb8a-4045-9d2b-c7a110278748 service nova] Acquiring lock "7d508276-60ac-4d77-a930-bfc8b745f243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-8f734ee3-39da-4ce8-8206-011823ebfdaa req-239d202b-eb8a-4045-9d2b-c7a110278748 service nova] Lock "7d508276-60ac-4d77-a930-bfc8b745f243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-8f734ee3-39da-4ce8-8206-011823ebfdaa req-239d202b-eb8a-4045-9d2b-c7a110278748 service nova] Lock "7d508276-60ac-4d77-a930-bfc8b745f243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:18 user nova-compute[75247]: DEBUG nova.compute.manager [req-8f734ee3-39da-4ce8-8206-011823ebfdaa req-239d202b-eb8a-4045-9d2b-c7a110278748 service nova] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] No waiting events found dispatching network-vif-plugged-74668015-d48f-4ebb-92a1-c0603025cdae {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:54:18 user nova-compute[75247]: WARNING nova.compute.manager [req-8f734ee3-39da-4ce8-8206-011823ebfdaa req-239d202b-eb8a-4045-9d2b-c7a110278748 service nova] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Received unexpected event network-vif-plugged-74668015-d48f-4ebb-92a1-c0603025cdae for instance with vm_state building and task_state spawning.
Dec 06 12:54:18 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:54:18 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:54:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:18 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 12:54:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d508276-60ac-4d77-a930-bfc8b745f243/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d508276-60ac-4d77-a930-bfc8b745f243/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d508276-60ac-4d77-a930-bfc8b745f243/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d508276-60ac-4d77-a930-bfc8b745f243/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-2e1bef3e-8153-4bcf-aa52-b6bcb7dea2db req-521dc7d3-67a7-4e3d-ae2d-c4da46439fa7 service nova] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Received event network-vif-plugged-74668015-d48f-4ebb-92a1-c0603025cdae {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2e1bef3e-8153-4bcf-aa52-b6bcb7dea2db req-521dc7d3-67a7-4e3d-ae2d-c4da46439fa7 service nova] Acquiring lock "7d508276-60ac-4d77-a930-bfc8b745f243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2e1bef3e-8153-4bcf-aa52-b6bcb7dea2db req-521dc7d3-67a7-4e3d-ae2d-c4da46439fa7 service nova] Lock "7d508276-60ac-4d77-a930-bfc8b745f243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2e1bef3e-8153-4bcf-aa52-b6bcb7dea2db req-521dc7d3-67a7-4e3d-ae2d-c4da46439fa7 service nova] Lock "7d508276-60ac-4d77-a930-bfc8b745f243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-2e1bef3e-8153-4bcf-aa52-b6bcb7dea2db req-521dc7d3-67a7-4e3d-ae2d-c4da46439fa7 service nova] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] No waiting events found dispatching network-vif-plugged-74668015-d48f-4ebb-92a1-c0603025cdae {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:54:20 user nova-compute[75247]: WARNING nova.compute.manager [req-2e1bef3e-8153-4bcf-aa52-b6bcb7dea2db req-521dc7d3-67a7-4e3d-ae2d-c4da46439fa7 service nova] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Received unexpected event network-vif-plugged-74668015-d48f-4ebb-92a1-c0603025cdae for instance with vm_state building and task_state spawning.
Dec 06 12:54:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:20 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:54:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:54:21 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Instance spawned successfully.
Dec 06 12:54:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:54:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:54:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:54:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:54:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:54:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:54:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:54:21 user nova-compute[75247]: INFO nova.compute.manager [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Took 6.39 seconds to spawn the instance on the hypervisor.
Dec 06 12:54:21 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:54:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:21 user nova-compute[75247]: INFO nova.compute.manager [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Took 7.64 seconds to build instance.
Dec 06 12:54:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ca6b4873-1fcb-4336-9a79-e9c4ca9b7555 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "7d508276-60ac-4d77-a930-bfc8b745f243" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.780s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d767ae1-4df2-4e87-b991-729fabd467f8/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Starting finish_migration {{(pid=75247) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11677}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Instance directory exists: not creating {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 06 12:54:22 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Creating image(s)
Dec 06 12:54:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Did not create local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Ensure instance console log exists: /opt/stack/data/nova/instances/b3720cc0-ff80-4ca2-8b13-d83dded593ad/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Start _get_guest_xml network_info=[{"id": "41d8bb63-57dd-4479-9a1e-89e223d16677", "address": "fa:16:3e:9a:8b:8a", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2059292391-network", "vif_mac": "fa:16:3e:9a:8b:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d8bb63-57", "ovs_interfaceid": "41d8bb63-57dd-4479-9a1e-89e223d16677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '4c01d23e-8ed3-4802-b769-5d2dd2a5a805', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmYCPVNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b3720cc0-ff80-4ca2-8b13-d83dded593ad', 'attached_at': '2023-12-06T12:54:22.000000', 'detached_at': '', 'volume_id': '7ce8f69d-d096-4c5d-ae72-af142a835d31', 'serial': '7ce8f69d-d096-4c5d-ae72-af142a835d31'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d767ae1-4df2-4e87-b991-729fabd467f8/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d767ae1-4df2-4e87-b991-729fabd467f8/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:22 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:54:22 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:54:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmYCPVNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:54:22 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:54:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:54:22 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:54:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:54:22 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260" returned: 21 in 0.038s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdf062b-93f0-400b-841c-29929a90086b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:54:22 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[745e4595-8cd6-430a-9141-c6f3a504713f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31] added
Dec 06 12:54:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54f9497-90d9-4646-8cce-b868b8d812c8]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d767ae1-4df2-4e87-b991-729fabd467f8/disk.rescue --force-share --output=json" returned: 0 in 0.248s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7090ab44-a377-4de5-b161-32509c38746b]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jmYCPVNh {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jmYCPVNh" returned: 0 in 0.029s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef25bc4-658b-416f-ab8c-4f49615ed021]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jmYCPVNh'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8e651d-2458-428d-83d4-5d32cc57f799]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1424db-a284-430f-b0e1-cfabd6a8839c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:54:22 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:54:22 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:54:22 user nova-compute[75247]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 (non-flash)
Dec 06 12:54:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:54:22 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:54:22 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:54:22 user nova-compute[75247]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 (non-flash)
Dec 06 12:54:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0812af-7274-4e36-ad32-d8f603bdffd5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31, portal: 172.16.0.220,3260]
Dec 06 12:54:22 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31, portal: 172.16.0.220,3260] successful.
Dec 06 12:54:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef1f92d-462b-40c7-b54d-9acdb1180c84]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b5d00d-047b-4135-a1d4-31c6bee664d4]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:54:22 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:54:22 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:54:22 user nova-compute[75247]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 (non-flash)
Dec 06 12:54:22 user nova-compute[75247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:54:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:54:22 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:54:22 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:54:22 user nova-compute[75247]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 (non-flash)
Dec 06 12:54:22 user nova-compute[75247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:54:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.430s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.028s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[07baa499-8419-447e-b3d8-582b649ad7b0]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmYCPVNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7f8114-2e5d-4bf6-bb31-b00666f0d901/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7f8114-2e5d-4bf6-bb31-b00666f0d901/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7f8114-2e5d-4bf6-bb31-b00666f0d901/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7f8114-2e5d-4bf6-bb31-b00666f0d901/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.481s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] <== connect_volume: return (1485ms) {'type': 'block', 'scsi_wwn': '26530663838663662', 'path': '/dev/sdc'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530663838663662', 'path': '/dev/sdc'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:52:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1873472062',display_name='tempest-ServerActionsTestOtherA-server-1873472062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1873472062',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1PSIn5waVLUBUVXmci26Bjo3OHYSVHL8/oxs3uvNoObvAgLe5HgiP5u61wX8nEvgm8XgeBjcCfcP/HNC/vep9hMtkBYH/Pz/i1rF8IkHYEtoKU1LHCX3Qi/2pvpu4Reg==',key_name='tempest-keypair-1071092699',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:52:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a0ccf15765714ca2a8c4700d2d6e3ed2',ramdisk_id='',reservation_id='r-80mdy70u',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2075667053',owner_user_name='tempest-ServerActionsTestOtherA-2075667053-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:54:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13843d8f074da189dbd3e93750b811',uuid=b3720cc0-ff80-4ca2-8b13-d83dded593ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41d8bb63-57dd-4479-9a1e-89e223d16677", "address": "fa:16:3e:9a:8b:8a", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2059292391-network", "vif_mac": "fa:16:3e:9a:8b:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d8bb63-57", "ovs_interfaceid": "41d8bb63-57dd-4479-9a1e-89e223d16677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converting VIF {"id": "41d8bb63-57dd-4479-9a1e-89e223d16677", "address": "fa:16:3e:9a:8b:8a", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2059292391-network", "vif_mac": "fa:16:3e:9a:8b:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d8bb63-57", "ovs_interfaceid": "41d8bb63-57dd-4479-9a1e-89e223d16677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:8b:8a,bridge_name='br-int',has_traffic_filtering=True,id=41d8bb63-57dd-4479-9a1e-89e223d16677,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d8bb63-57') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:54:23 user nova-compute[75247]:   <uuid>b3720cc0-ff80-4ca2-8b13-d83dded593ad</uuid>
Dec 06 12:54:23 user nova-compute[75247]:   <name>instance-00000020</name>
Dec 06 12:54:23 user nova-compute[75247]:   <memory>2097152</memory>
Dec 06 12:54:23 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:54:23 user nova-compute[75247]:   <metadata>
Dec 06 12:54:23 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:54:23 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:54:23 user nova-compute[75247]:       <nova:name>tempest-ServerActionsTestOtherA-server-1873472062</nova:name>
Dec 06 12:54:23 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:54:22</nova:creationTime>
Dec 06 12:54:23 user nova-compute[75247]:       <nova:flavor name="m1.small">
Dec 06 12:54:23 user nova-compute[75247]:         <nova:memory>2048</nova:memory>
Dec 06 12:54:23 user nova-compute[75247]:         <nova:disk>20</nova:disk>
Dec 06 12:54:23 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:54:23 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:54:23 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:54:23 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:54:23 user nova-compute[75247]:       <nova:owner>
Dec 06 12:54:23 user nova-compute[75247]:         <nova:user uuid="fc13843d8f074da189dbd3e93750b811">tempest-ServerActionsTestOtherA-2075667053-project-member</nova:user>
Dec 06 12:54:23 user nova-compute[75247]:         <nova:project uuid="a0ccf15765714ca2a8c4700d2d6e3ed2">tempest-ServerActionsTestOtherA-2075667053</nova:project>
Dec 06 12:54:23 user nova-compute[75247]:       </nova:owner>
Dec 06 12:54:23 user nova-compute[75247]:       <nova:ports>
Dec 06 12:54:23 user nova-compute[75247]:         <nova:port uuid="41d8bb63-57dd-4479-9a1e-89e223d16677">
Dec 06 12:54:23 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 06 12:54:23 user nova-compute[75247]:         </nova:port>
Dec 06 12:54:23 user nova-compute[75247]:       </nova:ports>
Dec 06 12:54:23 user nova-compute[75247]:     </nova:instance>
Dec 06 12:54:23 user nova-compute[75247]:   </metadata>
Dec 06 12:54:23 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:54:23 user nova-compute[75247]:     <system>
Dec 06 12:54:23 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:54:23 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:54:23 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:54:23 user nova-compute[75247]:       <entry name="serial">b3720cc0-ff80-4ca2-8b13-d83dded593ad</entry>
Dec 06 12:54:23 user nova-compute[75247]:       <entry name="uuid">b3720cc0-ff80-4ca2-8b13-d83dded593ad</entry>
Dec 06 12:54:23 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:54:23 user nova-compute[75247]:     </system>
Dec 06 12:54:23 user nova-compute[75247]:   </sysinfo>
Dec 06 12:54:23 user nova-compute[75247]:   <os>
Dec 06 12:54:23 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:54:23 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:54:23 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:54:23 user nova-compute[75247]:   </os>
Dec 06 12:54:23 user nova-compute[75247]:   <features>
Dec 06 12:54:23 user nova-compute[75247]:     <acpi/>
Dec 06 12:54:23 user nova-compute[75247]:     <apic/>
Dec 06 12:54:23 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:54:23 user nova-compute[75247]:   </features>
Dec 06 12:54:23 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:54:23 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:54:23 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:54:23 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:54:23 user nova-compute[75247]:   </clock>
Dec 06 12:54:23 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:54:23 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:54:23 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:54:23 user nova-compute[75247]:   </cpu>
Dec 06 12:54:23 user nova-compute[75247]:   <devices>
Dec 06 12:54:23 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 12:54:23 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:54:23 user nova-compute[75247]:       <source dev="/dev/sdc"/>
Dec 06 12:54:23 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:54:23 user nova-compute[75247]:       <serial>7ce8f69d-d096-4c5d-ae72-af142a835d31</serial>
Dec 06 12:54:23 user nova-compute[75247]:     </disk>
Dec 06 12:54:23 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:54:23 user nova-compute[75247]:       <mac address="fa:16:3e:9a:8b:8a"/>
Dec 06 12:54:23 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:54:23 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:54:23 user nova-compute[75247]:       <target dev="tap41d8bb63-57"/>
Dec 06 12:54:23 user nova-compute[75247]:     </interface>
Dec 06 12:54:23 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:54:23 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/b3720cc0-ff80-4ca2-8b13-d83dded593ad/console.log" append="off"/>
Dec 06 12:54:23 user nova-compute[75247]:     </serial>
Dec 06 12:54:23 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:54:23 user nova-compute[75247]:     <video>
Dec 06 12:54:23 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:54:23 user nova-compute[75247]:     </video>
Dec 06 12:54:23 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:54:23 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:54:23 user nova-compute[75247]:     </rng>
Dec 06 12:54:23 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:54:23 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:54:23 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:54:23 user nova-compute[75247]:     </memballoon>
Dec 06 12:54:23 user nova-compute[75247]:   </devices>
Dec 06 12:54:23 user nova-compute[75247]: </domain>
Dec 06 12:54:23 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:52:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1873472062',display_name='tempest-ServerActionsTestOtherA-server-1873472062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1873472062',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1PSIn5waVLUBUVXmci26Bjo3OHYSVHL8/oxs3uvNoObvAgLe5HgiP5u61wX8nEvgm8XgeBjcCfcP/HNC/vep9hMtkBYH/Pz/i1rF8IkHYEtoKU1LHCX3Qi/2pvpu4Reg==',key_name='tempest-keypair-1071092699',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:52:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a0ccf15765714ca2a8c4700d2d6e3ed2',ramdisk_id='',reservation_id='r-80mdy70u',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2075667053',owner_user_name='tempest-ServerActionsTestOtherA-2075667053-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:54:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13843d8f074da189dbd3e93750b811',uuid=b3720cc0-ff80-4ca2-8b13-d83dded593ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41d8bb63-57dd-4479-9a1e-89e223d16677", "address": "fa:16:3e:9a:8b:8a", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2059292391-network", "vif_mac": "fa:16:3e:9a:8b:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d8bb63-57", "ovs_interfaceid": "41d8bb63-57dd-4479-9a1e-89e223d16677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converting VIF {"id": "41d8bb63-57dd-4479-9a1e-89e223d16677", "address": "fa:16:3e:9a:8b:8a", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2059292391-network", "vif_mac": "fa:16:3e:9a:8b:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d8bb63-57", "ovs_interfaceid": "41d8bb63-57dd-4479-9a1e-89e223d16677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:8b:8a,bridge_name='br-int',has_traffic_filtering=True,id=41d8bb63-57dd-4479-9a1e-89e223d16677,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d8bb63-57') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG os_vif [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:8b:8a,bridge_name='br-int',has_traffic_filtering=True,id=41d8bb63-57dd-4479-9a1e-89e223d16677,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d8bb63-57') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4cb8e765-fa8f-5ae8-946b-73de4f03f707', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41d8bb63-57, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41d8bb63-57, col_values=(('qos', UUID('4a2b0d02-32de-477b-97e9-082a6785da99')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41d8bb63-57, col_values=(('external_ids', {'iface-id': '41d8bb63-57dd-4479-9a1e-89e223d16677', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:8b:8a', 'vm-uuid': 'b3720cc0-ff80-4ca2-8b13-d83dded593ad'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:54:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:24 user nova-compute[75247]: INFO os_vif [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:8b:8a,bridge_name='br-int',has_traffic_filtering=True,id=41d8bb63-57dd-4479-9a1e-89e223d16677,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d8bb63-57')
Dec 06 12:54:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:54:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] No VIF found with MAC fa:16:3e:9a:8b:8a, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:54:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:54:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:54:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:54:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Acquiring lock "c603d6dc-804e-4c0d-be1f-40e09de74e8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "c603d6dc-804e-4c0d-be1f-40e09de74e8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:26 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:54:28 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 0e7f8114-2e5d-4bf6-bb31-b00666f0d901 is timed out.
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.compute.manager [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:54:28 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Successfully detached device vdc from instance 0e7f8114-2e5d-4bf6-bb31-b00666f0d901 from the live domain config.
Dec 06 12:54:28 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Instance running successfully.
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RiLetyHw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:54:28 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:54:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:54:28 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:54:28 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=7381MB free_disk=24.904064178466797GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Failed to set time: agent not configured {{(pid=75247) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1e1151cb-fae6-403d-b3cc-26610a48338f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] finish_migration finished successfully. {{(pid=75247) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11772}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6287461-b695-49e3-bd33-ad418b9c58ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:54:28 user nova-compute[75247]: No targets found.
Dec 06 12:54:28 user nova-compute[75247]: iSNS:
Dec 06 12:54:28 user nova-compute[75247]: No targets found.
Dec 06 12:54:28 user nova-compute[75247]: STATIC:
Dec 06 12:54:28 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd
Dec 06 12:54:28 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:54:28 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:54:28 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:54:28 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:54:28 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:54:28 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6
Dec 06 12:54:28 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:54:28 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:54:28 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33
Dec 06 12:54:28 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:54:28 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:54:28 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31
Dec 06 12:54:28 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:54:28 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:54:28 user nova-compute[75247]: FIRMWARE:
Dec 06 12:54:28 user nova-compute[75247]: No targets found.
Dec 06 12:54:28 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:54:28 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:54:28 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a4491c-aba5-40a1-9c75-81e1402cb9c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[834095f9-dd28-42c1-bc6e-d5c6d3fe0983]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:54:28 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:54:28 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:54:28 user nova-compute[75247]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 (non-flash)
Dec 06 12:54:28 user nova-compute[75247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:54:28 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:54:28 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:54:28 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:54:28 user nova-compute[75247]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 (non-flash)
Dec 06 12:54:28 user nova-compute[75247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:54:28 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c645fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6'): ({'sdg'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Removing single pathed devices sdg {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9371ca78-3996-47b9-871b-679f96a1c5bb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ca32d9-4782-4e10-9770-6e9873ad5bc0]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Flushing IO for device /dev/sdg {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Applying migration context for instance b3720cc0-ff80-4ca2-8b13-d83dded593ad as it has an incoming, in-progress migration a28e36c3-e15d-45e3-9f84-3ac928105559. Migration status is finished {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 06 12:54:28 user nova-compute[75247]: INFO nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Updating resource usage from migration a28e36c3-e15d-45e3-9f84-3ac928105559
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0841bc-16cb-4527-9fb0-d30ee6bfccc0]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2fd73b-2184-4e25-a6dc-82e7a22b12cc]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] SCSI volumes sdg have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 70c4664e-ae7a-47de-bba7-18300391d209 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 782289e2-91cd-4aee-9a08-eadfb2a5965b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 3e1b5197-dc38-48a5-b9f9-e053be499433 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance bc3ddb40-b05f-4170-b269-d44dec6ecdaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 530cfb75-7aa8-4e57-b282-8f7a21401b34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 92d215fd-8411-430c-b91e-b6e62e02a994 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 0e7f8114-2e5d-4bf6-bb31-b00666f0d901 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 6d767ae1-4df2-4e87-b991-729fabd467f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance f5b69324-579d-4833-9bb4-c43c511f820d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Migration a28e36c3-e15d-45e3-9f84-3ac928105559 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1712}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance b3720cc0-ff80-4ca2-8b13-d83dded593ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 7d508276-60ac-4d77-a930-bfc8b745f243 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.041s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97b90d1-7cc6-4acc-b655-97286674bcb9]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance c603d6dc-804e-4c0d-be1f-40e09de74e8a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1764}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0301692f-eebf-4e37-86a1-070d08a79548]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6, portal: 172.16.0.220,3260]
Dec 06 12:54:28 user nova-compute[75247]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6, portal: 172.16.0.220,3260] successful.
Dec 06 12:54:28 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e60d9f-2968-4c23-85e4-3c59d1d206e6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad8cea8-407f-4546-b664-c9b9583113b9]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] <== disconnect_volume: return (407ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.785s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.755s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:28 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:54:28 user nova-compute[75247]: INFO nova.compute.claims [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Claim successful on node user
Dec 06 12:54:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:29 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:54:29 user nova-compute[75247]: DEBUG nova.objects.instance [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'flavor' on Instance uuid 0e7f8114-2e5d-4bf6-bb31-b00666f0d901 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:54:29 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:54:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-59a31942-89b7-4596-8034-5c0b5f0409ca tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.630s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.620s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:29 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:54:29 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:54:29 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:54:29 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:54:29 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:54:29 user nova-compute[75247]: DEBUG nova.policy [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9462e4a57abb48f88f022c3486304df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c750eec93d4bfb9f7d61b6445d9e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:54:29 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:54:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:54:29 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Creating image(s)
Dec 06 12:54:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Acquiring lock "/opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "/opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "/opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:29 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:54:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.219s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG nova.compute.manager [req-4b05bd82-44fe-4bbc-afc2-1dd2746f0f6c req-81ab91b2-8e99-45a5-88fe-120f46c5c26a service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Received event network-vif-plugged-41d8bb63-57dd-4479-9a1e-89e223d16677 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4b05bd82-44fe-4bbc-afc2-1dd2746f0f6c req-81ab91b2-8e99-45a5-88fe-120f46c5c26a service nova] Acquiring lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4b05bd82-44fe-4bbc-afc2-1dd2746f0f6c req-81ab91b2-8e99-45a5-88fe-120f46c5c26a service nova] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4b05bd82-44fe-4bbc-afc2-1dd2746f0f6c req-81ab91b2-8e99-45a5-88fe-120f46c5c26a service nova] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG nova.compute.manager [req-4b05bd82-44fe-4bbc-afc2-1dd2746f0f6c req-81ab91b2-8e99-45a5-88fe-120f46c5c26a service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] No waiting events found dispatching network-vif-plugged-41d8bb63-57dd-4479-9a1e-89e223d16677 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:54:30 user nova-compute[75247]: WARNING nova.compute.manager [req-4b05bd82-44fe-4bbc-afc2-1dd2746f0f6c req-81ab91b2-8e99-45a5-88fe-120f46c5c26a service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Received unexpected event network-vif-plugged-41d8bb63-57dd-4479-9a1e-89e223d16677 for instance with vm_state resized and task_state None.
Dec 06 12:54:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.248s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk 1073741824" returned: 0 in 0.074s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Successfully created port: 96cf8894-1e05-412d-a5f2-6df6a6bd2f6f {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.241s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-faf23a04-1bea-4787-9284-7f2f107e1e3b tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-faf23a04-1bea-4787-9284-7f2f107e1e3b tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-faf23a04-1bea-4787-9284-7f2f107e1e3b tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-faf23a04-1bea-4787-9284-7f2f107e1e3b tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-faf23a04-1bea-4787-9284-7f2f107e1e3b tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:30 user nova-compute[75247]: INFO nova.compute.manager [None req-faf23a04-1bea-4787-9284-7f2f107e1e3b tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Terminating instance
Dec 06 12:54:30 user nova-compute[75247]: DEBUG nova.compute.manager [None req-faf23a04-1bea-4787-9284-7f2f107e1e3b tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Cannot resize image /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Ensure instance console log exists: /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.compute.manager [req-b4b858de-0105-49a3-a605-5b8a8d3ff5eb req-aed67cda-e236-4c9f-9db5-a84c867b774d service nova] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Received event network-vif-unplugged-8a76a9ce-2bbc-4989-9fcb-66cce8adf16b {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b4b858de-0105-49a3-a605-5b8a8d3ff5eb req-aed67cda-e236-4c9f-9db5-a84c867b774d service nova] Acquiring lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b4b858de-0105-49a3-a605-5b8a8d3ff5eb req-aed67cda-e236-4c9f-9db5-a84c867b774d service nova] Lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b4b858de-0105-49a3-a605-5b8a8d3ff5eb req-aed67cda-e236-4c9f-9db5-a84c867b774d service nova] Lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.compute.manager [req-b4b858de-0105-49a3-a605-5b8a8d3ff5eb req-aed67cda-e236-4c9f-9db5-a84c867b774d service nova] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] No waiting events found dispatching network-vif-unplugged-8a76a9ce-2bbc-4989-9fcb-66cce8adf16b {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.compute.manager [req-b4b858de-0105-49a3-a605-5b8a8d3ff5eb req-aed67cda-e236-4c9f-9db5-a84c867b774d service nova] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Received event network-vif-unplugged-8a76a9ce-2bbc-4989-9fcb-66cce8adf16b for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Successfully updated port: 96cf8894-1e05-412d-a5f2-6df6a6bd2f6f {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Acquiring lock "refresh_cache-c603d6dc-804e-4c0d-be1f-40e09de74e8a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Acquired lock "refresh_cache-c603d6dc-804e-4c0d-be1f-40e09de74e8a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.compute.manager [req-394dd863-4a78-4acb-9cd0-741e04285670 req-c08b3c6f-a57a-41be-a7ab-d3d1a5cc874e service nova] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Received event network-changed-96cf8894-1e05-412d-a5f2-6df6a6bd2f6f {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.compute.manager [req-394dd863-4a78-4acb-9cd0-741e04285670 req-c08b3c6f-a57a-41be-a7ab-d3d1a5cc874e service nova] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Refreshing instance network info cache due to event network-changed-96cf8894-1e05-412d-a5f2-6df6a6bd2f6f. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-394dd863-4a78-4acb-9cd0-741e04285670 req-c08b3c6f-a57a-41be-a7ab-d3d1a5cc874e service nova] Acquiring lock "refresh_cache-c603d6dc-804e-4c0d-be1f-40e09de74e8a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:54:31 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Instance destroyed successfully.
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.objects.instance [None req-faf23a04-1bea-4787-9284-7f2f107e1e3b tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lazy-loading 'resources' on Instance uuid 0e7f8114-2e5d-4bf6-bb31-b00666f0d901 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-faf23a04-1bea-4787-9284-7f2f107e1e3b tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:51:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1435568381',display_name='tempest-AttachVolumeTestJSON-server-1435568381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1435568381',id=30,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeC3Lxqos3L/j7GsxbWERod31gMNYOh1WvDp2eLcoFHCmccbaJ0Azy260YTcypWiKfWA/hNruUSMbgPcCcPBaCDpII0NLAW1z4+pb8a4RbrKEPhWaImdiv7EkBwvVj0CQ==',key_name='tempest-keypair-1203396339',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:51:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f3aeaf6ffdb4cc0807d90e73e92fa7e',ramdisk_id='',reservation_id='r-5wriy0n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-209684424',owner_user_name='tempest-AttachVolumeTestJSON-209684424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:51:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cb0e32ba6094d1e8053787bc1979b65',uuid=0e7f8114-2e5d-4bf6-bb31-b00666f0d901,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a76a9ce-2bbc-4989-9fcb-66cce8adf16b", "address": "fa:16:3e:67:2a:53", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a76a9ce-2b", "ovs_interfaceid": "8a76a9ce-2bbc-4989-9fcb-66cce8adf16b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-faf23a04-1bea-4787-9284-7f2f107e1e3b tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Converting VIF {"id": "8a76a9ce-2bbc-4989-9fcb-66cce8adf16b", "address": "fa:16:3e:67:2a:53", "network": {"id": "becaa1c0-6fcb-4053-919f-08bdb2990835", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-441497359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3aeaf6ffdb4cc0807d90e73e92fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a76a9ce-2b", "ovs_interfaceid": "8a76a9ce-2bbc-4989-9fcb-66cce8adf16b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-faf23a04-1bea-4787-9284-7f2f107e1e3b tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:2a:53,bridge_name='br-int',has_traffic_filtering=True,id=8a76a9ce-2bbc-4989-9fcb-66cce8adf16b,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a76a9ce-2b') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG os_vif [None req-faf23a04-1bea-4787-9284-7f2f107e1e3b tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:2a:53,bridge_name='br-int',has_traffic_filtering=True,id=8a76a9ce-2bbc-4989-9fcb-66cce8adf16b,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a76a9ce-2b') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a76a9ce-2b, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83bba9e6-8d3d-46ae-a83c-b583f5b662a3) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:31 user nova-compute[75247]: INFO os_vif [None req-faf23a04-1bea-4787-9284-7f2f107e1e3b tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:2a:53,bridge_name='br-int',has_traffic_filtering=True,id=8a76a9ce-2bbc-4989-9fcb-66cce8adf16b,network=Network(becaa1c0-6fcb-4053-919f-08bdb2990835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a76a9ce-2b')
Dec 06 12:54:31 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-faf23a04-1bea-4787-9284-7f2f107e1e3b tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Deleting instance files /opt/stack/data/nova/instances/0e7f8114-2e5d-4bf6-bb31-b00666f0d901_del
Dec 06 12:54:31 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-faf23a04-1bea-4787-9284-7f2f107e1e3b tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Deletion of /opt/stack/data/nova/instances/0e7f8114-2e5d-4bf6-bb31-b00666f0d901_del complete
Dec 06 12:54:31 user nova-compute[75247]: INFO nova.compute.manager [None req-faf23a04-1bea-4787-9284-7f2f107e1e3b tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Took 0.96 seconds to destroy the instance on the hypervisor.
Dec 06 12:54:31 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-faf23a04-1bea-4787-9284-7f2f107e1e3b tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Updating instance_info_cache with network_info: [{"id": "96cf8894-1e05-412d-a5f2-6df6a6bd2f6f", "address": "fa:16:3e:6c:dd:e2", "network": {"id": "8691a7c7-5761-40a7-962e-880f95352b9a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-919731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8c750eec93d4bfb9f7d61b6445d9e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96cf8894-1e", "ovs_interfaceid": "96cf8894-1e05-412d-a5f2-6df6a6bd2f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Releasing lock "refresh_cache-c603d6dc-804e-4c0d-be1f-40e09de74e8a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Instance network_info: |[{"id": "96cf8894-1e05-412d-a5f2-6df6a6bd2f6f", "address": "fa:16:3e:6c:dd:e2", "network": {"id": "8691a7c7-5761-40a7-962e-880f95352b9a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-919731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8c750eec93d4bfb9f7d61b6445d9e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96cf8894-1e", "ovs_interfaceid": "96cf8894-1e05-412d-a5f2-6df6a6bd2f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-394dd863-4a78-4acb-9cd0-741e04285670 req-c08b3c6f-a57a-41be-a7ab-d3d1a5cc874e service nova] Acquired lock "refresh_cache-c603d6dc-804e-4c0d-be1f-40e09de74e8a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.network.neutron [req-394dd863-4a78-4acb-9cd0-741e04285670 req-c08b3c6f-a57a-41be-a7ab-d3d1a5cc874e service nova] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Refreshing network info cache for port 96cf8894-1e05-412d-a5f2-6df6a6bd2f6f {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Start _get_guest_xml network_info=[{"id": "96cf8894-1e05-412d-a5f2-6df6a6bd2f6f", "address": "fa:16:3e:6c:dd:e2", "network": {"id": "8691a7c7-5761-40a7-962e-880f95352b9a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-919731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8c750eec93d4bfb9f7d61b6445d9e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96cf8894-1e", "ovs_interfaceid": "96cf8894-1e05-412d-a5f2-6df6a6bd2f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:54:31 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:54:31 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:54:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1965887220',display_name='tempest-ServersNegativeTestJSON-server-1965887220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1965887220',id=35,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8c750eec93d4bfb9f7d61b6445d9e42',ramdisk_id='',reservation_id='r-gl3qj2kb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-521653173',owner_user_name='tempest-ServersNegativeTestJSON-521653173-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:54:30Z,user_data=None,user_id='9462e4a57abb48f88f022c3486304df1',uuid=c603d6dc-804e-4c0d-be1f-40e09de74e8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96cf8894-1e05-412d-a5f2-6df6a6bd2f6f", "address": "fa:16:3e:6c:dd:e2", "network": {"id": "8691a7c7-5761-40a7-962e-880f95352b9a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-919731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8c750eec93d4bfb9f7d61b6445d9e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96cf8894-1e", "ovs_interfaceid": "96cf8894-1e05-412d-a5f2-6df6a6bd2f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Converting VIF {"id": "96cf8894-1e05-412d-a5f2-6df6a6bd2f6f", "address": "fa:16:3e:6c:dd:e2", "network": {"id": "8691a7c7-5761-40a7-962e-880f95352b9a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-919731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8c750eec93d4bfb9f7d61b6445d9e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96cf8894-1e", "ovs_interfaceid": "96cf8894-1e05-412d-a5f2-6df6a6bd2f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:dd:e2,bridge_name='br-int',has_traffic_filtering=True,id=96cf8894-1e05-412d-a5f2-6df6a6bd2f6f,network=Network(8691a7c7-5761-40a7-962e-880f95352b9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96cf8894-1e') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lazy-loading 'pci_devices' on Instance uuid c603d6dc-804e-4c0d-be1f-40e09de74e8a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:54:31 user nova-compute[75247]:   <uuid>c603d6dc-804e-4c0d-be1f-40e09de74e8a</uuid>
Dec 06 12:54:31 user nova-compute[75247]:   <name>instance-00000023</name>
Dec 06 12:54:31 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:54:31 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:54:31 user nova-compute[75247]:   <metadata>
Dec 06 12:54:31 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:54:31 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:54:31 user nova-compute[75247]:       <nova:name>tempest-ServersNegativeTestJSON-server-1965887220</nova:name>
Dec 06 12:54:31 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:54:31</nova:creationTime>
Dec 06 12:54:31 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:54:31 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:54:31 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:54:31 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:54:31 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:54:31 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:54:31 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:54:31 user nova-compute[75247]:       <nova:owner>
Dec 06 12:54:31 user nova-compute[75247]:         <nova:user uuid="9462e4a57abb48f88f022c3486304df1">tempest-ServersNegativeTestJSON-521653173-project-member</nova:user>
Dec 06 12:54:31 user nova-compute[75247]:         <nova:project uuid="b8c750eec93d4bfb9f7d61b6445d9e42">tempest-ServersNegativeTestJSON-521653173</nova:project>
Dec 06 12:54:31 user nova-compute[75247]:       </nova:owner>
Dec 06 12:54:31 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:54:31 user nova-compute[75247]:       <nova:ports>
Dec 06 12:54:31 user nova-compute[75247]:         <nova:port uuid="96cf8894-1e05-412d-a5f2-6df6a6bd2f6f">
Dec 06 12:54:31 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 06 12:54:31 user nova-compute[75247]:         </nova:port>
Dec 06 12:54:31 user nova-compute[75247]:       </nova:ports>
Dec 06 12:54:31 user nova-compute[75247]:     </nova:instance>
Dec 06 12:54:31 user nova-compute[75247]:   </metadata>
Dec 06 12:54:31 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:54:31 user nova-compute[75247]:     <system>
Dec 06 12:54:31 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:54:31 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:54:31 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:54:31 user nova-compute[75247]:       <entry name="serial">c603d6dc-804e-4c0d-be1f-40e09de74e8a</entry>
Dec 06 12:54:31 user nova-compute[75247]:       <entry name="uuid">c603d6dc-804e-4c0d-be1f-40e09de74e8a</entry>
Dec 06 12:54:31 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:54:31 user nova-compute[75247]:     </system>
Dec 06 12:54:31 user nova-compute[75247]:   </sysinfo>
Dec 06 12:54:31 user nova-compute[75247]:   <os>
Dec 06 12:54:31 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:54:31 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:54:31 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:54:31 user nova-compute[75247]:   </os>
Dec 06 12:54:31 user nova-compute[75247]:   <features>
Dec 06 12:54:31 user nova-compute[75247]:     <acpi/>
Dec 06 12:54:31 user nova-compute[75247]:     <apic/>
Dec 06 12:54:31 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:54:31 user nova-compute[75247]:   </features>
Dec 06 12:54:31 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:54:31 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:54:31 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:54:31 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:54:31 user nova-compute[75247]:   </clock>
Dec 06 12:54:31 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:54:31 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:54:31 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:54:31 user nova-compute[75247]:   </cpu>
Dec 06 12:54:31 user nova-compute[75247]:   <devices>
Dec 06 12:54:31 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:54:31 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:54:31 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk"/>
Dec 06 12:54:31 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:54:31 user nova-compute[75247]:     </disk>
Dec 06 12:54:31 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:54:31 user nova-compute[75247]:       <mac address="fa:16:3e:6c:dd:e2"/>
Dec 06 12:54:31 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:54:31 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:54:31 user nova-compute[75247]:       <target dev="tap96cf8894-1e"/>
Dec 06 12:54:31 user nova-compute[75247]:     </interface>
Dec 06 12:54:31 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:54:31 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/console.log" append="off"/>
Dec 06 12:54:31 user nova-compute[75247]:     </serial>
Dec 06 12:54:31 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:54:31 user nova-compute[75247]:     <video>
Dec 06 12:54:31 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:54:31 user nova-compute[75247]:     </video>
Dec 06 12:54:31 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:54:31 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:54:31 user nova-compute[75247]:     </rng>
Dec 06 12:54:31 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:54:31 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:54:31 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:54:31 user nova-compute[75247]:     </memballoon>
Dec 06 12:54:31 user nova-compute[75247]:   </devices>
Dec 06 12:54:31 user nova-compute[75247]: </domain>
Dec 06 12:54:31 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:54:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1965887220',display_name='tempest-ServersNegativeTestJSON-server-1965887220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1965887220',id=35,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8c750eec93d4bfb9f7d61b6445d9e42',ramdisk_id='',reservation_id='r-gl3qj2kb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-521653173',owner_user_name='tempest-ServersNegativeTestJSON-521653173-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:54:30Z,user_data=None,user_id='9462e4a57abb48f88f022c3486304df1',uuid=c603d6dc-804e-4c0d-be1f-40e09de74e8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96cf8894-1e05-412d-a5f2-6df6a6bd2f6f", "address": "fa:16:3e:6c:dd:e2", "network": {"id": "8691a7c7-5761-40a7-962e-880f95352b9a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-919731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8c750eec93d4bfb9f7d61b6445d9e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96cf8894-1e", "ovs_interfaceid": "96cf8894-1e05-412d-a5f2-6df6a6bd2f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Converting VIF {"id": "96cf8894-1e05-412d-a5f2-6df6a6bd2f6f", "address": "fa:16:3e:6c:dd:e2", "network": {"id": "8691a7c7-5761-40a7-962e-880f95352b9a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-919731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8c750eec93d4bfb9f7d61b6445d9e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96cf8894-1e", "ovs_interfaceid": "96cf8894-1e05-412d-a5f2-6df6a6bd2f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:dd:e2,bridge_name='br-int',has_traffic_filtering=True,id=96cf8894-1e05-412d-a5f2-6df6a6bd2f6f,network=Network(8691a7c7-5761-40a7-962e-880f95352b9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96cf8894-1e') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG os_vif [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:dd:e2,bridge_name='br-int',has_traffic_filtering=True,id=96cf8894-1e05-412d-a5f2-6df6a6bd2f6f,network=Network(8691a7c7-5761-40a7-962e-880f95352b9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96cf8894-1e') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:54:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dab2742e-d725-5d8b-a018-b62e3c7e2577', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:54:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:54:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96cf8894-1e, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:54:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96cf8894-1e, col_values=(('qos', UUID('ef14c16f-7d72-4f7b-a035-8c569182a9dd')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:54:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96cf8894-1e, col_values=(('external_ids', {'iface-id': '96cf8894-1e05-412d-a5f2-6df6a6bd2f6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:dd:e2', 'vm-uuid': 'c603d6dc-804e-4c0d-be1f-40e09de74e8a'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:54:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:32 user nova-compute[75247]: INFO os_vif [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:dd:e2,bridge_name='br-int',has_traffic_filtering=True,id=96cf8894-1e05-412d-a5f2-6df6a6bd2f6f,network=Network(8691a7c7-5761-40a7-962e-880f95352b9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96cf8894-1e')
Dec 06 12:54:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:54:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] No VIF found with MAC fa:16:3e:6c:dd:e2, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:54:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-d75b67bf-c211-4d80-a268-b71d75a1a76c req-883b120e-9554-442b-98d9-281dcf724b19 service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Received event network-vif-plugged-41d8bb63-57dd-4479-9a1e-89e223d16677 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d75b67bf-c211-4d80-a268-b71d75a1a76c req-883b120e-9554-442b-98d9-281dcf724b19 service nova] Acquiring lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d75b67bf-c211-4d80-a268-b71d75a1a76c req-883b120e-9554-442b-98d9-281dcf724b19 service nova] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d75b67bf-c211-4d80-a268-b71d75a1a76c req-883b120e-9554-442b-98d9-281dcf724b19 service nova] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-d75b67bf-c211-4d80-a268-b71d75a1a76c req-883b120e-9554-442b-98d9-281dcf724b19 service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] No waiting events found dispatching network-vif-plugged-41d8bb63-57dd-4479-9a1e-89e223d16677 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:54:32 user nova-compute[75247]: WARNING nova.compute.manager [req-d75b67bf-c211-4d80-a268-b71d75a1a76c req-883b120e-9554-442b-98d9-281dcf724b19 service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Received unexpected event network-vif-plugged-41d8bb63-57dd-4479-9a1e-89e223d16677 for instance with vm_state resized and task_state None.
Dec 06 12:54:32 user nova-compute[75247]: DEBUG nova.network.neutron [req-394dd863-4a78-4acb-9cd0-741e04285670 req-c08b3c6f-a57a-41be-a7ab-d3d1a5cc874e service nova] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Updated VIF entry in instance network info cache for port 96cf8894-1e05-412d-a5f2-6df6a6bd2f6f. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:54:32 user nova-compute[75247]: DEBUG nova.network.neutron [req-394dd863-4a78-4acb-9cd0-741e04285670 req-c08b3c6f-a57a-41be-a7ab-d3d1a5cc874e service nova] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Updating instance_info_cache with network_info: [{"id": "96cf8894-1e05-412d-a5f2-6df6a6bd2f6f", "address": "fa:16:3e:6c:dd:e2", "network": {"id": "8691a7c7-5761-40a7-962e-880f95352b9a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-919731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8c750eec93d4bfb9f7d61b6445d9e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96cf8894-1e", "ovs_interfaceid": "96cf8894-1e05-412d-a5f2-6df6a6bd2f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:54:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-394dd863-4a78-4acb-9cd0-741e04285670 req-c08b3c6f-a57a-41be-a7ab-d3d1a5cc874e service nova] Releasing lock "refresh_cache-c603d6dc-804e-4c0d-be1f-40e09de74e8a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:54:32 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:54:32 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Took 1.26 seconds to deallocate network for instance.
Dec 06 12:54:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-faf23a04-1bea-4787-9284-7f2f107e1e3b tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-faf23a04-1bea-4787-9284-7f2f107e1e3b tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:33 user nova-compute[75247]: DEBUG nova.compute.manager [req-5149b018-5049-4f57-885c-47b196f999bb req-71a4ac07-77fa-43c0-96e9-90b04b89258e service nova] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Received event network-vif-plugged-8a76a9ce-2bbc-4989-9fcb-66cce8adf16b {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5149b018-5049-4f57-885c-47b196f999bb req-71a4ac07-77fa-43c0-96e9-90b04b89258e service nova] Acquiring lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5149b018-5049-4f57-885c-47b196f999bb req-71a4ac07-77fa-43c0-96e9-90b04b89258e service nova] Lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5149b018-5049-4f57-885c-47b196f999bb req-71a4ac07-77fa-43c0-96e9-90b04b89258e service nova] Lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:33 user nova-compute[75247]: DEBUG nova.compute.manager [req-5149b018-5049-4f57-885c-47b196f999bb req-71a4ac07-77fa-43c0-96e9-90b04b89258e service nova] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] No waiting events found dispatching network-vif-plugged-8a76a9ce-2bbc-4989-9fcb-66cce8adf16b {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:54:33 user nova-compute[75247]: WARNING nova.compute.manager [req-5149b018-5049-4f57-885c-47b196f999bb req-71a4ac07-77fa-43c0-96e9-90b04b89258e service nova] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Received unexpected event network-vif-plugged-8a76a9ce-2bbc-4989-9fcb-66cce8adf16b for instance with vm_state deleted and task_state None.
Dec 06 12:54:33 user nova-compute[75247]: DEBUG nova.compute.manager [req-006d098f-515d-493f-aa24-706a79af6280 req-36b9e913-ee94-4101-8ec0-f5c6401ad9bb service nova] [instance: 0e7f8114-2e5d-4bf6-bb31-b00666f0d901] Received event network-vif-deleted-8a76a9ce-2bbc-4989-9fcb-66cce8adf16b {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:33 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-faf23a04-1bea-4787-9284-7f2f107e1e3b tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:54:33 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-faf23a04-1bea-4787-9284-7f2f107e1e3b tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:54:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-faf23a04-1bea-4787-9284-7f2f107e1e3b tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.526s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:33 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-faf23a04-1bea-4787-9284-7f2f107e1e3b tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Deleted allocations for instance 0e7f8114-2e5d-4bf6-bb31-b00666f0d901
Dec 06 12:54:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-faf23a04-1bea-4787-9284-7f2f107e1e3b tempest-AttachVolumeTestJSON-209684424 tempest-AttachVolumeTestJSON-209684424-project-member] Lock "0e7f8114-2e5d-4bf6-bb31-b00666f0d901" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.031s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:34 user nova-compute[75247]: DEBUG nova.compute.manager [req-7669f69b-0597-45b4-9d60-fc1a8d30b63c req-edab946e-5203-4827-997f-2611f07af94e service nova] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Received event network-vif-plugged-96cf8894-1e05-412d-a5f2-6df6a6bd2f6f {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7669f69b-0597-45b4-9d60-fc1a8d30b63c req-edab946e-5203-4827-997f-2611f07af94e service nova] Acquiring lock "c603d6dc-804e-4c0d-be1f-40e09de74e8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7669f69b-0597-45b4-9d60-fc1a8d30b63c req-edab946e-5203-4827-997f-2611f07af94e service nova] Lock "c603d6dc-804e-4c0d-be1f-40e09de74e8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7669f69b-0597-45b4-9d60-fc1a8d30b63c req-edab946e-5203-4827-997f-2611f07af94e service nova] Lock "c603d6dc-804e-4c0d-be1f-40e09de74e8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:34 user nova-compute[75247]: DEBUG nova.compute.manager [req-7669f69b-0597-45b4-9d60-fc1a8d30b63c req-edab946e-5203-4827-997f-2611f07af94e service nova] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] No waiting events found dispatching network-vif-plugged-96cf8894-1e05-412d-a5f2-6df6a6bd2f6f {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:54:34 user nova-compute[75247]: WARNING nova.compute.manager [req-7669f69b-0597-45b4-9d60-fc1a8d30b63c req-edab946e-5203-4827-997f-2611f07af94e service nova] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Received unexpected event network-vif-plugged-96cf8894-1e05-412d-a5f2-6df6a6bd2f6f for instance with vm_state building and task_state spawning.
Dec 06 12:54:34 user nova-compute[75247]: DEBUG nova.compute.manager [req-7669f69b-0597-45b4-9d60-fc1a8d30b63c req-edab946e-5203-4827-997f-2611f07af94e service nova] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Received event network-vif-plugged-96cf8894-1e05-412d-a5f2-6df6a6bd2f6f {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7669f69b-0597-45b4-9d60-fc1a8d30b63c req-edab946e-5203-4827-997f-2611f07af94e service nova] Acquiring lock "c603d6dc-804e-4c0d-be1f-40e09de74e8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7669f69b-0597-45b4-9d60-fc1a8d30b63c req-edab946e-5203-4827-997f-2611f07af94e service nova] Lock "c603d6dc-804e-4c0d-be1f-40e09de74e8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7669f69b-0597-45b4-9d60-fc1a8d30b63c req-edab946e-5203-4827-997f-2611f07af94e service nova] Lock "c603d6dc-804e-4c0d-be1f-40e09de74e8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:34 user nova-compute[75247]: DEBUG nova.compute.manager [req-7669f69b-0597-45b4-9d60-fc1a8d30b63c req-edab946e-5203-4827-997f-2611f07af94e service nova] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] No waiting events found dispatching network-vif-plugged-96cf8894-1e05-412d-a5f2-6df6a6bd2f6f {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:54:34 user nova-compute[75247]: WARNING nova.compute.manager [req-7669f69b-0597-45b4-9d60-fc1a8d30b63c req-edab946e-5203-4827-997f-2611f07af94e service nova] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Received unexpected event network-vif-plugged-96cf8894-1e05-412d-a5f2-6df6a6bd2f6f for instance with vm_state building and task_state spawning.
Dec 06 12:54:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:36 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:54:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:54:36 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Instance spawned successfully.
Dec 06 12:54:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:54:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:54:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:54:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:54:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:54:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:54:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:54:36 user nova-compute[75247]: INFO nova.compute.manager [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Took 6.61 seconds to spawn the instance on the hypervisor.
Dec 06 12:54:36 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:54:36 user nova-compute[75247]: INFO nova.compute.manager [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Took 8.41 seconds to build instance.
Dec 06 12:54:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c85f60ee-83ca-47c1-8197-9e0f9d3da093 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "c603d6dc-804e-4c0d-be1f-40e09de74e8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.143s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:54:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:50 user nova-compute[75247]: DEBUG nova.compute.manager [req-0f25dcfc-3761-4c63-89a6-13ff6982ce44 req-6b8be28b-e930-4bb1-b057-1237c48ce8e3 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received event network-changed-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:50 user nova-compute[75247]: DEBUG nova.compute.manager [req-0f25dcfc-3761-4c63-89a6-13ff6982ce44 req-6b8be28b-e930-4bb1-b057-1237c48ce8e3 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Refreshing instance network info cache due to event network-changed-358da164-b155-4d24-a006-7454c10ee790. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:54:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0f25dcfc-3761-4c63-89a6-13ff6982ce44 req-6b8be28b-e930-4bb1-b057-1237c48ce8e3 service nova] Acquiring lock "refresh_cache-92d215fd-8411-430c-b91e-b6e62e02a994" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:54:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0f25dcfc-3761-4c63-89a6-13ff6982ce44 req-6b8be28b-e930-4bb1-b057-1237c48ce8e3 service nova] Acquired lock "refresh_cache-92d215fd-8411-430c-b91e-b6e62e02a994" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:54:50 user nova-compute[75247]: DEBUG nova.network.neutron [req-0f25dcfc-3761-4c63-89a6-13ff6982ce44 req-6b8be28b-e930-4bb1-b057-1237c48ce8e3 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Refreshing network info cache for port 358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:54:50 user nova-compute[75247]: DEBUG nova.network.neutron [req-0f25dcfc-3761-4c63-89a6-13ff6982ce44 req-6b8be28b-e930-4bb1-b057-1237c48ce8e3 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Updated VIF entry in instance network info cache for port 358da164-b155-4d24-a006-7454c10ee790. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:54:50 user nova-compute[75247]: DEBUG nova.network.neutron [req-0f25dcfc-3761-4c63-89a6-13ff6982ce44 req-6b8be28b-e930-4bb1-b057-1237c48ce8e3 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Updating instance_info_cache with network_info: [{"id": "358da164-b155-4d24-a006-7454c10ee790", "address": "fa:16:3e:56:7e:02", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358da164-b1", "ovs_interfaceid": "358da164-b155-4d24-a006-7454c10ee790", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:54:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0f25dcfc-3761-4c63-89a6-13ff6982ce44 req-6b8be28b-e930-4bb1-b057-1237c48ce8e3 service nova] Releasing lock "refresh_cache-92d215fd-8411-430c-b91e-b6e62e02a994" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:54:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "92d215fd-8411-430c-b91e-b6e62e02a994" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:54:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "92d215fd-8411-430c-b91e-b6e62e02a994" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:54:51 user nova-compute[75247]: INFO nova.compute.manager [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Detaching volume f9a3d0be-0d86-4a99-a353-728604fb5abd
Dec 06 12:54:51 user nova-compute[75247]: INFO nova.virt.block_device [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Attempting to driver detach volume f9a3d0be-0d86-4a99-a353-728604fb5abd from mountpoint /dev/vdb
Dec 06 12:54:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Attempting to detach device vdb from instance 92d215fd-8411-430c-b91e-b6e62e02a994 from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 12:54:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:54:51 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:54:51 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:54:51 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:54:51 user nova-compute[75247]:   <serial>f9a3d0be-0d86-4a99-a353-728604fb5abd</serial>
Dec 06 12:54:51 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:54:51 user nova-compute[75247]: </disk>
Dec 06 12:54:51 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:54:51 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Successfully detached device vdb from instance 92d215fd-8411-430c-b91e-b6e62e02a994 from the persistent domain config.
Dec 06 12:54:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 92d215fd-8411-430c-b91e-b6e62e02a994 from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 12:54:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:54:51 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:54:51 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:54:51 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:54:51 user nova-compute[75247]:   <serial>f9a3d0be-0d86-4a99-a353-728604fb5abd</serial>
Dec 06 12:54:51 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:54:51 user nova-compute[75247]: </disk>
Dec 06 12:54:51 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:54:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 92d215fd-8411-430c-b91e-b6e62e02a994 {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 12:54:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:52 user nova-compute[75247]: DEBUG nova.compute.manager [req-07f44c3e-6de3-4308-a155-32fe39bd967f req-49aaaec5-a977-4efd-a4fb-be592bda5163 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received event network-changed-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:54:52 user nova-compute[75247]: DEBUG nova.compute.manager [req-07f44c3e-6de3-4308-a155-32fe39bd967f req-49aaaec5-a977-4efd-a4fb-be592bda5163 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Refreshing instance network info cache due to event network-changed-358da164-b155-4d24-a006-7454c10ee790. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:54:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-07f44c3e-6de3-4308-a155-32fe39bd967f req-49aaaec5-a977-4efd-a4fb-be592bda5163 service nova] Acquiring lock "refresh_cache-92d215fd-8411-430c-b91e-b6e62e02a994" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:54:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-07f44c3e-6de3-4308-a155-32fe39bd967f req-49aaaec5-a977-4efd-a4fb-be592bda5163 service nova] Acquired lock "refresh_cache-92d215fd-8411-430c-b91e-b6e62e02a994" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:54:52 user nova-compute[75247]: DEBUG nova.network.neutron [req-07f44c3e-6de3-4308-a155-32fe39bd967f req-49aaaec5-a977-4efd-a4fb-be592bda5163 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Refreshing network info cache for port 358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:54:52 user nova-compute[75247]: DEBUG nova.network.neutron [req-07f44c3e-6de3-4308-a155-32fe39bd967f req-49aaaec5-a977-4efd-a4fb-be592bda5163 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Updated VIF entry in instance network info cache for port 358da164-b155-4d24-a006-7454c10ee790. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:54:52 user nova-compute[75247]: DEBUG nova.network.neutron [req-07f44c3e-6de3-4308-a155-32fe39bd967f req-49aaaec5-a977-4efd-a4fb-be592bda5163 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Updating instance_info_cache with network_info: [{"id": "358da164-b155-4d24-a006-7454c10ee790", "address": "fa:16:3e:56:7e:02", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358da164-b1", "ovs_interfaceid": "358da164-b155-4d24-a006-7454c10ee790", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:54:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-07f44c3e-6de3-4308-a155-32fe39bd967f req-49aaaec5-a977-4efd-a4fb-be592bda5163 service nova] Releasing lock "refresh_cache-92d215fd-8411-430c-b91e-b6e62e02a994" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:54:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:54:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:11 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 92d215fd-8411-430c-b91e-b6e62e02a994 is timed out.
Dec 06 12:55:11 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Successfully detached device vdb from instance 92d215fd-8411-430c-b91e-b6e62e02a994 from the live domain config.
Dec 06 12:55:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PlvhWwCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:55:11 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:55:11 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dc4d16-977c-4d40-8203-55bb2145f8de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:55:11 user nova-compute[75247]: No targets found.
Dec 06 12:55:11 user nova-compute[75247]: iSNS:
Dec 06 12:55:11 user nova-compute[75247]: No targets found.
Dec 06 12:55:11 user nova-compute[75247]: STATIC:
Dec 06 12:55:11 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd
Dec 06 12:55:11 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:55:11 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:55:11 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:55:11 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:55:11 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:55:11 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33
Dec 06 12:55:11 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:55:11 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:55:11 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31
Dec 06 12:55:11 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:55:11 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:55:11 user nova-compute[75247]: FIRMWARE:
Dec 06 12:55:11 user nova-compute[75247]: No targets found.
Dec 06 12:55:11 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:55:11 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:55:11 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f126757-7c3d-41b2-b958-53cea7fb0789]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07e2144-65ec-4830-91a1-da7c907c76ad]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:55:11 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:55:11 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:55:11 user nova-compute[75247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:55:11 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:55:11 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:55:11 user nova-compute[75247]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd (non-flash)
Dec 06 12:55:11 user nova-compute[75247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:55:11 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c645ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd'): ({'sdb'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Removing single pathed devices sdb {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe5ee11-497e-4bbb-8b1d-c41216772758]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d907afe-6fd2-46b5-aa94-6ce85019b4d4]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Flushing IO for device /dev/sdb {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3611bad1-4284-4323-8d7a-1efdbdd99201]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fa790c-fdd5-46e7-b31c-645a776ab902]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:55:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:12 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf41055-248c-4f3e-8433-704b77f50b74]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:55:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:55:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:12 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2041fb-79d9-4058-8e0c-726a3734c4a3]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:55:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd, portal: 172.16.0.220,3260]
Dec 06 12:55:12 user nova-compute[75247]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd, portal: 172.16.0.220,3260] successful.
Dec 06 12:55:12 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:55:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a3d0be-0d86-4a99-a353-728604fb5abd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:12 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ba5d5b-d41c-4489-b955-c32642ed6530]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:55:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:55:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:55:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] <== disconnect_volume: return (334ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:55:12 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:55:12 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:55:13 user nova-compute[75247]: DEBUG nova.objects.instance [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lazy-loading 'flavor' on Instance uuid 92d215fd-8411-430c-b91e-b6e62e02a994 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:55:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b6e06c4c-4746-4981-a8d3-72c140f0232e tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "92d215fd-8411-430c-b91e-b6e62e02a994" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.012s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:55:13 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:55:13 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:55:13 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 12:55:15 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:55:16 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:55:16 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 12:55:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:55:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:55:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 12:55:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 12:55:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 12:55:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-3e1b5197-dc38-48a5-b9f9-e053be499433" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:55:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-3e1b5197-dc38-48a5-b9f9-e053be499433" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:55:17 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 12:55:17 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Updating instance_info_cache with network_info: [{"id": "f373c320-8b0c-440d-b825-d7ec2555b89d", "address": "fa:16:3e:3f:8d:92", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf373c320-8b", "ovs_interfaceid": "f373c320-8b0c-440d-b825-d7ec2555b89d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:55:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-3e1b5197-dc38-48a5-b9f9-e053be499433" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:55:17 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 12:55:18 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:55:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:55:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:55:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:55:18 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 12:55:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d508276-60ac-4d77-a930-bfc8b745f243/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d508276-60ac-4d77-a930-bfc8b745f243/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d508276-60ac-4d77-a930-bfc8b745f243/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d508276-60ac-4d77-a930-bfc8b745f243/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:55:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d767ae1-4df2-4e87-b991-729fabd467f8/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d767ae1-4df2-4e87-b991-729fabd467f8/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d767ae1-4df2-4e87-b991-729fabd467f8/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d767ae1-4df2-4e87-b991-729fabd467f8/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:55:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:55:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:24 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:55:24 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:55:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=7124MB free_disk=24.8697509765625GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 12:55:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:55:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:55:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Applying migration context for instance b3720cc0-ff80-4ca2-8b13-d83dded593ad as it has an incoming, in-progress migration a28e36c3-e15d-45e3-9f84-3ac928105559. Migration status is finished {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 06 12:55:24 user nova-compute[75247]: INFO nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Updating resource usage from migration a28e36c3-e15d-45e3-9f84-3ac928105559
Dec 06 12:55:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 70c4664e-ae7a-47de-bba7-18300391d209 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:55:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 782289e2-91cd-4aee-9a08-eadfb2a5965b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:55:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 3e1b5197-dc38-48a5-b9f9-e053be499433 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:55:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:55:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance bc3ddb40-b05f-4170-b269-d44dec6ecdaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:55:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 530cfb75-7aa8-4e57-b282-8f7a21401b34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:55:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 92d215fd-8411-430c-b91e-b6e62e02a994 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:55:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 6d767ae1-4df2-4e87-b991-729fabd467f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:55:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance f5b69324-579d-4833-9bb4-c43c511f820d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:55:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Migration a28e36c3-e15d-45e3-9f84-3ac928105559 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1712}}
Dec 06 12:55:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance b3720cc0-ff80-4ca2-8b13-d83dded593ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:55:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 7d508276-60ac-4d77-a930-bfc8b745f243 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:55:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance c603d6dc-804e-4c0d-be1f-40e09de74e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:55:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 12:55:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 12:55:24 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:55:24 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:55:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 12:55:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.614s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:55:25 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:55:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:55:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 12:55:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 12:55:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 12:55:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:28 user nova-compute[75247]: INFO nova.compute.manager [None req-c1f42098-6c84-4fca-80e0-636b69c714bf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Unrescuing
Dec 06 12:55:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c1f42098-6c84-4fca-80e0-636b69c714bf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "refresh_cache-6d767ae1-4df2-4e87-b991-729fabd467f8" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:55:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c1f42098-6c84-4fca-80e0-636b69c714bf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquired lock "refresh_cache-6d767ae1-4df2-4e87-b991-729fabd467f8" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:55:28 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c1f42098-6c84-4fca-80e0-636b69c714bf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:55:29 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c1f42098-6c84-4fca-80e0-636b69c714bf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Updating instance_info_cache with network_info: [{"id": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "address": "fa:16:3e:73:5b:1b", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f9635e-3e", "ovs_interfaceid": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:55:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c1f42098-6c84-4fca-80e0-636b69c714bf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Releasing lock "refresh_cache-6d767ae1-4df2-4e87-b991-729fabd467f8" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:55:29 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c1f42098-6c84-4fca-80e0-636b69c714bf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lazy-loading 'flavor' on Instance uuid 6d767ae1-4df2-4e87-b991-729fabd467f8 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:55:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:30 user nova-compute[75247]: DEBUG nova.compute.manager [req-b8a7d403-b4d8-453f-ad30-c071602fdfeb req-632c9ab8-8833-415b-9792-d3e49afd9d1a service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Received event network-vif-unplugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:55:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b8a7d403-b4d8-453f-ad30-c071602fdfeb req-632c9ab8-8833-415b-9792-d3e49afd9d1a service nova] Acquiring lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:55:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b8a7d403-b4d8-453f-ad30-c071602fdfeb req-632c9ab8-8833-415b-9792-d3e49afd9d1a service nova] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:55:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b8a7d403-b4d8-453f-ad30-c071602fdfeb req-632c9ab8-8833-415b-9792-d3e49afd9d1a service nova] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:55:30 user nova-compute[75247]: DEBUG nova.compute.manager [req-b8a7d403-b4d8-453f-ad30-c071602fdfeb req-632c9ab8-8833-415b-9792-d3e49afd9d1a service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] No waiting events found dispatching network-vif-unplugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:55:30 user nova-compute[75247]: WARNING nova.compute.manager [req-b8a7d403-b4d8-453f-ad30-c071602fdfeb req-632c9ab8-8833-415b-9792-d3e49afd9d1a service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Received unexpected event network-vif-unplugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 for instance with vm_state rescued and task_state unrescuing.
Dec 06 12:55:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:30 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Instance destroyed successfully.
Dec 06 12:55:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-95d65a75-b358-40b8-a09e-3186dec19224 req-2ade1704-dc10-4fe8-80d9-db58c28ec9eb service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Received event network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:55:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-95d65a75-b358-40b8-a09e-3186dec19224 req-2ade1704-dc10-4fe8-80d9-db58c28ec9eb service nova] Acquiring lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:55:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-95d65a75-b358-40b8-a09e-3186dec19224 req-2ade1704-dc10-4fe8-80d9-db58c28ec9eb service nova] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:55:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-95d65a75-b358-40b8-a09e-3186dec19224 req-2ade1704-dc10-4fe8-80d9-db58c28ec9eb service nova] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:55:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-95d65a75-b358-40b8-a09e-3186dec19224 req-2ade1704-dc10-4fe8-80d9-db58c28ec9eb service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] No waiting events found dispatching network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:55:32 user nova-compute[75247]: WARNING nova.compute.manager [req-95d65a75-b358-40b8-a09e-3186dec19224 req-2ade1704-dc10-4fe8-80d9-db58c28ec9eb service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Received unexpected event network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 for instance with vm_state rescued and task_state unrescuing.
Dec 06 12:55:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-95d65a75-b358-40b8-a09e-3186dec19224 req-2ade1704-dc10-4fe8-80d9-db58c28ec9eb service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Received event network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:55:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-95d65a75-b358-40b8-a09e-3186dec19224 req-2ade1704-dc10-4fe8-80d9-db58c28ec9eb service nova] Acquiring lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:55:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-95d65a75-b358-40b8-a09e-3186dec19224 req-2ade1704-dc10-4fe8-80d9-db58c28ec9eb service nova] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:55:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-95d65a75-b358-40b8-a09e-3186dec19224 req-2ade1704-dc10-4fe8-80d9-db58c28ec9eb service nova] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:55:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-95d65a75-b358-40b8-a09e-3186dec19224 req-2ade1704-dc10-4fe8-80d9-db58c28ec9eb service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] No waiting events found dispatching network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:55:32 user nova-compute[75247]: WARNING nova.compute.manager [req-95d65a75-b358-40b8-a09e-3186dec19224 req-2ade1704-dc10-4fe8-80d9-db58c28ec9eb service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Received unexpected event network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 for instance with vm_state rescued and task_state unrescuing.
Dec 06 12:55:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:34 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c1f42098-6c84-4fca-80e0-636b69c714bf tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:55:34 user nova-compute[75247]: DEBUG nova.compute.manager [req-bada13b3-a262-49f0-8779-dd1b812decc9 req-d399890b-9a4c-482e-8212-add8098d3a76 service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Received event network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:55:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bada13b3-a262-49f0-8779-dd1b812decc9 req-d399890b-9a4c-482e-8212-add8098d3a76 service nova] Acquiring lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:55:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bada13b3-a262-49f0-8779-dd1b812decc9 req-d399890b-9a4c-482e-8212-add8098d3a76 service nova] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:55:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bada13b3-a262-49f0-8779-dd1b812decc9 req-d399890b-9a4c-482e-8212-add8098d3a76 service nova] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:55:34 user nova-compute[75247]: DEBUG nova.compute.manager [req-bada13b3-a262-49f0-8779-dd1b812decc9 req-d399890b-9a4c-482e-8212-add8098d3a76 service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] No waiting events found dispatching network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:55:34 user nova-compute[75247]: WARNING nova.compute.manager [req-bada13b3-a262-49f0-8779-dd1b812decc9 req-d399890b-9a4c-482e-8212-add8098d3a76 service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Received unexpected event network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 for instance with vm_state rescued and task_state unrescuing.
Dec 06 12:55:36 user nova-compute[75247]: DEBUG nova.compute.manager [req-bd37bc20-c783-4e1e-b432-463bfb873e35 req-318c377d-2685-4f79-aac1-3ffe12c2dab7 service nova] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Received event network-changed-818fb644-610d-4c88-b8fe-58ab34e6a02a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:55:36 user nova-compute[75247]: DEBUG nova.compute.manager [req-bd37bc20-c783-4e1e-b432-463bfb873e35 req-318c377d-2685-4f79-aac1-3ffe12c2dab7 service nova] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Refreshing instance network info cache due to event network-changed-818fb644-610d-4c88-b8fe-58ab34e6a02a. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:55:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bd37bc20-c783-4e1e-b432-463bfb873e35 req-318c377d-2685-4f79-aac1-3ffe12c2dab7 service nova] Acquiring lock "refresh_cache-f5b69324-579d-4833-9bb4-c43c511f820d" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:55:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bd37bc20-c783-4e1e-b432-463bfb873e35 req-318c377d-2685-4f79-aac1-3ffe12c2dab7 service nova] Acquired lock "refresh_cache-f5b69324-579d-4833-9bb4-c43c511f820d" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:55:36 user nova-compute[75247]: DEBUG nova.network.neutron [req-bd37bc20-c783-4e1e-b432-463bfb873e35 req-318c377d-2685-4f79-aac1-3ffe12c2dab7 service nova] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Refreshing network info cache for port 818fb644-610d-4c88-b8fe-58ab34e6a02a {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:55:36 user nova-compute[75247]: DEBUG nova.network.neutron [req-bd37bc20-c783-4e1e-b432-463bfb873e35 req-318c377d-2685-4f79-aac1-3ffe12c2dab7 service nova] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Updated VIF entry in instance network info cache for port 818fb644-610d-4c88-b8fe-58ab34e6a02a. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:55:36 user nova-compute[75247]: DEBUG nova.network.neutron [req-bd37bc20-c783-4e1e-b432-463bfb873e35 req-318c377d-2685-4f79-aac1-3ffe12c2dab7 service nova] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Updating instance_info_cache with network_info: [{"id": "818fb644-610d-4c88-b8fe-58ab34e6a02a", "address": "fa:16:3e:88:16:dd", "network": {"id": "54586963-619a-439b-94a9-13ade1a28f3f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1711423376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8439b54f294add9fb59befefd54456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fb644-61", "ovs_interfaceid": "818fb644-610d-4c88-b8fe-58ab34e6a02a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:55:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bd37bc20-c783-4e1e-b432-463bfb873e35 req-318c377d-2685-4f79-aac1-3ffe12c2dab7 service nova] Releasing lock "refresh_cache-f5b69324-579d-4833-9bb4-c43c511f820d" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:55:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "f5b69324-579d-4833-9bb4-c43c511f820d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:55:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:55:39 user nova-compute[75247]: DEBUG nova.objects.instance [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lazy-loading 'flavor' on Instance uuid f5b69324-579d-4833-9bb4-c43c511f820d {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:55:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:55:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "f5b69324-579d-4833-9bb4-c43c511f820d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:55:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:55:40 user nova-compute[75247]: INFO nova.compute.manager [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Attaching volume ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 to /dev/vdb
Dec 06 12:55:40 user nova-compute[75247]: DEBUG os_brick.utils [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:55:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6090f2-ef7e-434f-bd1b-6292cf2fc661]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:55:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c545c3ad-5594-49db-857a-f33f1d083475]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:55:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b285d755-7ceb-44d9-92d2-10d56acd18d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:55:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce39789a-82a0-463b-a725-99874475be80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:55:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:55:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:55:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:55:40 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:55:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf21de3-80b5-4ed7-9f14-652f5c0930b3]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:55:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:55:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:55:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:55:40 user nova-compute[75247]: DEBUG os_brick.utils [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:55:40 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Updating existing volume attachment record: db7878b4-e5a0-477d-bb4f-122bb8b55957 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:55:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-675556ea-2f2d-4e01-8539-cd76151a06a9 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "92d215fd-8411-430c-b91e-b6e62e02a994" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-675556ea-2f2d-4e01-8539-cd76151a06a9 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "92d215fd-8411-430c-b91e-b6e62e02a994" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-675556ea-2f2d-4e01-8539-cd76151a06a9 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-675556ea-2f2d-4e01-8539-cd76151a06a9 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-675556ea-2f2d-4e01-8539-cd76151a06a9 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:55:47 user nova-compute[75247]: INFO nova.compute.manager [None req-675556ea-2f2d-4e01-8539-cd76151a06a9 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Terminating instance
Dec 06 12:55:47 user nova-compute[75247]: DEBUG nova.compute.manager [None req-675556ea-2f2d-4e01-8539-cd76151a06a9 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-cc2a0872-82d4-49d6-bd29-f5447d32489c req-852500fb-3955-4bb8-aa1c-befbbfe65957 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received event network-vif-unplugged-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-cc2a0872-82d4-49d6-bd29-f5447d32489c req-852500fb-3955-4bb8-aa1c-befbbfe65957 service nova] Acquiring lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-cc2a0872-82d4-49d6-bd29-f5447d32489c req-852500fb-3955-4bb8-aa1c-befbbfe65957 service nova] Lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-cc2a0872-82d4-49d6-bd29-f5447d32489c req-852500fb-3955-4bb8-aa1c-befbbfe65957 service nova] Lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-cc2a0872-82d4-49d6-bd29-f5447d32489c req-852500fb-3955-4bb8-aa1c-befbbfe65957 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] No waiting events found dispatching network-vif-unplugged-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-cc2a0872-82d4-49d6-bd29-f5447d32489c req-852500fb-3955-4bb8-aa1c-befbbfe65957 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received event network-vif-unplugged-358da164-b155-4d24-a006-7454c10ee790 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:47 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Instance destroyed successfully.
Dec 06 12:55:47 user nova-compute[75247]: DEBUG nova.objects.instance [None req-675556ea-2f2d-4e01-8539-cd76151a06a9 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lazy-loading 'resources' on Instance uuid 92d215fd-8411-430c-b91e-b6e62e02a994 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-675556ea-2f2d-4e01-8539-cd76151a06a9 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-405491717',display_name='tempest-TestMinimumBasicScenario-server-405491717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-405491717',id=28,image_ref='77880627-5661-4b33-918f-7f31d21bbf09',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8DJx6AERy2099LBCgp0NCcDeirjKP0JaCltFxo6ebyzhA+RaiRR5xAzSQFYIZYmpKbdvwElgDd3tckUYpfpyWVw2FT00kZhSxTzK8Ya6p8RFso6a9TFAS+ZLvdkG8SSQ==',key_name='tempest-TestMinimumBasicScenario-652469488',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:50:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df4c40ccbb8a410aa0e65c1f5897de97',ramdisk_id='',reservation_id='r-4nqr0wos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77880627-5661-4b33-918f-7f31d21bbf09',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1052287778',owner_user_name='tempest-TestMinimumBasicScenario-1052287778-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:53:05Z,user_data=None,user_id='4548c5d3575e45d787758e52fbf274d6',uuid=92d215fd-8411-430c-b91e-b6e62e02a994,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "358da164-b155-4d24-a006-7454c10ee790", "address": "fa:16:3e:56:7e:02", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358da164-b1", "ovs_interfaceid": "358da164-b155-4d24-a006-7454c10ee790", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-675556ea-2f2d-4e01-8539-cd76151a06a9 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Converting VIF {"id": "358da164-b155-4d24-a006-7454c10ee790", "address": "fa:16:3e:56:7e:02", "network": {"id": "56756e7a-b384-43a0-88dc-bab3b11e5f66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-383293291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4c40ccbb8a410aa0e65c1f5897de97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358da164-b1", "ovs_interfaceid": "358da164-b155-4d24-a006-7454c10ee790", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-675556ea-2f2d-4e01-8539-cd76151a06a9 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:7e:02,bridge_name='br-int',has_traffic_filtering=True,id=358da164-b155-4d24-a006-7454c10ee790,network=Network(56756e7a-b384-43a0-88dc-bab3b11e5f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358da164-b1') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG os_vif [None req-675556ea-2f2d-4e01-8539-cd76151a06a9 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:7e:02,bridge_name='br-int',has_traffic_filtering=True,id=358da164-b155-4d24-a006-7454c10ee790,network=Network(56756e7a-b384-43a0-88dc-bab3b11e5f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358da164-b1') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap358da164-b1, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7eb6cf7d-4369-45cc-941c-63ed1eca1622) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:47 user nova-compute[75247]: INFO os_vif [None req-675556ea-2f2d-4e01-8539-cd76151a06a9 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:7e:02,bridge_name='br-int',has_traffic_filtering=True,id=358da164-b155-4d24-a006-7454c10ee790,network=Network(56756e7a-b384-43a0-88dc-bab3b11e5f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358da164-b1')
Dec 06 12:55:47 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-675556ea-2f2d-4e01-8539-cd76151a06a9 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Deleting instance files /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994_del
Dec 06 12:55:47 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-675556ea-2f2d-4e01-8539-cd76151a06a9 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Deletion of /opt/stack/data/nova/instances/92d215fd-8411-430c-b91e-b6e62e02a994_del complete
Dec 06 12:55:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:47 user nova-compute[75247]: INFO nova.compute.manager [None req-675556ea-2f2d-4e01-8539-cd76151a06a9 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Took 0.94 seconds to destroy the instance on the hypervisor.
Dec 06 12:55:47 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-675556ea-2f2d-4e01-8539-cd76151a06a9 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:55:47 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:55:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:48 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:55:48 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Took 0.62 seconds to deallocate network for instance.
Dec 06 12:55:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:48 user nova-compute[75247]: DEBUG nova.compute.manager [req-60f28bd7-6c1f-46df-b0e0-b9e07cf5507a req-630db3a0-ea02-4744-abbf-57e8d5d23c8f service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received event network-vif-deleted-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:55:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-675556ea-2f2d-4e01-8539-cd76151a06a9 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:55:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-675556ea-2f2d-4e01-8539-cd76151a06a9 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:55:49 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-675556ea-2f2d-4e01-8539-cd76151a06a9 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:55:49 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-675556ea-2f2d-4e01-8539-cd76151a06a9 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:55:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-675556ea-2f2d-4e01-8539-cd76151a06a9 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:55:49 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-675556ea-2f2d-4e01-8539-cd76151a06a9 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Deleted allocations for instance 92d215fd-8411-430c-b91e-b6e62e02a994
Dec 06 12:55:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-675556ea-2f2d-4e01-8539-cd76151a06a9 tempest-TestMinimumBasicScenario-1052287778 tempest-TestMinimumBasicScenario-1052287778-project-member] Lock "92d215fd-8411-430c-b91e-b6e62e02a994" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.302s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:55:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-bf2b951c-2c0a-40f6-afa6-29bab695db5a req-2fde9258-c7fb-4bb5-8e09-92a126b539b8 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received event network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:55:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bf2b951c-2c0a-40f6-afa6-29bab695db5a req-2fde9258-c7fb-4bb5-8e09-92a126b539b8 service nova] Acquiring lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:55:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bf2b951c-2c0a-40f6-afa6-29bab695db5a req-2fde9258-c7fb-4bb5-8e09-92a126b539b8 service nova] Lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:55:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bf2b951c-2c0a-40f6-afa6-29bab695db5a req-2fde9258-c7fb-4bb5-8e09-92a126b539b8 service nova] Lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:55:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-bf2b951c-2c0a-40f6-afa6-29bab695db5a req-2fde9258-c7fb-4bb5-8e09-92a126b539b8 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] No waiting events found dispatching network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:55:49 user nova-compute[75247]: WARNING nova.compute.manager [req-bf2b951c-2c0a-40f6-afa6-29bab695db5a req-2fde9258-c7fb-4bb5-8e09-92a126b539b8 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received unexpected event network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 for instance with vm_state deleted and task_state None.
Dec 06 12:55:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-bf2b951c-2c0a-40f6-afa6-29bab695db5a req-2fde9258-c7fb-4bb5-8e09-92a126b539b8 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received event network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:55:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bf2b951c-2c0a-40f6-afa6-29bab695db5a req-2fde9258-c7fb-4bb5-8e09-92a126b539b8 service nova] Acquiring lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:55:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bf2b951c-2c0a-40f6-afa6-29bab695db5a req-2fde9258-c7fb-4bb5-8e09-92a126b539b8 service nova] Lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:55:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bf2b951c-2c0a-40f6-afa6-29bab695db5a req-2fde9258-c7fb-4bb5-8e09-92a126b539b8 service nova] Lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:55:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-bf2b951c-2c0a-40f6-afa6-29bab695db5a req-2fde9258-c7fb-4bb5-8e09-92a126b539b8 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] No waiting events found dispatching network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:55:49 user nova-compute[75247]: WARNING nova.compute.manager [req-bf2b951c-2c0a-40f6-afa6-29bab695db5a req-2fde9258-c7fb-4bb5-8e09-92a126b539b8 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received unexpected event network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 for instance with vm_state deleted and task_state None.
Dec 06 12:55:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-bf2b951c-2c0a-40f6-afa6-29bab695db5a req-2fde9258-c7fb-4bb5-8e09-92a126b539b8 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received event network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:55:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bf2b951c-2c0a-40f6-afa6-29bab695db5a req-2fde9258-c7fb-4bb5-8e09-92a126b539b8 service nova] Acquiring lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:55:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bf2b951c-2c0a-40f6-afa6-29bab695db5a req-2fde9258-c7fb-4bb5-8e09-92a126b539b8 service nova] Lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:55:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bf2b951c-2c0a-40f6-afa6-29bab695db5a req-2fde9258-c7fb-4bb5-8e09-92a126b539b8 service nova] Lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:55:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-bf2b951c-2c0a-40f6-afa6-29bab695db5a req-2fde9258-c7fb-4bb5-8e09-92a126b539b8 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] No waiting events found dispatching network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:55:49 user nova-compute[75247]: WARNING nova.compute.manager [req-bf2b951c-2c0a-40f6-afa6-29bab695db5a req-2fde9258-c7fb-4bb5-8e09-92a126b539b8 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received unexpected event network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 for instance with vm_state deleted and task_state None.
Dec 06 12:55:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-bf2b951c-2c0a-40f6-afa6-29bab695db5a req-2fde9258-c7fb-4bb5-8e09-92a126b539b8 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received event network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:55:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bf2b951c-2c0a-40f6-afa6-29bab695db5a req-2fde9258-c7fb-4bb5-8e09-92a126b539b8 service nova] Acquiring lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:55:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bf2b951c-2c0a-40f6-afa6-29bab695db5a req-2fde9258-c7fb-4bb5-8e09-92a126b539b8 service nova] Lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:55:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bf2b951c-2c0a-40f6-afa6-29bab695db5a req-2fde9258-c7fb-4bb5-8e09-92a126b539b8 service nova] Lock "92d215fd-8411-430c-b91e-b6e62e02a994-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:55:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-bf2b951c-2c0a-40f6-afa6-29bab695db5a req-2fde9258-c7fb-4bb5-8e09-92a126b539b8 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] No waiting events found dispatching network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:55:49 user nova-compute[75247]: WARNING nova.compute.manager [req-bf2b951c-2c0a-40f6-afa6-29bab695db5a req-2fde9258-c7fb-4bb5-8e09-92a126b539b8 service nova] [instance: 92d215fd-8411-430c-b91e-b6e62e02a994] Received unexpected event network-vif-plugged-358da164-b155-4d24-a006-7454c10ee790 for instance with vm_state deleted and task_state None.
Dec 06 12:55:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'McWeAzDy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:55:51 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:55:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:55:51 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:55:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:55:51 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:55:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[22104ce7-b9f8-49cf-8fdc-1b03b2e5e0ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:55:51 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ca62fe-8acc-4285-84fb-d264b59ca030]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5] added
Dec 06 12:55:51 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f84d48-65ed-43ee-a41c-5e16e583cedf]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2952be-0e97-4937-a95f-4210e2cb0a60]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v McWeAzDy {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v McWeAzDy" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ed9fe9-2277-43d1-b9ac-98708c953a50]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'McWeAzDy'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ab14e1-1a46-4ba0-9469-32dcfa040576]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0845ef0e-ebd4-4822-b1c1-599f9dfc427c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:55:51 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:55:51 user nova-compute[75247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:55:51 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:55:51 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:55:51 user nova-compute[75247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:55:51 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:55:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 -p 172.16.0.220:3260 --login" returned: 0 in 1.071s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea37a20-9b83-4458-a1ad-aa61a4802654]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:55:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5, portal: 172.16.0.220,3260]
Dec 06 12:55:52 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5, portal: 172.16.0.220,3260] successful.
Dec 06 12:55:52 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:55:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:52 user nova-compute[75247]: INFO nova.compute.manager [None req-38110e0d-25a3-463c-be96-f6e52c05cf30 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Unrescuing
Dec 06 12:55:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-38110e0d-25a3-463c-be96-f6e52c05cf30 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "refresh_cache-bc3ddb40-b05f-4170-b269-d44dec6ecdaf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:55:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-38110e0d-25a3-463c-be96-f6e52c05cf30 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquired lock "refresh_cache-bc3ddb40-b05f-4170-b269-d44dec6ecdaf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:55:52 user nova-compute[75247]: DEBUG nova.network.neutron [None req-38110e0d-25a3-463c-be96-f6e52c05cf30 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:55:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76ce465-25e3-4261-888a-899cfa550eb4]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:55:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:55:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ba51f3-f10e-4e84-a866-1dca0ad3fb01]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:55:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:55:52 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:55:52 user nova-compute[75247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:55:52 user nova-compute[75247]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 (non-flash)
Dec 06 12:55:52 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:55:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:55:52 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:55:52 user nova-compute[75247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:55:52 user nova-compute[75247]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 (non-flash)
Dec 06 12:55:52 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:55:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.329s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:55:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:55:52 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:55:52 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:55:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:55:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:55:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de83d58-8259-4eeb-a621-c94c6987ee80]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:55:52 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:55:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'McWeAzDy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-40b11d1a-dd1e-469b-bed6-8dbcc67a2a9f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-40b11d1a-dd1e-469b-bed6-8dbcc67a2a9f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG nova.compute.manager [None req-40b11d1a-dd1e-469b-bed6-8dbcc67a2a9f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Going to confirm migration 2 {{(pid=75247) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG nova.network.neutron [None req-38110e0d-25a3-463c-be96-f6e52c05cf30 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Updating instance_info_cache with network_info: [{"id": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "address": "fa:16:3e:d5:71:f5", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e66d0f0-cc", "ovs_interfaceid": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-38110e0d-25a3-463c-be96-f6e52c05cf30 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Releasing lock "refresh_cache-bc3ddb40-b05f-4170-b269-d44dec6ecdaf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG nova.objects.instance [None req-38110e0d-25a3-463c-be96-f6e52c05cf30 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'flavor' on Instance uuid bc3ddb40-b05f-4170-b269-d44dec6ecdaf {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-40b11d1a-dd1e-469b-bed6-8dbcc67a2a9f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "refresh_cache-b3720cc0-ff80-4ca2-8b13-d83dded593ad" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-40b11d1a-dd1e-469b-bed6-8dbcc67a2a9f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquired lock "refresh_cache-b3720cc0-ff80-4ca2-8b13-d83dded593ad" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG nova.network.neutron [None req-40b11d1a-dd1e-469b-bed6-8dbcc67a2a9f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG nova.objects.instance [None req-40b11d1a-dd1e-469b-bed6-8dbcc67a2a9f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lazy-loading 'info_cache' on Instance uuid b3720cc0-ff80-4ca2-8b13-d83dded593ad {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG nova.compute.manager [req-873fb085-f6f7-4b06-bf11-93ed7e086a0e req-6e9db276-9511-488c-abc1-5663f68e1469 service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received event network-vif-unplugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-873fb085-f6f7-4b06-bf11-93ed7e086a0e req-6e9db276-9511-488c-abc1-5663f68e1469 service nova] Acquiring lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-873fb085-f6f7-4b06-bf11-93ed7e086a0e req-6e9db276-9511-488c-abc1-5663f68e1469 service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-873fb085-f6f7-4b06-bf11-93ed7e086a0e req-6e9db276-9511-488c-abc1-5663f68e1469 service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG nova.compute.manager [req-873fb085-f6f7-4b06-bf11-93ed7e086a0e req-6e9db276-9511-488c-abc1-5663f68e1469 service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] No waiting events found dispatching network-vif-unplugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:55:53 user nova-compute[75247]: WARNING nova.compute.manager [req-873fb085-f6f7-4b06-bf11-93ed7e086a0e req-6e9db276-9511-488c-abc1-5663f68e1469 service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received unexpected event network-vif-unplugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 for instance with vm_state rescued and task_state unrescuing.
Dec 06 12:55:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.367s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] <== connect_volume: return (2369ms) {'type': 'block', 'scsi_wwn': '23836323964366662', 'path': '/dev/sdb'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836323964366662', 'path': '/dev/sdb'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG nova.objects.instance [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lazy-loading 'flavor' on Instance uuid f5b69324-579d-4833-9bb4-c43c511f820d {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG nova.network.neutron [None req-40b11d1a-dd1e-469b-bed6-8dbcc67a2a9f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Updating instance_info_cache with network_info: [{"id": "41d8bb63-57dd-4479-9a1e-89e223d16677", "address": "fa:16:3e:9a:8b:8a", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d8bb63-57", "ovs_interfaceid": "41d8bb63-57dd-4479-9a1e-89e223d16677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 12:55:53 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:55:53 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:55:53 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:55:53 user nova-compute[75247]:   <serial>ae31a6e8-00f8-4b60-95fe-b9949eebcbb5</serial>
Dec 06 12:55:53 user nova-compute[75247]: </disk>
Dec 06 12:55:53 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-40b11d1a-dd1e-469b-bed6-8dbcc67a2a9f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Releasing lock "refresh_cache-b3720cc0-ff80-4ca2-8b13-d83dded593ad" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG nova.objects.instance [None req-40b11d1a-dd1e-469b-bed6-8dbcc67a2a9f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lazy-loading 'migration_context' on Instance uuid b3720cc0-ff80-4ca2-8b13-d83dded593ad {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG nova.objects.base [None req-40b11d1a-dd1e-469b-bed6-8dbcc67a2a9f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Object Instance<b3720cc0-ff80-4ca2-8b13-d83dded593ad> lazy-loaded attributes: info_cache,migration_context {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-40b11d1a-dd1e-469b-bed6-8dbcc67a2a9f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:55:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-40b11d1a-dd1e-469b-bed6-8dbcc67a2a9f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:55:54 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-40b11d1a-dd1e-469b-bed6-8dbcc67a2a9f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:55:54 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-40b11d1a-dd1e-469b-bed6-8dbcc67a2a9f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:55:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:54 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Instance destroyed successfully.
Dec 06 12:55:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-40b11d1a-dd1e-469b-bed6-8dbcc67a2a9f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.468s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:55:54 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:55:54 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:55:54 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] No VIF found with MAC fa:16:3e:88:16:dd, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:55:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-840988e6-6d67-45e5-a21e-8739c7aebe14 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.421s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:55:54 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-40b11d1a-dd1e-469b-bed6-8dbcc67a2a9f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Deleted allocation for migration a28e36c3-e15d-45e3-9f84-3ac928105559
Dec 06 12:55:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-40b11d1a-dd1e-469b-bed6-8dbcc67a2a9f tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.597s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:55:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:55 user nova-compute[75247]: DEBUG nova.compute.manager [req-5a3ef681-d966-46d0-bd9b-b90d67c73fb7 req-5286f747-f2b0-4698-ae5d-9e6ad86afcb5 service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received event network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:55:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5a3ef681-d966-46d0-bd9b-b90d67c73fb7 req-5286f747-f2b0-4698-ae5d-9e6ad86afcb5 service nova] Acquiring lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:55:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5a3ef681-d966-46d0-bd9b-b90d67c73fb7 req-5286f747-f2b0-4698-ae5d-9e6ad86afcb5 service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:55:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5a3ef681-d966-46d0-bd9b-b90d67c73fb7 req-5286f747-f2b0-4698-ae5d-9e6ad86afcb5 service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:55:55 user nova-compute[75247]: DEBUG nova.compute.manager [req-5a3ef681-d966-46d0-bd9b-b90d67c73fb7 req-5286f747-f2b0-4698-ae5d-9e6ad86afcb5 service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] No waiting events found dispatching network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:55:55 user nova-compute[75247]: WARNING nova.compute.manager [req-5a3ef681-d966-46d0-bd9b-b90d67c73fb7 req-5286f747-f2b0-4698-ae5d-9e6ad86afcb5 service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received unexpected event network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 for instance with vm_state rescued and task_state unrescuing.
Dec 06 12:55:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:57 user nova-compute[75247]: DEBUG nova.compute.manager [req-0d8f7deb-7e01-4f6a-898c-a267ee40a4a9 req-afe81467-e517-45a2-8940-71104cc45fdd service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received event network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:55:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0d8f7deb-7e01-4f6a-898c-a267ee40a4a9 req-afe81467-e517-45a2-8940-71104cc45fdd service nova] Acquiring lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:55:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0d8f7deb-7e01-4f6a-898c-a267ee40a4a9 req-afe81467-e517-45a2-8940-71104cc45fdd service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:55:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0d8f7deb-7e01-4f6a-898c-a267ee40a4a9 req-afe81467-e517-45a2-8940-71104cc45fdd service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:55:57 user nova-compute[75247]: DEBUG nova.compute.manager [req-0d8f7deb-7e01-4f6a-898c-a267ee40a4a9 req-afe81467-e517-45a2-8940-71104cc45fdd service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] No waiting events found dispatching network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:55:57 user nova-compute[75247]: WARNING nova.compute.manager [req-0d8f7deb-7e01-4f6a-898c-a267ee40a4a9 req-afe81467-e517-45a2-8940-71104cc45fdd service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received unexpected event network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 for instance with vm_state rescued and task_state unrescuing.
Dec 06 12:55:57 user nova-compute[75247]: DEBUG nova.compute.manager [req-0d8f7deb-7e01-4f6a-898c-a267ee40a4a9 req-afe81467-e517-45a2-8940-71104cc45fdd service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received event network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:55:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0d8f7deb-7e01-4f6a-898c-a267ee40a4a9 req-afe81467-e517-45a2-8940-71104cc45fdd service nova] Acquiring lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:55:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0d8f7deb-7e01-4f6a-898c-a267ee40a4a9 req-afe81467-e517-45a2-8940-71104cc45fdd service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:55:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0d8f7deb-7e01-4f6a-898c-a267ee40a4a9 req-afe81467-e517-45a2-8940-71104cc45fdd service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:55:57 user nova-compute[75247]: DEBUG nova.compute.manager [req-0d8f7deb-7e01-4f6a-898c-a267ee40a4a9 req-afe81467-e517-45a2-8940-71104cc45fdd service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] No waiting events found dispatching network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:55:57 user nova-compute[75247]: WARNING nova.compute.manager [req-0d8f7deb-7e01-4f6a-898c-a267ee40a4a9 req-afe81467-e517-45a2-8940-71104cc45fdd service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received unexpected event network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 for instance with vm_state rescued and task_state unrescuing.
Dec 06 12:55:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:55:58 user nova-compute[75247]: DEBUG nova.compute.manager [None req-38110e0d-25a3-463c-be96-f6e52c05cf30 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:55:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4a4e02c4-2344-4450-9742-a4573f506f86 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Acquiring lock "7d508276-60ac-4d77-a930-bfc8b745f243" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:56:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4a4e02c4-2344-4450-9742-a4573f506f86 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "7d508276-60ac-4d77-a930-bfc8b745f243" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:56:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4a4e02c4-2344-4450-9742-a4573f506f86 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Acquiring lock "7d508276-60ac-4d77-a930-bfc8b745f243-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:56:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4a4e02c4-2344-4450-9742-a4573f506f86 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "7d508276-60ac-4d77-a930-bfc8b745f243-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:56:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4a4e02c4-2344-4450-9742-a4573f506f86 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "7d508276-60ac-4d77-a930-bfc8b745f243-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:56:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:04 user nova-compute[75247]: INFO nova.compute.manager [None req-4a4e02c4-2344-4450-9742-a4573f506f86 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Terminating instance
Dec 06 12:56:04 user nova-compute[75247]: DEBUG nova.compute.manager [None req-4a4e02c4-2344-4450-9742-a4573f506f86 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:56:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:04 user nova-compute[75247]: DEBUG nova.compute.manager [req-57a85a80-d163-4636-a919-fae3a915e51a req-bcd1c6ba-505c-423a-87c8-d8bd6b02c887 service nova] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Received event network-vif-unplugged-74668015-d48f-4ebb-92a1-c0603025cdae {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:56:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-57a85a80-d163-4636-a919-fae3a915e51a req-bcd1c6ba-505c-423a-87c8-d8bd6b02c887 service nova] Acquiring lock "7d508276-60ac-4d77-a930-bfc8b745f243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:56:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-57a85a80-d163-4636-a919-fae3a915e51a req-bcd1c6ba-505c-423a-87c8-d8bd6b02c887 service nova] Lock "7d508276-60ac-4d77-a930-bfc8b745f243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:56:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-57a85a80-d163-4636-a919-fae3a915e51a req-bcd1c6ba-505c-423a-87c8-d8bd6b02c887 service nova] Lock "7d508276-60ac-4d77-a930-bfc8b745f243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:56:04 user nova-compute[75247]: DEBUG nova.compute.manager [req-57a85a80-d163-4636-a919-fae3a915e51a req-bcd1c6ba-505c-423a-87c8-d8bd6b02c887 service nova] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] No waiting events found dispatching network-vif-unplugged-74668015-d48f-4ebb-92a1-c0603025cdae {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:56:04 user nova-compute[75247]: DEBUG nova.compute.manager [req-57a85a80-d163-4636-a919-fae3a915e51a req-bcd1c6ba-505c-423a-87c8-d8bd6b02c887 service nova] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Received event network-vif-unplugged-74668015-d48f-4ebb-92a1-c0603025cdae for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:56:04 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Instance destroyed successfully.
Dec 06 12:56:04 user nova-compute[75247]: DEBUG nova.objects.instance [None req-4a4e02c4-2344-4450-9742-a4573f506f86 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lazy-loading 'resources' on Instance uuid 7d508276-60ac-4d77-a930-bfc8b745f243 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:56:05 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-4a4e02c4-2344-4450-9742-a4573f506f86 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1134137317',display_name='tempest-VolumesActionsTest-instance-1134137317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1134137317',id=34,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:54:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea74e3cf3f254f0b8b6eec14ecc8c80e',ramdisk_id='',reservation_id='r-by1q06wx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-72234739',owner_user_name='tempest-VolumesActionsTest-72234739-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:54:21Z,user_data=None,user_id='7d662e0050774501a04828dcd6d3b63f',uuid=7d508276-60ac-4d77-a930-bfc8b745f243,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74668015-d48f-4ebb-92a1-c0603025cdae", "address": "fa:16:3e:3e:cc:2c", "network": {"id": "c46a4b1b-086d-48c6-83cb-a4b88077781f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-70878896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea74e3cf3f254f0b8b6eec14ecc8c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74668015-d4", "ovs_interfaceid": "74668015-d48f-4ebb-92a1-c0603025cdae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:56:05 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-4a4e02c4-2344-4450-9742-a4573f506f86 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Converting VIF {"id": "74668015-d48f-4ebb-92a1-c0603025cdae", "address": "fa:16:3e:3e:cc:2c", "network": {"id": "c46a4b1b-086d-48c6-83cb-a4b88077781f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-70878896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea74e3cf3f254f0b8b6eec14ecc8c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74668015-d4", "ovs_interfaceid": "74668015-d48f-4ebb-92a1-c0603025cdae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:56:05 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-4a4e02c4-2344-4450-9742-a4573f506f86 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:cc:2c,bridge_name='br-int',has_traffic_filtering=True,id=74668015-d48f-4ebb-92a1-c0603025cdae,network=Network(c46a4b1b-086d-48c6-83cb-a4b88077781f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74668015-d4') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:56:05 user nova-compute[75247]: DEBUG os_vif [None req-4a4e02c4-2344-4450-9742-a4573f506f86 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:cc:2c,bridge_name='br-int',has_traffic_filtering=True,id=74668015-d48f-4ebb-92a1-c0603025cdae,network=Network(c46a4b1b-086d-48c6-83cb-a4b88077781f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74668015-d4') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:56:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74668015-d4, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:56:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:56:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85529a5b-313b-45f4-a7d4-c3ed054c0d8e) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:56:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:05 user nova-compute[75247]: INFO os_vif [None req-4a4e02c4-2344-4450-9742-a4573f506f86 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:cc:2c,bridge_name='br-int',has_traffic_filtering=True,id=74668015-d48f-4ebb-92a1-c0603025cdae,network=Network(c46a4b1b-086d-48c6-83cb-a4b88077781f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74668015-d4')
Dec 06 12:56:05 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-4a4e02c4-2344-4450-9742-a4573f506f86 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Deleting instance files /opt/stack/data/nova/instances/7d508276-60ac-4d77-a930-bfc8b745f243_del
Dec 06 12:56:05 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-4a4e02c4-2344-4450-9742-a4573f506f86 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Deletion of /opt/stack/data/nova/instances/7d508276-60ac-4d77-a930-bfc8b745f243_del complete
Dec 06 12:56:05 user nova-compute[75247]: INFO nova.compute.manager [None req-4a4e02c4-2344-4450-9742-a4573f506f86 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Took 0.73 seconds to destroy the instance on the hypervisor.
Dec 06 12:56:05 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-4a4e02c4-2344-4450-9742-a4573f506f86 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:56:05 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:56:05 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:56:05 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:56:05 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Took 0.70 seconds to deallocate network for instance.
Dec 06 12:56:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-d0211910-638a-466b-9be6-1639663dd117 req-84104d08-caeb-48ae-982d-3867adb82efc service nova] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Received event network-vif-deleted-74668015-d48f-4ebb-92a1-c0603025cdae {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:56:05 user nova-compute[75247]: INFO nova.compute.manager [req-d0211910-638a-466b-9be6-1639663dd117 req-84104d08-caeb-48ae-982d-3867adb82efc service nova] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Neutron deleted interface 74668015-d48f-4ebb-92a1-c0603025cdae; detaching it from the instance and deleting it from the info cache
Dec 06 12:56:05 user nova-compute[75247]: DEBUG nova.network.neutron [req-d0211910-638a-466b-9be6-1639663dd117 req-84104d08-caeb-48ae-982d-3867adb82efc service nova] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:56:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-d0211910-638a-466b-9be6-1639663dd117 req-84104d08-caeb-48ae-982d-3867adb82efc service nova] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Detach interface failed, port_id=74668015-d48f-4ebb-92a1-c0603025cdae, reason: Instance 7d508276-60ac-4d77-a930-bfc8b745f243 could not be found. {{(pid=75247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 12:56:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4a4e02c4-2344-4450-9742-a4573f506f86 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:56:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4a4e02c4-2344-4450-9742-a4573f506f86 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:56:06 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-4a4e02c4-2344-4450-9742-a4573f506f86 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:56:06 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-4a4e02c4-2344-4450-9742-a4573f506f86 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:56:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4a4e02c4-2344-4450-9742-a4573f506f86 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:56:06 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-4a4e02c4-2344-4450-9742-a4573f506f86 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Deleted allocations for instance 7d508276-60ac-4d77-a930-bfc8b745f243
Dec 06 12:56:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4a4e02c4-2344-4450-9742-a4573f506f86 tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "7d508276-60ac-4d77-a930-bfc8b745f243" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.020s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:56:06 user nova-compute[75247]: DEBUG nova.compute.manager [req-39b557b6-af7c-4f90-9887-8c5d04f412c2 req-d345f127-bfd1-4bbd-8aea-8ac8baec199e service nova] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Received event network-vif-plugged-74668015-d48f-4ebb-92a1-c0603025cdae {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:56:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-39b557b6-af7c-4f90-9887-8c5d04f412c2 req-d345f127-bfd1-4bbd-8aea-8ac8baec199e service nova] Acquiring lock "7d508276-60ac-4d77-a930-bfc8b745f243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:56:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-39b557b6-af7c-4f90-9887-8c5d04f412c2 req-d345f127-bfd1-4bbd-8aea-8ac8baec199e service nova] Lock "7d508276-60ac-4d77-a930-bfc8b745f243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:56:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-39b557b6-af7c-4f90-9887-8c5d04f412c2 req-d345f127-bfd1-4bbd-8aea-8ac8baec199e service nova] Lock "7d508276-60ac-4d77-a930-bfc8b745f243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:56:06 user nova-compute[75247]: DEBUG nova.compute.manager [req-39b557b6-af7c-4f90-9887-8c5d04f412c2 req-d345f127-bfd1-4bbd-8aea-8ac8baec199e service nova] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] No waiting events found dispatching network-vif-plugged-74668015-d48f-4ebb-92a1-c0603025cdae {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:56:06 user nova-compute[75247]: WARNING nova.compute.manager [req-39b557b6-af7c-4f90-9887-8c5d04f412c2 req-d345f127-bfd1-4bbd-8aea-8ac8baec199e service nova] [instance: 7d508276-60ac-4d77-a930-bfc8b745f243] Received unexpected event network-vif-plugged-74668015-d48f-4ebb-92a1-c0603025cdae for instance with vm_state deleted and task_state None.
Dec 06 12:56:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:09 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:56:09 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75247) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 12:56:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:11 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:56:12 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:56:13 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:56:13 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:56:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "f5b69324-579d-4833-9bb4-c43c511f820d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:56:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:56:15 user nova-compute[75247]: INFO nova.compute.manager [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Detaching volume ae31a6e8-00f8-4b60-95fe-b9949eebcbb5
Dec 06 12:56:15 user nova-compute[75247]: INFO nova.virt.block_device [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Attempting to driver detach volume ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 from mountpoint /dev/vdb
Dec 06 12:56:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Attempting to detach device vdb from instance f5b69324-579d-4833-9bb4-c43c511f820d from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 12:56:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:56:15 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:56:15 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:56:15 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:56:15 user nova-compute[75247]:   <serial>ae31a6e8-00f8-4b60-95fe-b9949eebcbb5</serial>
Dec 06 12:56:15 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:56:15 user nova-compute[75247]: </disk>
Dec 06 12:56:15 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:56:15 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Successfully detached device vdb from instance f5b69324-579d-4833-9bb4-c43c511f820d from the persistent domain config.
Dec 06 12:56:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f5b69324-579d-4833-9bb4-c43c511f820d from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 12:56:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:56:15 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:56:15 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:56:15 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:56:15 user nova-compute[75247]:   <serial>ae31a6e8-00f8-4b60-95fe-b9949eebcbb5</serial>
Dec 06 12:56:15 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:56:15 user nova-compute[75247]: </disk>
Dec 06 12:56:15 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:56:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f5b69324-579d-4833-9bb4-c43c511f820d {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 12:56:15 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:56:15 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 12:56:16 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:56:16 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 12:56:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:56:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:56:17 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 12:56:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Acquiring lock "a94db53f-e791-4e0f-8c4f-3b292f00a24a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:56:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "a94db53f-e791-4e0f-8c4f-3b292f00a24a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:56:17 user nova-compute[75247]: DEBUG nova.compute.manager [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:56:17 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Updating instance_info_cache with network_info: [{"id": "6ed7f42b-d2d5-4663-8943-e016c1acfe5c", "address": "fa:16:3e:30:47:63", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed7f42b-d2", "ovs_interfaceid": "6ed7f42b-d2d5-4663-8943-e016c1acfe5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:56:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:56:17 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 12:56:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:56:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:56:17 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:56:17 user nova-compute[75247]: INFO nova.compute.claims [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Claim successful on node user
Dec 06 12:56:17 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Refreshing inventories for resource provider d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 12:56:17 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Updating ProviderTree inventory for provider d326b140-3450-4409-964c-9eafc6cc025d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 12:56:17 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Updating inventory in ProviderTree for provider d326b140-3450-4409-964c-9eafc6cc025d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 12:56:17 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Refreshing aggregate associations for resource provider d326b140-3450-4409-964c-9eafc6cc025d, aggregates: None {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 12:56:17 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Refreshing trait associations for resource provider d326b140-3450-4409-964c-9eafc6cc025d, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 12:56:17 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:56:17 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:56:17 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:56:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.537s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:56:18 user nova-compute[75247]: DEBUG nova.compute.manager [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:56:18 user nova-compute[75247]: DEBUG nova.compute.manager [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:56:18 user nova-compute[75247]: DEBUG nova.network.neutron [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:56:18 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:56:18 user nova-compute[75247]: DEBUG nova.compute.manager [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:56:18 user nova-compute[75247]: DEBUG nova.policy [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9462e4a57abb48f88f022c3486304df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c750eec93d4bfb9f7d61b6445d9e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:56:18 user nova-compute[75247]: DEBUG nova.compute.manager [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:56:18 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:56:18 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Creating image(s)
Dec 06 12:56:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Acquiring lock "/opt/stack/data/nova/instances/a94db53f-e791-4e0f-8c4f-3b292f00a24a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:56:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "/opt/stack/data/nova/instances/a94db53f-e791-4e0f-8c4f-3b292f00a24a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:56:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "/opt/stack/data/nova/instances/a94db53f-e791-4e0f-8c4f-3b292f00a24a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:56:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.174s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:56:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:56:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.176s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/a94db53f-e791-4e0f-8c4f-3b292f00a24a/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/a94db53f-e791-4e0f-8c4f-3b292f00a24a/disk 1073741824" returned: 0 in 0.089s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:56:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.173s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:18 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a94db53f-e791-4e0f-8c4f-3b292f00a24a/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:56:18 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94db53f-e791-4e0f-8c4f-3b292f00a24a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94db53f-e791-4e0f-8c4f-3b292f00a24a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:19 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Cannot resize image /opt/stack/data/nova/instances/a94db53f-e791-4e0f-8c4f-3b292f00a24a/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:56:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:56:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Ensure instance console log exists: /opt/stack/data/nova/instances/a94db53f-e791-4e0f-8c4f-3b292f00a24a/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:56:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:56:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:56:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:56:19 user nova-compute[75247]: DEBUG nova.network.neutron [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Successfully created port: 01209cad-6739-4725-9f7e-5836a9ad691e {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:56:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:19 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:56:19 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:56:19 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:56:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:56:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:56:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:56:19 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 12:56:19 user nova-compute[75247]: DEBUG nova.network.neutron [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Successfully updated port: 01209cad-6739-4725-9f7e-5836a9ad691e {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Acquiring lock "refresh_cache-a94db53f-e791-4e0f-8c4f-3b292f00a24a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Acquired lock "refresh_cache-a94db53f-e791-4e0f-8c4f-3b292f00a24a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.network.neutron [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-d8444a90-60e4-469c-96f2-d2f892ef62ff req-8e9fb0b9-c28a-411f-a498-331e66900867 service nova] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Received event network-changed-01209cad-6739-4725-9f7e-5836a9ad691e {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-d8444a90-60e4-469c-96f2-d2f892ef62ff req-8e9fb0b9-c28a-411f-a498-331e66900867 service nova] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Refreshing instance network info cache due to event network-changed-01209cad-6739-4725-9f7e-5836a9ad691e. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d8444a90-60e4-469c-96f2-d2f892ef62ff req-8e9fb0b9-c28a-411f-a498-331e66900867 service nova] Acquiring lock "refresh_cache-a94db53f-e791-4e0f-8c4f-3b292f00a24a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.network.neutron [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.network.neutron [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Updating instance_info_cache with network_info: [{"id": "01209cad-6739-4725-9f7e-5836a9ad691e", "address": "fa:16:3e:b7:54:dd", "network": {"id": "8691a7c7-5761-40a7-962e-880f95352b9a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-919731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8c750eec93d4bfb9f7d61b6445d9e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01209cad-67", "ovs_interfaceid": "01209cad-6739-4725-9f7e-5836a9ad691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Releasing lock "refresh_cache-a94db53f-e791-4e0f-8c4f-3b292f00a24a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.compute.manager [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Instance network_info: |[{"id": "01209cad-6739-4725-9f7e-5836a9ad691e", "address": "fa:16:3e:b7:54:dd", "network": {"id": "8691a7c7-5761-40a7-962e-880f95352b9a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-919731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8c750eec93d4bfb9f7d61b6445d9e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01209cad-67", "ovs_interfaceid": "01209cad-6739-4725-9f7e-5836a9ad691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d8444a90-60e4-469c-96f2-d2f892ef62ff req-8e9fb0b9-c28a-411f-a498-331e66900867 service nova] Acquired lock "refresh_cache-a94db53f-e791-4e0f-8c4f-3b292f00a24a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.network.neutron [req-d8444a90-60e4-469c-96f2-d2f892ef62ff req-8e9fb0b9-c28a-411f-a498-331e66900867 service nova] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Refreshing network info cache for port 01209cad-6739-4725-9f7e-5836a9ad691e {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Start _get_guest_xml network_info=[{"id": "01209cad-6739-4725-9f7e-5836a9ad691e", "address": "fa:16:3e:b7:54:dd", "network": {"id": "8691a7c7-5761-40a7-962e-880f95352b9a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-919731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8c750eec93d4bfb9f7d61b6445d9e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01209cad-67", "ovs_interfaceid": "01209cad-6739-4725-9f7e-5836a9ad691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:56:20 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:56:20 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:56:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1622790842',display_name='tempest-ServersNegativeTestJSON-server-1622790842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1622790842',id=36,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8c750eec93d4bfb9f7d61b6445d9e42',ramdisk_id='',reservation_id='r-mfoyxp13',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-521653173',owner_user_name='tempest-ServersNegativeTestJSON-521653173-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:56:18Z,user_data=None,user_id='9462e4a57abb48f88f022c3486304df1',uuid=a94db53f-e791-4e0f-8c4f-3b292f00a24a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01209cad-6739-4725-9f7e-5836a9ad691e", "address": "fa:16:3e:b7:54:dd", "network": {"id": "8691a7c7-5761-40a7-962e-880f95352b9a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-919731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8c750eec93d4bfb9f7d61b6445d9e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01209cad-67", "ovs_interfaceid": "01209cad-6739-4725-9f7e-5836a9ad691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Converting VIF {"id": "01209cad-6739-4725-9f7e-5836a9ad691e", "address": "fa:16:3e:b7:54:dd", "network": {"id": "8691a7c7-5761-40a7-962e-880f95352b9a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-919731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8c750eec93d4bfb9f7d61b6445d9e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01209cad-67", "ovs_interfaceid": "01209cad-6739-4725-9f7e-5836a9ad691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:54:dd,bridge_name='br-int',has_traffic_filtering=True,id=01209cad-6739-4725-9f7e-5836a9ad691e,network=Network(8691a7c7-5761-40a7-962e-880f95352b9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01209cad-67') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.objects.instance [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lazy-loading 'pci_devices' on Instance uuid a94db53f-e791-4e0f-8c4f-3b292f00a24a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:56:20 user nova-compute[75247]:   <uuid>a94db53f-e791-4e0f-8c4f-3b292f00a24a</uuid>
Dec 06 12:56:20 user nova-compute[75247]:   <name>instance-00000024</name>
Dec 06 12:56:20 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:56:20 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:56:20 user nova-compute[75247]:   <metadata>
Dec 06 12:56:20 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:56:20 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:56:20 user nova-compute[75247]:       <nova:name>tempest-ServersNegativeTestJSON-server-1622790842</nova:name>
Dec 06 12:56:20 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:56:20</nova:creationTime>
Dec 06 12:56:20 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:56:20 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:56:20 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:56:20 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:56:20 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:56:20 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:56:20 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:56:20 user nova-compute[75247]:       <nova:owner>
Dec 06 12:56:20 user nova-compute[75247]:         <nova:user uuid="9462e4a57abb48f88f022c3486304df1">tempest-ServersNegativeTestJSON-521653173-project-member</nova:user>
Dec 06 12:56:20 user nova-compute[75247]:         <nova:project uuid="b8c750eec93d4bfb9f7d61b6445d9e42">tempest-ServersNegativeTestJSON-521653173</nova:project>
Dec 06 12:56:20 user nova-compute[75247]:       </nova:owner>
Dec 06 12:56:20 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:56:20 user nova-compute[75247]:       <nova:ports>
Dec 06 12:56:20 user nova-compute[75247]:         <nova:port uuid="01209cad-6739-4725-9f7e-5836a9ad691e">
Dec 06 12:56:20 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 06 12:56:20 user nova-compute[75247]:         </nova:port>
Dec 06 12:56:20 user nova-compute[75247]:       </nova:ports>
Dec 06 12:56:20 user nova-compute[75247]:     </nova:instance>
Dec 06 12:56:20 user nova-compute[75247]:   </metadata>
Dec 06 12:56:20 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:56:20 user nova-compute[75247]:     <system>
Dec 06 12:56:20 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:56:20 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:56:20 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:56:20 user nova-compute[75247]:       <entry name="serial">a94db53f-e791-4e0f-8c4f-3b292f00a24a</entry>
Dec 06 12:56:20 user nova-compute[75247]:       <entry name="uuid">a94db53f-e791-4e0f-8c4f-3b292f00a24a</entry>
Dec 06 12:56:20 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:56:20 user nova-compute[75247]:     </system>
Dec 06 12:56:20 user nova-compute[75247]:   </sysinfo>
Dec 06 12:56:20 user nova-compute[75247]:   <os>
Dec 06 12:56:20 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:56:20 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:56:20 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:56:20 user nova-compute[75247]:   </os>
Dec 06 12:56:20 user nova-compute[75247]:   <features>
Dec 06 12:56:20 user nova-compute[75247]:     <acpi/>
Dec 06 12:56:20 user nova-compute[75247]:     <apic/>
Dec 06 12:56:20 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:56:20 user nova-compute[75247]:   </features>
Dec 06 12:56:20 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:56:20 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:56:20 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:56:20 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:56:20 user nova-compute[75247]:   </clock>
Dec 06 12:56:20 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:56:20 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:56:20 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:56:20 user nova-compute[75247]:   </cpu>
Dec 06 12:56:20 user nova-compute[75247]:   <devices>
Dec 06 12:56:20 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:56:20 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:56:20 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/a94db53f-e791-4e0f-8c4f-3b292f00a24a/disk"/>
Dec 06 12:56:20 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:56:20 user nova-compute[75247]:     </disk>
Dec 06 12:56:20 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:56:20 user nova-compute[75247]:       <mac address="fa:16:3e:b7:54:dd"/>
Dec 06 12:56:20 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:56:20 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:56:20 user nova-compute[75247]:       <target dev="tap01209cad-67"/>
Dec 06 12:56:20 user nova-compute[75247]:     </interface>
Dec 06 12:56:20 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:56:20 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/a94db53f-e791-4e0f-8c4f-3b292f00a24a/console.log" append="off"/>
Dec 06 12:56:20 user nova-compute[75247]:     </serial>
Dec 06 12:56:20 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:56:20 user nova-compute[75247]:     <video>
Dec 06 12:56:20 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:56:20 user nova-compute[75247]:     </video>
Dec 06 12:56:20 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:56:20 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:56:20 user nova-compute[75247]:     </rng>
Dec 06 12:56:20 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:56:20 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:56:20 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:56:20 user nova-compute[75247]:     </memballoon>
Dec 06 12:56:20 user nova-compute[75247]:   </devices>
Dec 06 12:56:20 user nova-compute[75247]: </domain>
Dec 06 12:56:20 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:56:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1622790842',display_name='tempest-ServersNegativeTestJSON-server-1622790842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1622790842',id=36,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8c750eec93d4bfb9f7d61b6445d9e42',ramdisk_id='',reservation_id='r-mfoyxp13',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-521653173',owner_user_name='tempest-ServersNegativeTestJSON-521653173-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:56:18Z,user_data=None,user_id='9462e4a57abb48f88f022c3486304df1',uuid=a94db53f-e791-4e0f-8c4f-3b292f00a24a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01209cad-6739-4725-9f7e-5836a9ad691e", "address": "fa:16:3e:b7:54:dd", "network": {"id": "8691a7c7-5761-40a7-962e-880f95352b9a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-919731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8c750eec93d4bfb9f7d61b6445d9e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01209cad-67", "ovs_interfaceid": "01209cad-6739-4725-9f7e-5836a9ad691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Converting VIF {"id": "01209cad-6739-4725-9f7e-5836a9ad691e", "address": "fa:16:3e:b7:54:dd", "network": {"id": "8691a7c7-5761-40a7-962e-880f95352b9a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-919731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8c750eec93d4bfb9f7d61b6445d9e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01209cad-67", "ovs_interfaceid": "01209cad-6739-4725-9f7e-5836a9ad691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:54:dd,bridge_name='br-int',has_traffic_filtering=True,id=01209cad-6739-4725-9f7e-5836a9ad691e,network=Network(8691a7c7-5761-40a7-962e-880f95352b9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01209cad-67') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG os_vif [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:54:dd,bridge_name='br-int',has_traffic_filtering=True,id=01209cad-6739-4725-9f7e-5836a9ad691e,network=Network(8691a7c7-5761-40a7-962e-880f95352b9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01209cad-67') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d4c0654-f014-5f65-91b5-b7ff69c29ff2', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01209cad-67, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01209cad-67, col_values=(('qos', UUID('10edb670-eb27-40ad-9281-3511ef65e64e')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01209cad-67, col_values=(('external_ids', {'iface-id': '01209cad-6739-4725-9f7e-5836a9ad691e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:54:dd', 'vm-uuid': 'a94db53f-e791-4e0f-8c4f-3b292f00a24a'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:20 user nova-compute[75247]: INFO os_vif [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:54:dd,bridge_name='br-int',has_traffic_filtering=True,id=01209cad-6739-4725-9f7e-5836a9ad691e,network=Network(8691a7c7-5761-40a7-962e-880f95352b9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01209cad-67')
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] No VIF found with MAC fa:16:3e:b7:54:dd, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:21 user nova-compute[75247]: DEBUG nova.network.neutron [req-d8444a90-60e4-469c-96f2-d2f892ef62ff req-8e9fb0b9-c28a-411f-a498-331e66900867 service nova] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Updated VIF entry in instance network info cache for port 01209cad-6739-4725-9f7e-5836a9ad691e. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:56:21 user nova-compute[75247]: DEBUG nova.network.neutron [req-d8444a90-60e4-469c-96f2-d2f892ef62ff req-8e9fb0b9-c28a-411f-a498-331e66900867 service nova] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Updating instance_info_cache with network_info: [{"id": "01209cad-6739-4725-9f7e-5836a9ad691e", "address": "fa:16:3e:b7:54:dd", "network": {"id": "8691a7c7-5761-40a7-962e-880f95352b9a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-919731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8c750eec93d4bfb9f7d61b6445d9e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01209cad-67", "ovs_interfaceid": "01209cad-6739-4725-9f7e-5836a9ad691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:56:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d8444a90-60e4-469c-96f2-d2f892ef62ff req-8e9fb0b9-c28a-411f-a498-331e66900867 service nova] Releasing lock "refresh_cache-a94db53f-e791-4e0f-8c4f-3b292f00a24a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:56:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:56:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-616e22ee-1e3f-41f8-967c-9ad8b722fa0d req-781d7e9f-24f5-45cf-b73c-5f40fec808a5 service nova] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Received event network-vif-plugged-01209cad-6739-4725-9f7e-5836a9ad691e {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:56:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-616e22ee-1e3f-41f8-967c-9ad8b722fa0d req-781d7e9f-24f5-45cf-b73c-5f40fec808a5 service nova] Acquiring lock "a94db53f-e791-4e0f-8c4f-3b292f00a24a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:56:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-616e22ee-1e3f-41f8-967c-9ad8b722fa0d req-781d7e9f-24f5-45cf-b73c-5f40fec808a5 service nova] Lock "a94db53f-e791-4e0f-8c4f-3b292f00a24a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:56:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-616e22ee-1e3f-41f8-967c-9ad8b722fa0d req-781d7e9f-24f5-45cf-b73c-5f40fec808a5 service nova] Lock "a94db53f-e791-4e0f-8c4f-3b292f00a24a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:56:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-616e22ee-1e3f-41f8-967c-9ad8b722fa0d req-781d7e9f-24f5-45cf-b73c-5f40fec808a5 service nova] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] No waiting events found dispatching network-vif-plugged-01209cad-6739-4725-9f7e-5836a9ad691e {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:56:22 user nova-compute[75247]: WARNING nova.compute.manager [req-616e22ee-1e3f-41f8-967c-9ad8b722fa0d req-781d7e9f-24f5-45cf-b73c-5f40fec808a5 service nova] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Received unexpected event network-vif-plugged-01209cad-6739-4725-9f7e-5836a9ad691e for instance with vm_state building and task_state spawning.
Dec 06 12:56:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:56:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:56:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.compute.manager [req-616f2583-eb35-4d5e-9f91-cca14b0ec69e req-819d9e54-4360-48dd-ad64-4a6e230156ed service nova] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Received event network-vif-plugged-01209cad-6739-4725-9f7e-5836a9ad691e {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-616f2583-eb35-4d5e-9f91-cca14b0ec69e req-819d9e54-4360-48dd-ad64-4a6e230156ed service nova] Acquiring lock "a94db53f-e791-4e0f-8c4f-3b292f00a24a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-616f2583-eb35-4d5e-9f91-cca14b0ec69e req-819d9e54-4360-48dd-ad64-4a6e230156ed service nova] Lock "a94db53f-e791-4e0f-8c4f-3b292f00a24a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-616f2583-eb35-4d5e-9f91-cca14b0ec69e req-819d9e54-4360-48dd-ad64-4a6e230156ed service nova] Lock "a94db53f-e791-4e0f-8c4f-3b292f00a24a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.compute.manager [req-616f2583-eb35-4d5e-9f91-cca14b0ec69e req-819d9e54-4360-48dd-ad64-4a6e230156ed service nova] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] No waiting events found dispatching network-vif-plugged-01209cad-6739-4725-9f7e-5836a9ad691e {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:56:24 user nova-compute[75247]: WARNING nova.compute.manager [req-616f2583-eb35-4d5e-9f91-cca14b0ec69e req-819d9e54-4360-48dd-ad64-4a6e230156ed service nova] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Received unexpected event network-vif-plugged-01209cad-6739-4725-9f7e-5836a9ad691e for instance with vm_state building and task_state spawning.
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.compute.manager [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:56:24 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Instance spawned successfully.
Dec 06 12:56:24 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:56:24 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=7622MB free_disk=24.912277221679688GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:56:24 user nova-compute[75247]: INFO nova.compute.manager [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Took 6.41 seconds to spawn the instance on the hypervisor.
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.compute.manager [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 70c4664e-ae7a-47de-bba7-18300391d209 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 782289e2-91cd-4aee-9a08-eadfb2a5965b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 3e1b5197-dc38-48a5-b9f9-e053be499433 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance bc3ddb40-b05f-4170-b269-d44dec6ecdaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 530cfb75-7aa8-4e57-b282-8f7a21401b34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 6d767ae1-4df2-4e87-b991-729fabd467f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance f5b69324-579d-4833-9bb4-c43c511f820d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance b3720cc0-ff80-4ca2-8b13-d83dded593ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance c603d6dc-804e-4c0d-be1f-40e09de74e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance a94db53f-e791-4e0f-8c4f-3b292f00a24a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 12:56:24 user nova-compute[75247]: INFO nova.compute.manager [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Took 7.34 seconds to build instance.
Dec 06 12:56:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3b235ba5-a904-4f9a-9a0b-e924c5d55d14 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "a94db53f-e791-4e0f-8c4f-3b292f00a24a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.448s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:56:24 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:56:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 12:56:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.539s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:56:25 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:56:25 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Cleaning up deleted instances {{(pid=75247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 12:56:25 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] There are 0 instances to clean {{(pid=75247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 12:56:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:33 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:56:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:35 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f5b69324-579d-4833-9bb4-c43c511f820d is timed out.
Dec 06 12:56:35 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Successfully detached device vdb from instance f5b69324-579d-4833-9bb4-c43c511f820d from the live domain config.
Dec 06 12:56:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'McWeAzDy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:56:35 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:56:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3df13b-90b3-4187-9b1c-85af3cdf4818]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:56:35 user nova-compute[75247]: No targets found.
Dec 06 12:56:35 user nova-compute[75247]: iSNS:
Dec 06 12:56:35 user nova-compute[75247]: No targets found.
Dec 06 12:56:35 user nova-compute[75247]: STATIC:
Dec 06 12:56:35 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:56:35 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:56:35 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:56:35 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5
Dec 06 12:56:35 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:56:35 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:56:35 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33
Dec 06 12:56:35 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:56:35 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:56:35 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31
Dec 06 12:56:35 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:56:35 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:56:35 user nova-compute[75247]: FIRMWARE:
Dec 06 12:56:35 user nova-compute[75247]: No targets found.
Dec 06 12:56:35 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:56:35 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:56:35 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[429b692e-8c39-4b68-ae33-106eb6236dad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ba1ac6-644f-4f34-b035-cba64041437e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:56:35 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:56:35 user nova-compute[75247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:56:35 user nova-compute[75247]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 (non-flash)
Dec 06 12:56:35 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:56:35 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:56:35 user nova-compute[75247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:56:35 user nova-compute[75247]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 (non-flash)
Dec 06 12:56:35 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd74b189c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5'): ({'sdb'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Removing single pathed devices sdb {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f568116-bfa2-4403-8ad2-94eaa2ef0b0d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[82465244-1a8f-460a-9491-ee14a6ba97d5]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Flushing IO for device /dev/sdb {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dcd95f-1f08-4e36-acf7-561b216ef66d]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f3b113-ec9b-4826-9d5c-604a00d575d2]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a17f37e-81a5-4343-af97-2cbb6efbe9c4]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e516e91e-a882-4c77-a51b-f5a80be88056]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5, portal: 172.16.0.220,3260]
Dec 06 12:56:35 user nova-compute[75247]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5, portal: 172.16.0.220,3260] successful.
Dec 06 12:56:35 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae31a6e8-00f8-4b60-95fe-b9949eebcbb5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[82778c99-1c53-47f3-8641-91325f06ddec]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] <== disconnect_volume: return (315ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:56:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:56:36 user nova-compute[75247]: DEBUG nova.objects.instance [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lazy-loading 'flavor' on Instance uuid f5b69324-579d-4833-9bb4-c43c511f820d {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:56:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d6f70add-2dab-4aab-a1ee-01b9e55a126d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.778s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:56:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Acquiring lock "3800b293-6987-43c1-893f-e8919ee17243" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:56:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "3800b293-6987-43c1-893f-e8919ee17243" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:56:56 user nova-compute[75247]: DEBUG nova.compute.manager [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:56:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:56:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:56:56 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:56:56 user nova-compute[75247]: INFO nova.compute.claims [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Claim successful on node user
Dec 06 12:56:56 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:56:56 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:56:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.562s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:56:56 user nova-compute[75247]: DEBUG nova.compute.manager [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:56:56 user nova-compute[75247]: DEBUG nova.compute.manager [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:56:56 user nova-compute[75247]: DEBUG nova.network.neutron [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:56:56 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:56:56 user nova-compute[75247]: DEBUG nova.compute.manager [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:56:56 user nova-compute[75247]: DEBUG nova.policy [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d662e0050774501a04828dcd6d3b63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea74e3cf3f254f0b8b6eec14ecc8c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:56:56 user nova-compute[75247]: DEBUG nova.compute.manager [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:56:56 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:56:56 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Creating image(s)
Dec 06 12:56:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Acquiring lock "/opt/stack/data/nova/instances/3800b293-6987-43c1-893f-e8919ee17243/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:56:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "/opt/stack/data/nova/instances/3800b293-6987-43c1-893f-e8919ee17243/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:56:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "/opt/stack/data/nova/instances/3800b293-6987-43c1-893f-e8919ee17243/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:56:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.173s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:56:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:56:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.201s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/3800b293-6987-43c1-893f-e8919ee17243/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/3800b293-6987-43c1-893f-e8919ee17243/disk 1073741824" returned: 0 in 0.052s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:56:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.212s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:57 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3800b293-6987-43c1-893f-e8919ee17243/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:56:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3800b293-6987-43c1-893f-e8919ee17243/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:56:57 user nova-compute[75247]: DEBUG nova.network.neutron [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Successfully created port: 5a7b1d76-a210-436f-827b-8ce4a2f04d35 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:56:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3800b293-6987-43c1-893f-e8919ee17243/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:56:57 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Cannot resize image /opt/stack/data/nova/instances/3800b293-6987-43c1-893f-e8919ee17243/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:56:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:56:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Ensure instance console log exists: /opt/stack/data/nova/instances/3800b293-6987-43c1-893f-e8919ee17243/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:56:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:56:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:56:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:56:58 user nova-compute[75247]: DEBUG nova.network.neutron [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Successfully updated port: 5a7b1d76-a210-436f-827b-8ce4a2f04d35 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:56:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Acquiring lock "refresh_cache-3800b293-6987-43c1-893f-e8919ee17243" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:56:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Acquired lock "refresh_cache-3800b293-6987-43c1-893f-e8919ee17243" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:56:58 user nova-compute[75247]: DEBUG nova.network.neutron [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:56:58 user nova-compute[75247]: DEBUG nova.compute.manager [req-d130f866-e6f9-402b-bca5-384290bcbb41 req-30085e68-3131-4d42-afbb-c53fe97fa68a service nova] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Received event network-changed-5a7b1d76-a210-436f-827b-8ce4a2f04d35 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:56:58 user nova-compute[75247]: DEBUG nova.compute.manager [req-d130f866-e6f9-402b-bca5-384290bcbb41 req-30085e68-3131-4d42-afbb-c53fe97fa68a service nova] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Refreshing instance network info cache due to event network-changed-5a7b1d76-a210-436f-827b-8ce4a2f04d35. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:56:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d130f866-e6f9-402b-bca5-384290bcbb41 req-30085e68-3131-4d42-afbb-c53fe97fa68a service nova] Acquiring lock "refresh_cache-3800b293-6987-43c1-893f-e8919ee17243" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:56:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:58 user nova-compute[75247]: DEBUG nova.network.neutron [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.network.neutron [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Updating instance_info_cache with network_info: [{"id": "5a7b1d76-a210-436f-827b-8ce4a2f04d35", "address": "fa:16:3e:a8:28:e4", "network": {"id": "c46a4b1b-086d-48c6-83cb-a4b88077781f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-70878896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea74e3cf3f254f0b8b6eec14ecc8c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a7b1d76-a2", "ovs_interfaceid": "5a7b1d76-a210-436f-827b-8ce4a2f04d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Releasing lock "refresh_cache-3800b293-6987-43c1-893f-e8919ee17243" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.compute.manager [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Instance network_info: |[{"id": "5a7b1d76-a210-436f-827b-8ce4a2f04d35", "address": "fa:16:3e:a8:28:e4", "network": {"id": "c46a4b1b-086d-48c6-83cb-a4b88077781f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-70878896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea74e3cf3f254f0b8b6eec14ecc8c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a7b1d76-a2", "ovs_interfaceid": "5a7b1d76-a210-436f-827b-8ce4a2f04d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d130f866-e6f9-402b-bca5-384290bcbb41 req-30085e68-3131-4d42-afbb-c53fe97fa68a service nova] Acquired lock "refresh_cache-3800b293-6987-43c1-893f-e8919ee17243" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.network.neutron [req-d130f866-e6f9-402b-bca5-384290bcbb41 req-30085e68-3131-4d42-afbb-c53fe97fa68a service nova] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Refreshing network info cache for port 5a7b1d76-a210-436f-827b-8ce4a2f04d35 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Start _get_guest_xml network_info=[{"id": "5a7b1d76-a210-436f-827b-8ce4a2f04d35", "address": "fa:16:3e:a8:28:e4", "network": {"id": "c46a4b1b-086d-48c6-83cb-a4b88077781f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-70878896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea74e3cf3f254f0b8b6eec14ecc8c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a7b1d76-a2", "ovs_interfaceid": "5a7b1d76-a210-436f-827b-8ce4a2f04d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:56:59 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:56:59 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:56:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-704332245',display_name='tempest-VolumesActionsTest-instance-704332245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-704332245',id=37,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea74e3cf3f254f0b8b6eec14ecc8c80e',ramdisk_id='',reservation_id='r-vexlko85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-72234739',owner_user_name='tempest-VolumesActionsTest-72234739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:56:57Z,user_data=None,user_id='7d662e0050774501a04828dcd6d3b63f',uuid=3800b293-6987-43c1-893f-e8919ee17243,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a7b1d76-a210-436f-827b-8ce4a2f04d35", "address": "fa:16:3e:a8:28:e4", "network": {"id": "c46a4b1b-086d-48c6-83cb-a4b88077781f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-70878896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea74e3cf3f254f0b8b6eec14ecc8c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a7b1d76-a2", "ovs_interfaceid": "5a7b1d76-a210-436f-827b-8ce4a2f04d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Converting VIF {"id": "5a7b1d76-a210-436f-827b-8ce4a2f04d35", "address": "fa:16:3e:a8:28:e4", "network": {"id": "c46a4b1b-086d-48c6-83cb-a4b88077781f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-70878896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea74e3cf3f254f0b8b6eec14ecc8c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a7b1d76-a2", "ovs_interfaceid": "5a7b1d76-a210-436f-827b-8ce4a2f04d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:28:e4,bridge_name='br-int',has_traffic_filtering=True,id=5a7b1d76-a210-436f-827b-8ce4a2f04d35,network=Network(c46a4b1b-086d-48c6-83cb-a4b88077781f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a7b1d76-a2') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.objects.instance [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lazy-loading 'pci_devices' on Instance uuid 3800b293-6987-43c1-893f-e8919ee17243 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:56:59 user nova-compute[75247]:   <uuid>3800b293-6987-43c1-893f-e8919ee17243</uuid>
Dec 06 12:56:59 user nova-compute[75247]:   <name>instance-00000025</name>
Dec 06 12:56:59 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:56:59 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:56:59 user nova-compute[75247]:   <metadata>
Dec 06 12:56:59 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:56:59 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:56:59 user nova-compute[75247]:       <nova:name>tempest-VolumesActionsTest-instance-704332245</nova:name>
Dec 06 12:56:59 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:56:59</nova:creationTime>
Dec 06 12:56:59 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:56:59 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:56:59 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:56:59 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:56:59 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:56:59 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:56:59 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:56:59 user nova-compute[75247]:       <nova:owner>
Dec 06 12:56:59 user nova-compute[75247]:         <nova:user uuid="7d662e0050774501a04828dcd6d3b63f">tempest-VolumesActionsTest-72234739-project-member</nova:user>
Dec 06 12:56:59 user nova-compute[75247]:         <nova:project uuid="ea74e3cf3f254f0b8b6eec14ecc8c80e">tempest-VolumesActionsTest-72234739</nova:project>
Dec 06 12:56:59 user nova-compute[75247]:       </nova:owner>
Dec 06 12:56:59 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:56:59 user nova-compute[75247]:       <nova:ports>
Dec 06 12:56:59 user nova-compute[75247]:         <nova:port uuid="5a7b1d76-a210-436f-827b-8ce4a2f04d35">
Dec 06 12:56:59 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 12:56:59 user nova-compute[75247]:         </nova:port>
Dec 06 12:56:59 user nova-compute[75247]:       </nova:ports>
Dec 06 12:56:59 user nova-compute[75247]:     </nova:instance>
Dec 06 12:56:59 user nova-compute[75247]:   </metadata>
Dec 06 12:56:59 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:56:59 user nova-compute[75247]:     <system>
Dec 06 12:56:59 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:56:59 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:56:59 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:56:59 user nova-compute[75247]:       <entry name="serial">3800b293-6987-43c1-893f-e8919ee17243</entry>
Dec 06 12:56:59 user nova-compute[75247]:       <entry name="uuid">3800b293-6987-43c1-893f-e8919ee17243</entry>
Dec 06 12:56:59 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:56:59 user nova-compute[75247]:     </system>
Dec 06 12:56:59 user nova-compute[75247]:   </sysinfo>
Dec 06 12:56:59 user nova-compute[75247]:   <os>
Dec 06 12:56:59 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:56:59 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:56:59 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:56:59 user nova-compute[75247]:   </os>
Dec 06 12:56:59 user nova-compute[75247]:   <features>
Dec 06 12:56:59 user nova-compute[75247]:     <acpi/>
Dec 06 12:56:59 user nova-compute[75247]:     <apic/>
Dec 06 12:56:59 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:56:59 user nova-compute[75247]:   </features>
Dec 06 12:56:59 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:56:59 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:56:59 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:56:59 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:56:59 user nova-compute[75247]:   </clock>
Dec 06 12:56:59 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:56:59 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:56:59 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:56:59 user nova-compute[75247]:   </cpu>
Dec 06 12:56:59 user nova-compute[75247]:   <devices>
Dec 06 12:56:59 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:56:59 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:56:59 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/3800b293-6987-43c1-893f-e8919ee17243/disk"/>
Dec 06 12:56:59 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:56:59 user nova-compute[75247]:     </disk>
Dec 06 12:56:59 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:56:59 user nova-compute[75247]:       <mac address="fa:16:3e:a8:28:e4"/>
Dec 06 12:56:59 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:56:59 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:56:59 user nova-compute[75247]:       <target dev="tap5a7b1d76-a2"/>
Dec 06 12:56:59 user nova-compute[75247]:     </interface>
Dec 06 12:56:59 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:56:59 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/3800b293-6987-43c1-893f-e8919ee17243/console.log" append="off"/>
Dec 06 12:56:59 user nova-compute[75247]:     </serial>
Dec 06 12:56:59 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:56:59 user nova-compute[75247]:     <video>
Dec 06 12:56:59 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:56:59 user nova-compute[75247]:     </video>
Dec 06 12:56:59 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:56:59 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:56:59 user nova-compute[75247]:     </rng>
Dec 06 12:56:59 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:56:59 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:56:59 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:56:59 user nova-compute[75247]:     </memballoon>
Dec 06 12:56:59 user nova-compute[75247]:   </devices>
Dec 06 12:56:59 user nova-compute[75247]: </domain>
Dec 06 12:56:59 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:56:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-704332245',display_name='tempest-VolumesActionsTest-instance-704332245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-704332245',id=37,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea74e3cf3f254f0b8b6eec14ecc8c80e',ramdisk_id='',reservation_id='r-vexlko85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-72234739',owner_user_name='tempest-VolumesActionsTest-72234739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:56:57Z,user_data=None,user_id='7d662e0050774501a04828dcd6d3b63f',uuid=3800b293-6987-43c1-893f-e8919ee17243,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a7b1d76-a210-436f-827b-8ce4a2f04d35", "address": "fa:16:3e:a8:28:e4", "network": {"id": "c46a4b1b-086d-48c6-83cb-a4b88077781f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-70878896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea74e3cf3f254f0b8b6eec14ecc8c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a7b1d76-a2", "ovs_interfaceid": "5a7b1d76-a210-436f-827b-8ce4a2f04d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Converting VIF {"id": "5a7b1d76-a210-436f-827b-8ce4a2f04d35", "address": "fa:16:3e:a8:28:e4", "network": {"id": "c46a4b1b-086d-48c6-83cb-a4b88077781f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-70878896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea74e3cf3f254f0b8b6eec14ecc8c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a7b1d76-a2", "ovs_interfaceid": "5a7b1d76-a210-436f-827b-8ce4a2f04d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:28:e4,bridge_name='br-int',has_traffic_filtering=True,id=5a7b1d76-a210-436f-827b-8ce4a2f04d35,network=Network(c46a4b1b-086d-48c6-83cb-a4b88077781f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a7b1d76-a2') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG os_vif [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:28:e4,bridge_name='br-int',has_traffic_filtering=True,id=5a7b1d76-a210-436f-827b-8ce4a2f04d35,network=Network(c46a4b1b-086d-48c6-83cb-a4b88077781f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a7b1d76-a2') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03418b0f-ff42-516e-a6d4-21f517b4869f', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a7b1d76-a2, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a7b1d76-a2, col_values=(('qos', UUID('c8f187f6-9df4-4583-ab4d-90b7f7018939')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a7b1d76-a2, col_values=(('external_ids', {'iface-id': '5a7b1d76-a210-436f-827b-8ce4a2f04d35', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:28:e4', 'vm-uuid': '3800b293-6987-43c1-893f-e8919ee17243'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:56:59 user nova-compute[75247]: INFO os_vif [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:28:e4,bridge_name='br-int',has_traffic_filtering=True,id=5a7b1d76-a210-436f-827b-8ce4a2f04d35,network=Network(c46a4b1b-086d-48c6-83cb-a4b88077781f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a7b1d76-a2')
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] No VIF found with MAC fa:16:3e:a8:28:e4, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.network.neutron [req-d130f866-e6f9-402b-bca5-384290bcbb41 req-30085e68-3131-4d42-afbb-c53fe97fa68a service nova] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Updated VIF entry in instance network info cache for port 5a7b1d76-a210-436f-827b-8ce4a2f04d35. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG nova.network.neutron [req-d130f866-e6f9-402b-bca5-384290bcbb41 req-30085e68-3131-4d42-afbb-c53fe97fa68a service nova] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Updating instance_info_cache with network_info: [{"id": "5a7b1d76-a210-436f-827b-8ce4a2f04d35", "address": "fa:16:3e:a8:28:e4", "network": {"id": "c46a4b1b-086d-48c6-83cb-a4b88077781f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-70878896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea74e3cf3f254f0b8b6eec14ecc8c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a7b1d76-a2", "ovs_interfaceid": "5a7b1d76-a210-436f-827b-8ce4a2f04d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:56:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d130f866-e6f9-402b-bca5-384290bcbb41 req-30085e68-3131-4d42-afbb-c53fe97fa68a service nova] Releasing lock "refresh_cache-3800b293-6987-43c1-893f-e8919ee17243" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:57:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Acquiring lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:02 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:57:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:02 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:57:02 user nova-compute[75247]: INFO nova.compute.claims [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Claim successful on node user
Dec 06 12:57:03 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG nova.network.neutron [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:57:03 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:57:03 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG nova.policy [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72f8d05774464eb1b7043e2c945ec1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47c1410bde45648e4c65ea542b12d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:57:03 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Creating image(s)
Dec 06 12:57:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b8adc91-c4d4-4484-bd4e-cc3d356338c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "/opt/stack/data/nova/instances/3b8adc91-c4d4-4484-bd4e-cc3d356338c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "/opt/stack/data/nova/instances/3b8adc91-c4d4-4484-bd4e-cc3d356338c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG nova.compute.manager [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:57:03 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Instance spawned successfully.
Dec 06 12:57:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.181s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:57:03 user nova-compute[75247]: INFO nova.compute.manager [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Took 6.75 seconds to spawn the instance on the hypervisor.
Dec 06 12:57:03 user nova-compute[75247]: DEBUG nova.compute.manager [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.199s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/3b8adc91-c4d4-4484-bd4e-cc3d356338c7/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/3b8adc91-c4d4-4484-bd4e-cc3d356338c7/disk 1073741824" returned: 0 in 0.047s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:03 user nova-compute[75247]: INFO nova.compute.manager [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Took 7.70 seconds to build instance.
Dec 06 12:57:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5b916a44-3f3b-40b3-bcb1-80b9adcb07dd tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "3800b293-6987-43c1-893f-e8919ee17243" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.820s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG nova.network.neutron [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Successfully created port: 9674b746-bc7e-4ca4-bb83-28ac0adb21c4 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.206s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b8adc91-c4d4-4484-bd4e-cc3d356338c7/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:57:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b8adc91-c4d4-4484-bd4e-cc3d356338c7/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b8adc91-c4d4-4484-bd4e-cc3d356338c7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:04 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Cannot resize image /opt/stack/data/nova/instances/3b8adc91-c4d4-4484-bd4e-cc3d356338c7/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:57:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:57:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Ensure instance console log exists: /opt/stack/data/nova/instances/3b8adc91-c4d4-4484-bd4e-cc3d356338c7/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:57:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:04 user nova-compute[75247]: DEBUG nova.network.neutron [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Successfully updated port: 9674b746-bc7e-4ca4-bb83-28ac0adb21c4 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:57:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Acquiring lock "refresh_cache-3b8adc91-c4d4-4484-bd4e-cc3d356338c7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:57:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Acquired lock "refresh_cache-3b8adc91-c4d4-4484-bd4e-cc3d356338c7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:57:04 user nova-compute[75247]: DEBUG nova.network.neutron [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:57:04 user nova-compute[75247]: DEBUG nova.compute.manager [req-af799b6a-b857-4245-bf4c-98e67fbfb217 req-30a0388a-dd0c-4221-981c-a5585632bd8d service nova] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Received event network-changed-9674b746-bc7e-4ca4-bb83-28ac0adb21c4 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:57:04 user nova-compute[75247]: DEBUG nova.compute.manager [req-af799b6a-b857-4245-bf4c-98e67fbfb217 req-30a0388a-dd0c-4221-981c-a5585632bd8d service nova] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Refreshing instance network info cache due to event network-changed-9674b746-bc7e-4ca4-bb83-28ac0adb21c4. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:57:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-af799b6a-b857-4245-bf4c-98e67fbfb217 req-30a0388a-dd0c-4221-981c-a5585632bd8d service nova] Acquiring lock "refresh_cache-3b8adc91-c4d4-4484-bd4e-cc3d356338c7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:57:04 user nova-compute[75247]: DEBUG nova.network.neutron [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:57:04 user nova-compute[75247]: DEBUG nova.network.neutron [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Updating instance_info_cache with network_info: [{"id": "9674b746-bc7e-4ca4-bb83-28ac0adb21c4", "address": "fa:16:3e:1a:02:be", "network": {"id": "3e1570a1-1d0a-4f71-b103-39a83a25c7a1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1788872216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc47c1410bde45648e4c65ea542b12d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9674b746-bc", "ovs_interfaceid": "9674b746-bc7e-4ca4-bb83-28ac0adb21c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:57:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Releasing lock "refresh_cache-3b8adc91-c4d4-4484-bd4e-cc3d356338c7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:57:04 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Instance network_info: |[{"id": "9674b746-bc7e-4ca4-bb83-28ac0adb21c4", "address": "fa:16:3e:1a:02:be", "network": {"id": "3e1570a1-1d0a-4f71-b103-39a83a25c7a1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1788872216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc47c1410bde45648e4c65ea542b12d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9674b746-bc", "ovs_interfaceid": "9674b746-bc7e-4ca4-bb83-28ac0adb21c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:57:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-af799b6a-b857-4245-bf4c-98e67fbfb217 req-30a0388a-dd0c-4221-981c-a5585632bd8d service nova] Acquired lock "refresh_cache-3b8adc91-c4d4-4484-bd4e-cc3d356338c7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:57:04 user nova-compute[75247]: DEBUG nova.network.neutron [req-af799b6a-b857-4245-bf4c-98e67fbfb217 req-30a0388a-dd0c-4221-981c-a5585632bd8d service nova] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Refreshing network info cache for port 9674b746-bc7e-4ca4-bb83-28ac0adb21c4 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:57:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Start _get_guest_xml network_info=[{"id": "9674b746-bc7e-4ca4-bb83-28ac0adb21c4", "address": "fa:16:3e:1a:02:be", "network": {"id": "3e1570a1-1d0a-4f71-b103-39a83a25c7a1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1788872216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc47c1410bde45648e4c65ea542b12d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9674b746-bc", "ovs_interfaceid": "9674b746-bc7e-4ca4-bb83-28ac0adb21c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:57:04 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:57:04 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:57:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1289572704',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1289572704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1289572',id=38,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCok9NvOooBJ0H7CDFBEeZKI9GDOYkZFcgAbZTOkxHJGta2U+DO7HsT+Q9ih1zB+bwZtvnotX+hyor4L+o+0Bv5yo4QvZGaUIIfRr9BKw4kq/JnMES4bETI2UYLaK2TEvw==',key_name='tempest-keypair-1585112285',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc47c1410bde45648e4c65ea542b12d8',ramdisk_id='',reservation_id='r-1xnktcy5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2001652438',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:57:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72f8d05774464eb1b7043e2c945ec1ff',uuid=3b8adc91-c4d4-4484-bd4e-cc3d356338c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9674b746-bc7e-4ca4-bb83-28ac0adb21c4", "address": "fa:16:3e:1a:02:be", "network": {"id": "3e1570a1-1d0a-4f71-b103-39a83a25c7a1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1788872216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc47c1410bde45648e4c65ea542b12d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9674b746-bc", "ovs_interfaceid": "9674b746-bc7e-4ca4-bb83-28ac0adb21c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Converting VIF {"id": "9674b746-bc7e-4ca4-bb83-28ac0adb21c4", "address": "fa:16:3e:1a:02:be", "network": {"id": "3e1570a1-1d0a-4f71-b103-39a83a25c7a1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1788872216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc47c1410bde45648e4c65ea542b12d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9674b746-bc", "ovs_interfaceid": "9674b746-bc7e-4ca4-bb83-28ac0adb21c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:02:be,bridge_name='br-int',has_traffic_filtering=True,id=9674b746-bc7e-4ca4-bb83-28ac0adb21c4,network=Network(3e1570a1-1d0a-4f71-b103-39a83a25c7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9674b746-bc') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.objects.instance [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b8adc91-c4d4-4484-bd4e-cc3d356338c7 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:57:05 user nova-compute[75247]:   <uuid>3b8adc91-c4d4-4484-bd4e-cc3d356338c7</uuid>
Dec 06 12:57:05 user nova-compute[75247]:   <name>instance-00000026</name>
Dec 06 12:57:05 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:57:05 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:57:05 user nova-compute[75247]:   <metadata>
Dec 06 12:57:05 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:57:05 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:57:05 user nova-compute[75247]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1289572704</nova:name>
Dec 06 12:57:05 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:57:04</nova:creationTime>
Dec 06 12:57:05 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:57:05 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:57:05 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:57:05 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:57:05 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:57:05 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:57:05 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:57:05 user nova-compute[75247]:       <nova:owner>
Dec 06 12:57:05 user nova-compute[75247]:         <nova:user uuid="72f8d05774464eb1b7043e2c945ec1ff">tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member</nova:user>
Dec 06 12:57:05 user nova-compute[75247]:         <nova:project uuid="cc47c1410bde45648e4c65ea542b12d8">tempest-TestServerVolumeAttachScenarioOldVersion-2001652438</nova:project>
Dec 06 12:57:05 user nova-compute[75247]:       </nova:owner>
Dec 06 12:57:05 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:57:05 user nova-compute[75247]:       <nova:ports>
Dec 06 12:57:05 user nova-compute[75247]:         <nova:port uuid="9674b746-bc7e-4ca4-bb83-28ac0adb21c4">
Dec 06 12:57:05 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 06 12:57:05 user nova-compute[75247]:         </nova:port>
Dec 06 12:57:05 user nova-compute[75247]:       </nova:ports>
Dec 06 12:57:05 user nova-compute[75247]:     </nova:instance>
Dec 06 12:57:05 user nova-compute[75247]:   </metadata>
Dec 06 12:57:05 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:57:05 user nova-compute[75247]:     <system>
Dec 06 12:57:05 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:57:05 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:57:05 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:57:05 user nova-compute[75247]:       <entry name="serial">3b8adc91-c4d4-4484-bd4e-cc3d356338c7</entry>
Dec 06 12:57:05 user nova-compute[75247]:       <entry name="uuid">3b8adc91-c4d4-4484-bd4e-cc3d356338c7</entry>
Dec 06 12:57:05 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:57:05 user nova-compute[75247]:     </system>
Dec 06 12:57:05 user nova-compute[75247]:   </sysinfo>
Dec 06 12:57:05 user nova-compute[75247]:   <os>
Dec 06 12:57:05 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:57:05 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:57:05 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:57:05 user nova-compute[75247]:   </os>
Dec 06 12:57:05 user nova-compute[75247]:   <features>
Dec 06 12:57:05 user nova-compute[75247]:     <acpi/>
Dec 06 12:57:05 user nova-compute[75247]:     <apic/>
Dec 06 12:57:05 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:57:05 user nova-compute[75247]:   </features>
Dec 06 12:57:05 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:57:05 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:57:05 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:57:05 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:57:05 user nova-compute[75247]:   </clock>
Dec 06 12:57:05 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:57:05 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:57:05 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:57:05 user nova-compute[75247]:   </cpu>
Dec 06 12:57:05 user nova-compute[75247]:   <devices>
Dec 06 12:57:05 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:57:05 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:57:05 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/3b8adc91-c4d4-4484-bd4e-cc3d356338c7/disk"/>
Dec 06 12:57:05 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:57:05 user nova-compute[75247]:     </disk>
Dec 06 12:57:05 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:57:05 user nova-compute[75247]:       <mac address="fa:16:3e:1a:02:be"/>
Dec 06 12:57:05 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:57:05 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:57:05 user nova-compute[75247]:       <target dev="tap9674b746-bc"/>
Dec 06 12:57:05 user nova-compute[75247]:     </interface>
Dec 06 12:57:05 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:57:05 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/3b8adc91-c4d4-4484-bd4e-cc3d356338c7/console.log" append="off"/>
Dec 06 12:57:05 user nova-compute[75247]:     </serial>
Dec 06 12:57:05 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:57:05 user nova-compute[75247]:     <video>
Dec 06 12:57:05 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:57:05 user nova-compute[75247]:     </video>
Dec 06 12:57:05 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:57:05 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:57:05 user nova-compute[75247]:     </rng>
Dec 06 12:57:05 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:57:05 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:57:05 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:57:05 user nova-compute[75247]:     </memballoon>
Dec 06 12:57:05 user nova-compute[75247]:   </devices>
Dec 06 12:57:05 user nova-compute[75247]: </domain>
Dec 06 12:57:05 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:57:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1289572704',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1289572704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1289572',id=38,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCok9NvOooBJ0H7CDFBEeZKI9GDOYkZFcgAbZTOkxHJGta2U+DO7HsT+Q9ih1zB+bwZtvnotX+hyor4L+o+0Bv5yo4QvZGaUIIfRr9BKw4kq/JnMES4bETI2UYLaK2TEvw==',key_name='tempest-keypair-1585112285',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc47c1410bde45648e4c65ea542b12d8',ramdisk_id='',reservation_id='r-1xnktcy5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2001652438',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:57:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72f8d05774464eb1b7043e2c945ec1ff',uuid=3b8adc91-c4d4-4484-bd4e-cc3d356338c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9674b746-bc7e-4ca4-bb83-28ac0adb21c4", "address": "fa:16:3e:1a:02:be", "network": {"id": "3e1570a1-1d0a-4f71-b103-39a83a25c7a1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1788872216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc47c1410bde45648e4c65ea542b12d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9674b746-bc", "ovs_interfaceid": "9674b746-bc7e-4ca4-bb83-28ac0adb21c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Converting VIF {"id": "9674b746-bc7e-4ca4-bb83-28ac0adb21c4", "address": "fa:16:3e:1a:02:be", "network": {"id": "3e1570a1-1d0a-4f71-b103-39a83a25c7a1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1788872216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc47c1410bde45648e4c65ea542b12d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9674b746-bc", "ovs_interfaceid": "9674b746-bc7e-4ca4-bb83-28ac0adb21c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:02:be,bridge_name='br-int',has_traffic_filtering=True,id=9674b746-bc7e-4ca4-bb83-28ac0adb21c4,network=Network(3e1570a1-1d0a-4f71-b103-39a83a25c7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9674b746-bc') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG os_vif [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:02:be,bridge_name='br-int',has_traffic_filtering=True,id=9674b746-bc7e-4ca4-bb83-28ac0adb21c4,network=Network(3e1570a1-1d0a-4f71-b103-39a83a25c7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9674b746-bc') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f41573d7-94d3-5042-84c1-3e6674462d0f', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9674b746-bc, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9674b746-bc, col_values=(('qos', UUID('8d122608-41f6-43ee-9766-fb6dce70c059')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9674b746-bc, col_values=(('external_ids', {'iface-id': '9674b746-bc7e-4ca4-bb83-28ac0adb21c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:02:be', 'vm-uuid': '3b8adc91-c4d4-4484-bd4e-cc3d356338c7'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:05 user nova-compute[75247]: INFO os_vif [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:02:be,bridge_name='br-int',has_traffic_filtering=True,id=9674b746-bc7e-4ca4-bb83-28ac0adb21c4,network=Network(3e1570a1-1d0a-4f71-b103-39a83a25c7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9674b746-bc')
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] No VIF found with MAC fa:16:3e:1a:02:be, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-b1a02e02-5385-4e82-aa6b-fbf4a5dd8a25 req-29b3b9ff-71d1-42c4-8157-f911ec1040d8 service nova] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Received event network-vif-plugged-5a7b1d76-a210-436f-827b-8ce4a2f04d35 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b1a02e02-5385-4e82-aa6b-fbf4a5dd8a25 req-29b3b9ff-71d1-42c4-8157-f911ec1040d8 service nova] Acquiring lock "3800b293-6987-43c1-893f-e8919ee17243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b1a02e02-5385-4e82-aa6b-fbf4a5dd8a25 req-29b3b9ff-71d1-42c4-8157-f911ec1040d8 service nova] Lock "3800b293-6987-43c1-893f-e8919ee17243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b1a02e02-5385-4e82-aa6b-fbf4a5dd8a25 req-29b3b9ff-71d1-42c4-8157-f911ec1040d8 service nova] Lock "3800b293-6987-43c1-893f-e8919ee17243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.compute.manager [req-b1a02e02-5385-4e82-aa6b-fbf4a5dd8a25 req-29b3b9ff-71d1-42c4-8157-f911ec1040d8 service nova] [instance: 3800b293-6987-43c1-893f-e8919ee17243] No waiting events found dispatching network-vif-plugged-5a7b1d76-a210-436f-827b-8ce4a2f04d35 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:57:05 user nova-compute[75247]: WARNING nova.compute.manager [req-b1a02e02-5385-4e82-aa6b-fbf4a5dd8a25 req-29b3b9ff-71d1-42c4-8157-f911ec1040d8 service nova] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Received unexpected event network-vif-plugged-5a7b1d76-a210-436f-827b-8ce4a2f04d35 for instance with vm_state active and task_state None.
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.network.neutron [req-af799b6a-b857-4245-bf4c-98e67fbfb217 req-30a0388a-dd0c-4221-981c-a5585632bd8d service nova] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Updated VIF entry in instance network info cache for port 9674b746-bc7e-4ca4-bb83-28ac0adb21c4. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG nova.network.neutron [req-af799b6a-b857-4245-bf4c-98e67fbfb217 req-30a0388a-dd0c-4221-981c-a5585632bd8d service nova] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Updating instance_info_cache with network_info: [{"id": "9674b746-bc7e-4ca4-bb83-28ac0adb21c4", "address": "fa:16:3e:1a:02:be", "network": {"id": "3e1570a1-1d0a-4f71-b103-39a83a25c7a1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1788872216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc47c1410bde45648e4c65ea542b12d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9674b746-bc", "ovs_interfaceid": "9674b746-bc7e-4ca4-bb83-28ac0adb21c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:57:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-af799b6a-b857-4245-bf4c-98e67fbfb217 req-30a0388a-dd0c-4221-981c-a5585632bd8d service nova] Releasing lock "refresh_cache-3b8adc91-c4d4-4484-bd4e-cc3d356338c7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:57:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:07 user nova-compute[75247]: DEBUG nova.compute.manager [req-c5981dcd-ba55-4413-adc3-0579bd6b007a req-7950ac31-1b08-4fb3-82c5-b4893d812e40 service nova] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Received event network-vif-plugged-9674b746-bc7e-4ca4-bb83-28ac0adb21c4 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:57:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c5981dcd-ba55-4413-adc3-0579bd6b007a req-7950ac31-1b08-4fb3-82c5-b4893d812e40 service nova] Acquiring lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c5981dcd-ba55-4413-adc3-0579bd6b007a req-7950ac31-1b08-4fb3-82c5-b4893d812e40 service nova] Lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c5981dcd-ba55-4413-adc3-0579bd6b007a req-7950ac31-1b08-4fb3-82c5-b4893d812e40 service nova] Lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:07 user nova-compute[75247]: DEBUG nova.compute.manager [req-c5981dcd-ba55-4413-adc3-0579bd6b007a req-7950ac31-1b08-4fb3-82c5-b4893d812e40 service nova] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] No waiting events found dispatching network-vif-plugged-9674b746-bc7e-4ca4-bb83-28ac0adb21c4 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:57:07 user nova-compute[75247]: WARNING nova.compute.manager [req-c5981dcd-ba55-4413-adc3-0579bd6b007a req-7950ac31-1b08-4fb3-82c5-b4893d812e40 service nova] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Received unexpected event network-vif-plugged-9674b746-bc7e-4ca4-bb83-28ac0adb21c4 for instance with vm_state building and task_state spawning.
Dec 06 12:57:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:07 user nova-compute[75247]: DEBUG nova.compute.manager [req-19ebe4df-923c-4e0a-b75a-1324c9707020 req-28c1e3af-5094-4eb7-b1b0-fc0533bda243 service nova] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Received event network-vif-plugged-5a7b1d76-a210-436f-827b-8ce4a2f04d35 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:57:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-19ebe4df-923c-4e0a-b75a-1324c9707020 req-28c1e3af-5094-4eb7-b1b0-fc0533bda243 service nova] Acquiring lock "3800b293-6987-43c1-893f-e8919ee17243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-19ebe4df-923c-4e0a-b75a-1324c9707020 req-28c1e3af-5094-4eb7-b1b0-fc0533bda243 service nova] Lock "3800b293-6987-43c1-893f-e8919ee17243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-19ebe4df-923c-4e0a-b75a-1324c9707020 req-28c1e3af-5094-4eb7-b1b0-fc0533bda243 service nova] Lock "3800b293-6987-43c1-893f-e8919ee17243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:07 user nova-compute[75247]: DEBUG nova.compute.manager [req-19ebe4df-923c-4e0a-b75a-1324c9707020 req-28c1e3af-5094-4eb7-b1b0-fc0533bda243 service nova] [instance: 3800b293-6987-43c1-893f-e8919ee17243] No waiting events found dispatching network-vif-plugged-5a7b1d76-a210-436f-827b-8ce4a2f04d35 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:57:07 user nova-compute[75247]: WARNING nova.compute.manager [req-19ebe4df-923c-4e0a-b75a-1324c9707020 req-28c1e3af-5094-4eb7-b1b0-fc0533bda243 service nova] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Received unexpected event network-vif-plugged-5a7b1d76-a210-436f-827b-8ce4a2f04d35 for instance with vm_state active and task_state None.
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "f5b69324-579d-4833-9bb4-c43c511f820d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG nova.objects.instance [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lazy-loading 'flavor' on Instance uuid f5b69324-579d-4833-9bb4-c43c511f820d {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid 70c4664e-ae7a-47de-bba7-18300391d209 {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid 782289e2-91cd-4aee-9a08-eadfb2a5965b {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid 3e1b5197-dc38-48a5-b9f9-e053be499433 {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9 {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid bc3ddb40-b05f-4170-b269-d44dec6ecdaf {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid 530cfb75-7aa8-4e57-b282-8f7a21401b34 {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid 6d767ae1-4df2-4e87-b991-729fabd467f8 {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid b3720cc0-ff80-4ca2-8b13-d83dded593ad {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid f5b69324-579d-4833-9bb4-c43c511f820d {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid c603d6dc-804e-4c0d-be1f-40e09de74e8a {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid a94db53f-e791-4e0f-8c4f-3b292f00a24a {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid 3800b293-6987-43c1-893f-e8919ee17243 {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid 3b8adc91-c4d4-4484-bd4e-cc3d356338c7 {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "70c4664e-ae7a-47de-bba7-18300391d209" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "70c4664e-ae7a-47de-bba7-18300391d209" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "782289e2-91cd-4aee-9a08-eadfb2a5965b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "782289e2-91cd-4aee-9a08-eadfb2a5965b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "3e1b5197-dc38-48a5-b9f9-e053be499433" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "530cfb75-7aa8-4e57-b282-8f7a21401b34" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "530cfb75-7aa8-4e57-b282-8f7a21401b34" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "6d767ae1-4df2-4e87-b991-729fabd467f8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "f5b69324-579d-4833-9bb4-c43c511f820d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "c603d6dc-804e-4c0d-be1f-40e09de74e8a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "c603d6dc-804e-4c0d-be1f-40e09de74e8a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "a94db53f-e791-4e0f-8c4f-3b292f00a24a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "a94db53f-e791-4e0f-8c4f-3b292f00a24a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "3800b293-6987-43c1-893f-e8919ee17243" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "3800b293-6987-43c1-893f-e8919ee17243" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "70c4664e-ae7a-47de-bba7-18300391d209" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "782289e2-91cd-4aee-9a08-eadfb2a5965b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "530cfb75-7aa8-4e57-b282-8f7a21401b34" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.129s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.135s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "a94db53f-e791-4e0f-8c4f-3b292f00a24a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.139s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "3800b293-6987-43c1-893f-e8919ee17243" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.140s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "c603d6dc-804e-4c0d-be1f-40e09de74e8a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.146s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "f5b69324-579d-4833-9bb4-c43c511f820d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:08 user nova-compute[75247]: INFO nova.compute.manager [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Attaching volume 3f057b1b-98f2-4336-b91e-e3a34ae5ad4b to /dev/vdb
Dec 06 12:57:08 user nova-compute[75247]: DEBUG os_brick.utils [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab69d7b-3499-4868-800c-99f83685ac55]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9a5d8c-9303-4188-a304-7a6483886194]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f3f744-5022-4aa8-b183-4a3fc708973f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bde2eb3-5331-4b92-9234-0fea76e8ccdb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:57:08 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:57:08 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2a767e-6cdf-485b-ad64-bef2a20157a0]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:57:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:57:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:57:09 user nova-compute[75247]: DEBUG os_brick.utils [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:57:09 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Updating existing volume attachment record: ccb13edd-8b34-45c4-9887-4d434115c85d {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:57:09 user nova-compute[75247]: DEBUG nova.compute.manager [req-9ad16172-4b2d-4818-9f5f-6bdcdff63233 req-cbf8f383-7a91-4801-bace-98ae71222884 service nova] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Received event network-vif-plugged-9674b746-bc7e-4ca4-bb83-28ac0adb21c4 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:57:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-9ad16172-4b2d-4818-9f5f-6bdcdff63233 req-cbf8f383-7a91-4801-bace-98ae71222884 service nova] Acquiring lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-9ad16172-4b2d-4818-9f5f-6bdcdff63233 req-cbf8f383-7a91-4801-bace-98ae71222884 service nova] Lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-9ad16172-4b2d-4818-9f5f-6bdcdff63233 req-cbf8f383-7a91-4801-bace-98ae71222884 service nova] Lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:09 user nova-compute[75247]: DEBUG nova.compute.manager [req-9ad16172-4b2d-4818-9f5f-6bdcdff63233 req-cbf8f383-7a91-4801-bace-98ae71222884 service nova] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] No waiting events found dispatching network-vif-plugged-9674b746-bc7e-4ca4-bb83-28ac0adb21c4 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:57:09 user nova-compute[75247]: WARNING nova.compute.manager [req-9ad16172-4b2d-4818-9f5f-6bdcdff63233 req-cbf8f383-7a91-4801-bace-98ae71222884 service nova] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Received unexpected event network-vif-plugged-9674b746-bc7e-4ca4-bb83-28ac0adb21c4 for instance with vm_state building and task_state spawning.
Dec 06 12:57:09 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:57:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:57:09 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Instance spawned successfully.
Dec 06 12:57:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:57:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:57:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:57:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:57:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:57:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:57:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:57:09 user nova-compute[75247]: INFO nova.compute.manager [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Took 6.22 seconds to spawn the instance on the hypervisor.
Dec 06 12:57:09 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:57:09 user nova-compute[75247]: INFO nova.compute.manager [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Took 7.16 seconds to build instance.
Dec 06 12:57:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f3224334-34e0-4bc5-9b89-364d6a40ba5e tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.316s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.160s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:09 user nova-compute[75247]: INFO nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] During sync_power_state the instance has a pending task (spawning). Skip.
Dec 06 12:57:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:13 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:57:13 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:57:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:14 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:57:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:15 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:57:17 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:57:17 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:57:17 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 12:57:18 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:57:18 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 12:57:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-bc3ddb40-b05f-4170-b269-d44dec6ecdaf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:57:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-bc3ddb40-b05f-4170-b269-d44dec6ecdaf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:57:19 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 12:57:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:19 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Updating instance_info_cache with network_info: [{"id": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "address": "fa:16:3e:d5:71:f5", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e66d0f0-cc", "ovs_interfaceid": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:57:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-bc3ddb40-b05f-4170-b269-d44dec6ecdaf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:57:19 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 12:57:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "6d767ae1-4df2-4e87-b991-729fabd467f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:19 user nova-compute[75247]: INFO nova.compute.manager [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Terminating instance
Dec 06 12:57:19 user nova-compute[75247]: DEBUG nova.compute.manager [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:57:19 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:57:19 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:57:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:19 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-f78ce0aa-81b1-4feb-b690-4954691fcfc9 req-b7a15126-807d-4452-b2e7-41e62d1e8a03 service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Received event network-vif-unplugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f78ce0aa-81b1-4feb-b690-4954691fcfc9 req-b7a15126-807d-4452-b2e7-41e62d1e8a03 service nova] Acquiring lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f78ce0aa-81b1-4feb-b690-4954691fcfc9 req-b7a15126-807d-4452-b2e7-41e62d1e8a03 service nova] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f78ce0aa-81b1-4feb-b690-4954691fcfc9 req-b7a15126-807d-4452-b2e7-41e62d1e8a03 service nova] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-f78ce0aa-81b1-4feb-b690-4954691fcfc9 req-b7a15126-807d-4452-b2e7-41e62d1e8a03 service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] No waiting events found dispatching network-vif-unplugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-f78ce0aa-81b1-4feb-b690-4954691fcfc9 req-b7a15126-807d-4452-b2e7-41e62d1e8a03 service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Received event network-vif-unplugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RXTcZQim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:57:20 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:57:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:57:20 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:57:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:57:20 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1994d090-00f0-4bc0-8f9a-d0549d9e98a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:57:20 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[695382de-366d-484f-a3ed-a2062717166e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b] added
Dec 06 12:57:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d740206-4d60-444c-8815-771931fd0caf]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[368cc7cb-2ad0-4eda-887b-56adce6e5a45]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RXTcZQim {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RXTcZQim" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f27d3d-273f-4f97-bf9d-edc839d3f3ed]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RXTcZQim'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[05440138-9782-4da7-9060-e3efb858c3dc]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76da18b-c48e-4bef-968b-f16256a7b53e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:57:20 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:57:20 user nova-compute[75247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:57:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:57:20 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:57:20 user nova-compute[75247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:57:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0210b88-7098-4aab-850a-9feeb7dcf7c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b, portal: 172.16.0.220,3260]
Dec 06 12:57:20 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b, portal: 172.16.0.220,3260] successful.
Dec 06 12:57:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:20 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Instance destroyed successfully.
Dec 06 12:57:20 user nova-compute[75247]: DEBUG nova.objects.instance [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lazy-loading 'resources' on Instance uuid 6d767ae1-4df2-4e87-b991-729fabd467f8 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[09221dee-3a58-442a-a4c6-abf14541b15c]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1519077913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1519077913',id=31,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:53:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='222da79e3583495d90d5442029996343',ramdisk_id='',reservation_id='r-9fiavbvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:55:34Z,user_data=None,user_id='d0efa55fc4754d96a33d07d52342d8f7',uuid=6d767ae1-4df2-4e87-b991-729fabd467f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "address": "fa:16:3e:73:5b:1b", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f9635e-3e", "ovs_interfaceid": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converting VIF {"id": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "address": "fa:16:3e:73:5b:1b", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f9635e-3e", "ovs_interfaceid": "63f9635e-3eb4-4d2b-b289-e219ade9fb28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:5b:1b,bridge_name='br-int',has_traffic_filtering=True,id=63f9635e-3eb4-4d2b-b289-e219ade9fb28,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f9635e-3e') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG os_vif [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:5b:1b,bridge_name='br-int',has_traffic_filtering=True,id=63f9635e-3eb4-4d2b-b289-e219ade9fb28,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f9635e-3e') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63f9635e-3e, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d11a53a-eeb9-480f-a49e-1e42b47c6df3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:57:20 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:57:20 user nova-compute[75247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:57:20 user nova-compute[75247]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b (non-flash)
Dec 06 12:57:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:57:20 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:57:20 user nova-compute[75247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:57:20 user nova-compute[75247]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b (non-flash)
Dec 06 12:57:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e65219f-7592-4f87-8683-8830188b5f0d) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:57:20 user nova-compute[75247]: INFO os_vif [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:5b:1b,bridge_name='br-int',has_traffic_filtering=True,id=63f9635e-3eb4-4d2b-b289-e219ade9fb28,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f9635e-3e')
Dec 06 12:57:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcQpUNhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:57:20 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:57:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[01be021e-0fcc-4a69-abe9-c7fa8c61b29e]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:20 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RXTcZQim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '23339636131383864', 'path': '/dev/sdb'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339636131383864', 'path': '/dev/sdb'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.016s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG nova.objects.instance [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lazy-loading 'flavor' on Instance uuid f5b69324-579d-4833-9bb4-c43c511f820d {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b8adc91-c4d4-4484-bd4e-cc3d356338c7/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cbf2ba-b58c-4f27-8157-82d74b0b0379]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:57:21 user nova-compute[75247]: No targets found.
Dec 06 12:57:21 user nova-compute[75247]: iSNS:
Dec 06 12:57:21 user nova-compute[75247]: No targets found.
Dec 06 12:57:21 user nova-compute[75247]: STATIC:
Dec 06 12:57:21 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b
Dec 06 12:57:21 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:57:21 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:57:21 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:57:21 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:57:21 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:57:21 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33
Dec 06 12:57:21 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:57:21 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:57:21 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31
Dec 06 12:57:21 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:57:21 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:57:21 user nova-compute[75247]: FIRMWARE:
Dec 06 12:57:21 user nova-compute[75247]: No targets found.
Dec 06 12:57:21 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:57:21 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:57:21 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e1bb67-2059-41ca-bcd4-7ca273604627]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 12:57:21 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:57:21 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:57:21 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:57:21 user nova-compute[75247]:   <serial>3f057b1b-98f2-4336-b91e-e3a34ae5ad4b</serial>
Dec 06 12:57:21 user nova-compute[75247]: </disk>
Dec 06 12:57:21 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 12:57:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4468bb-670f-4330-a9d8-99d299a6b591]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:57:22 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:57:22 user nova-compute[75247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:57:22 user nova-compute[75247]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b (non-flash)
Dec 06 12:57:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:57:22 user nova-compute[75247]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 (non-flash)
Dec 06 12:57:22 user nova-compute[75247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:57:22 user nova-compute[75247]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b (non-flash)
Dec 06 12:57:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c6b56c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33'): ({'sde'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Removing single pathed devices sde {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad36eaa-e3eb-43e9-954f-1ea5e181565a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b8adc91-c4d4-4484-bd4e-cc3d356338c7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b8adc91-c4d4-4484-bd4e-cc3d356338c7/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f41753-6583-4c38-9861-94a65eeede12]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Flushing IO for device /dev/sde {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[85add655-9ed6-4f03-b201-b48bc35f53ff]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8b133b-6bb2-4e4f-90ce-a071e39e1ff6]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] SCSI volumes sde have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8167a394-0be4-4a2b-9229-bbf7cfcdc5fc]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc44430-4eb9-4f4a-9f20-5c3d0b58b353]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b8adc91-c4d4-4484-bd4e-cc3d356338c7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33, portal: 172.16.0.220,3260]
Dec 06 12:57:22 user nova-compute[75247]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33, portal: 172.16.0.220,3260] successful.
Dec 06 12:57:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e4e7c-239f-4371-b595-68e70bd0cd33 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6acc78b-d9ed-4615-80d3-1192ae5a7e80]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.459s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] <== disconnect_volume: return (1475ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:57:22 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Deleting instance files /opt/stack/data/nova/instances/6d767ae1-4df2-4e87-b991-729fabd467f8_del
Dec 06 12:57:22 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Deletion of /opt/stack/data/nova/instances/6d767ae1-4df2-4e87-b991-729fabd467f8_del complete
Dec 06 12:57:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] No VIF found with MAC fa:16:3e:88:16:dd, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:57:22 user nova-compute[75247]: INFO nova.compute.manager [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Took 2.53 seconds to destroy the instance on the hypervisor.
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-fb8a107e-9aca-4110-b697-c75eb8a8f3f2 req-ad02853b-bb82-4fce-864f-18926fb3ea1d service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Received event network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fb8a107e-9aca-4110-b697-c75eb8a8f3f2 req-ad02853b-bb82-4fce-864f-18926fb3ea1d service nova] Acquiring lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fb8a107e-9aca-4110-b697-c75eb8a8f3f2 req-ad02853b-bb82-4fce-864f-18926fb3ea1d service nova] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fb8a107e-9aca-4110-b697-c75eb8a8f3f2 req-ad02853b-bb82-4fce-864f-18926fb3ea1d service nova] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-fb8a107e-9aca-4110-b697-c75eb8a8f3f2 req-ad02853b-bb82-4fce-864f-18926fb3ea1d service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] No waiting events found dispatching network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:57:22 user nova-compute[75247]: WARNING nova.compute.manager [req-fb8a107e-9aca-4110-b697-c75eb8a8f3f2 req-ad02853b-bb82-4fce-864f-18926fb3ea1d service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Received unexpected event network-vif-plugged-63f9635e-3eb4-4d2b-b289-e219ade9fb28 for instance with vm_state active and task_state deleting.
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-1b9931a5-627b-4bde-ab1a-d992965ff4ae tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.947s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:57:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-599d9253-ed52-4985-a13c-df0949334889 req-83726a7f-9cbe-4ed3-9257-76d6f117320a service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Received event network-vif-deleted-63f9635e-3eb4-4d2b-b289-e219ade9fb28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:57:22 user nova-compute[75247]: INFO nova.compute.manager [req-599d9253-ed52-4985-a13c-df0949334889 req-83726a7f-9cbe-4ed3-9257-76d6f117320a service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Neutron deleted interface 63f9635e-3eb4-4d2b-b289-e219ade9fb28; detaching it from the instance and deleting it from the info cache
Dec 06 12:57:22 user nova-compute[75247]: DEBUG nova.network.neutron [req-599d9253-ed52-4985-a13c-df0949334889 req-83726a7f-9cbe-4ed3-9257-76d6f117320a service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:57:23 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Took 0.57 seconds to deallocate network for instance.
Dec 06 12:57:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-599d9253-ed52-4985-a13c-df0949334889 req-83726a7f-9cbe-4ed3-9257-76d6f117320a service nova] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Detach interface failed, port_id=63f9635e-3eb4-4d2b-b289-e219ade9fb28, reason: Instance 6d767ae1-4df2-4e87-b991-729fabd467f8 could not be found. {{(pid=75247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 12:57:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:23 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Error from libvirt while getting description of instance-0000001f: [Error Code 42] Domain not found: no domain with matching uuid '6d767ae1-4df2-4e87-b991-729fabd467f8' (instance-0000001f): libvirt.libvirtError: Domain not found: no domain with matching uuid '6d767ae1-4df2-4e87-b991-729fabd467f8' (instance-0000001f)
Dec 06 12:57:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:57:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:23 user nova-compute[75247]: INFO nova.compute.manager [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 6d767ae1-4df2-4e87-b991-729fabd467f8] Took 0.82 seconds to detach 1 volumes for instance.
Dec 06 12:57:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94db53f-e791-4e0f-8c4f-3b292f00a24a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "f5b69324-579d-4833-9bb4-c43c511f820d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:24 user nova-compute[75247]: INFO nova.compute.manager [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Detaching volume 3f057b1b-98f2-4336-b91e-e3a34ae5ad4b
Dec 06 12:57:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:24 user nova-compute[75247]: INFO nova.virt.block_device [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Attempting to driver detach volume 3f057b1b-98f2-4336-b91e-e3a34ae5ad4b from mountpoint /dev/vdb
Dec 06 12:57:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Attempting to detach device vdb from instance f5b69324-579d-4833-9bb4-c43c511f820d from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 12:57:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:57:24 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:57:24 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:57:24 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:57:24 user nova-compute[75247]:   <serial>3f057b1b-98f2-4336-b91e-e3a34ae5ad4b</serial>
Dec 06 12:57:24 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:57:24 user nova-compute[75247]: </disk>
Dec 06 12:57:24 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:57:24 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:57:24 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Successfully detached device vdb from instance f5b69324-579d-4833-9bb4-c43c511f820d from the persistent domain config.
Dec 06 12:57:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f5b69324-579d-4833-9bb4-c43c511f820d from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 12:57:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:57:24 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:57:24 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:57:24 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:57:24 user nova-compute[75247]:   <serial>3f057b1b-98f2-4336-b91e-e3a34ae5ad4b</serial>
Dec 06 12:57:24 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:57:24 user nova-compute[75247]: </disk>
Dec 06 12:57:24 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:57:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94db53f-e791-4e0f-8c4f-3b292f00a24a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94db53f-e791-4e0f-8c4f-3b292f00a24a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:24 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:57:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.622s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:24 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Deleted allocations for instance 6d767ae1-4df2-4e87-b991-729fabd467f8
Dec 06 12:57:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94db53f-e791-4e0f-8c4f-3b292f00a24a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8cc3b0ba-94f2-4050-9877-95db78283181 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "6d767ae1-4df2-4e87-b991-729fabd467f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.795s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:57:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:57:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f5b69324-579d-4833-9bb4-c43c511f820d {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 12:57:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3800b293-6987-43c1-893f-e8919ee17243/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3800b293-6987-43c1-893f-e8919ee17243/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3800b293-6987-43c1-893f-e8919ee17243/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3800b293-6987-43c1-893f-e8919ee17243/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:26 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:57:26 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:57:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=7365MB free_disk=24.867706298828125GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 12:57:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 70c4664e-ae7a-47de-bba7-18300391d209 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:57:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 782289e2-91cd-4aee-9a08-eadfb2a5965b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:57:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 3e1b5197-dc38-48a5-b9f9-e053be499433 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:57:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:57:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance bc3ddb40-b05f-4170-b269-d44dec6ecdaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:57:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 530cfb75-7aa8-4e57-b282-8f7a21401b34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:57:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance f5b69324-579d-4833-9bb4-c43c511f820d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:57:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance b3720cc0-ff80-4ca2-8b13-d83dded593ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:57:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance c603d6dc-804e-4c0d-be1f-40e09de74e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:57:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance a94db53f-e791-4e0f-8c4f-3b292f00a24a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:57:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 3800b293-6987-43c1-893f-e8919ee17243 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:57:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 3b8adc91-c4d4-4484-bd4e-cc3d356338c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:57:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 12:57:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 12:57:26 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:57:26 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:57:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 12:57:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:36 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:44 user nova-compute[75247]: INFO nova.compute.manager [None req-e2e062d9-80c7-42c4-9b6f-5f2b1b49d129 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Get console output
Dec 06 12:57:44 user nova-compute[75247]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Dec 06 12:57:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:44 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f5b69324-579d-4833-9bb4-c43c511f820d is timed out.
Dec 06 12:57:44 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Successfully detached device vdb from instance f5b69324-579d-4833-9bb4-c43c511f820d from the live domain config.
Dec 06 12:57:44 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:57:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RXTcZQim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:57:44 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:57:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:57:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:57:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:44 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5267c12d-a6a7-4bf5-95ab-05ec01dc0e63]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:57:44 user nova-compute[75247]: No targets found.
Dec 06 12:57:44 user nova-compute[75247]: iSNS:
Dec 06 12:57:44 user nova-compute[75247]: No targets found.
Dec 06 12:57:44 user nova-compute[75247]: STATIC:
Dec 06 12:57:44 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b
Dec 06 12:57:44 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:57:44 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:57:44 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:57:44 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:57:44 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:57:44 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31
Dec 06 12:57:44 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:57:44 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:57:44 user nova-compute[75247]: FIRMWARE:
Dec 06 12:57:44 user nova-compute[75247]: No targets found.
Dec 06 12:57:44 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:57:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:57:44 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:57:44 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:57:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:57:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2014d586-6617-4956-a591-d052c563bc63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e061987-ae66-41db-9689-5dc228fe9001]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:57:45 user nova-compute[75247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:57:45 user nova-compute[75247]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b (non-flash)
Dec 06 12:57:45 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:57:45 user nova-compute[75247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:57:45 user nova-compute[75247]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b (non-flash)
Dec 06 12:57:45 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c624b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b'): ({'sdb'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Removing single pathed devices sdb {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f374da80-df8d-423a-967b-3baabed7d0e0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[05daa505-7fc3-4568-aebb-6ff82bc7cd7a]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Flushing IO for device /dev/sdb {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82ef596-cd7e-4431-a096-72b2c3bb27cc]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad3b131-ddbb-4e53-a109-d2caaef205ea]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa33f015-e0fa-427f-90f6-c4b9d9e49d9b]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4681d2dc-9a31-4b2b-a910-44cef106b084]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b, portal: 172.16.0.220,3260]
Dec 06 12:57:45 user nova-compute[75247]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b, portal: 172.16.0.220,3260] successful.
Dec 06 12:57:45 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f057b1b-98f2-4336-b91e-e3a34ae5ad4b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[89be368a-df1d-4511-94e5-76e5afef5931]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] <== disconnect_volume: return (339ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:57:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:57:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:46 user nova-compute[75247]: DEBUG nova.objects.instance [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lazy-loading 'flavor' on Instance uuid f5b69324-579d-4833-9bb4-c43c511f820d {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:57:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8fb2a56d-e284-4cc7-9a52-dda13fcb5c8f tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.800s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:48 user nova-compute[75247]: DEBUG nova.compute.manager [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:57:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:48 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:57:48 user nova-compute[75247]: INFO nova.compute.claims [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Claim successful on node user
Dec 06 12:57:49 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:57:49 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:57:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:49 user nova-compute[75247]: DEBUG nova.compute.manager [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:57:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:49 user nova-compute[75247]: DEBUG nova.compute.manager [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:57:49 user nova-compute[75247]: DEBUG nova.network.neutron [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:57:49 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:57:49 user nova-compute[75247]: DEBUG nova.compute.manager [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:57:49 user nova-compute[75247]: DEBUG nova.policy [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'deac43cb03b440ff9de75801065ec9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b253fd3ef3284dd885d3a0efc1ec07d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:57:49 user nova-compute[75247]: DEBUG nova.compute.manager [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:57:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:57:49 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Creating image(s)
Dec 06 12:57:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "/opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "/opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "/opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.019s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.179s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.180s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk 1073741824" returned: 0 in 0.050s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:50 user nova-compute[75247]: DEBUG nova.network.neutron [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Successfully created port: 3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:57:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.201s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:50 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:57:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:50 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:50 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Cannot resize image /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:57:50 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:57:50 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Ensure instance console log exists: /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:57:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:50 user nova-compute[75247]: DEBUG nova.network.neutron [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Successfully updated port: 3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "refresh_cache-16dd787d-6abe-48f3-ac3c-fd55853b4e23" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquired lock "refresh_cache-16dd787d-6abe-48f3-ac3c-fd55853b4e23" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.network.neutron [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.compute.manager [req-743ef3df-febe-4d72-ba14-8389eb9b63f6 req-9bf04663-2073-4b4b-9798-08fe7a25798b service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received event network-changed-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.compute.manager [req-743ef3df-febe-4d72-ba14-8389eb9b63f6 req-9bf04663-2073-4b4b-9798-08fe7a25798b service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Refreshing instance network info cache due to event network-changed-3a8804e1-c0a2-4f4a-941e-5fc617f45d93. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-743ef3df-febe-4d72-ba14-8389eb9b63f6 req-9bf04663-2073-4b4b-9798-08fe7a25798b service nova] Acquiring lock "refresh_cache-16dd787d-6abe-48f3-ac3c-fd55853b4e23" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.network.neutron [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.network.neutron [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Updating instance_info_cache with network_info: [{"id": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "address": "fa:16:3e:f9:7b:5b", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8804e1-c0", "ovs_interfaceid": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Releasing lock "refresh_cache-16dd787d-6abe-48f3-ac3c-fd55853b4e23" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.compute.manager [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Instance network_info: |[{"id": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "address": "fa:16:3e:f9:7b:5b", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8804e1-c0", "ovs_interfaceid": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-743ef3df-febe-4d72-ba14-8389eb9b63f6 req-9bf04663-2073-4b4b-9798-08fe7a25798b service nova] Acquired lock "refresh_cache-16dd787d-6abe-48f3-ac3c-fd55853b4e23" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.network.neutron [req-743ef3df-febe-4d72-ba14-8389eb9b63f6 req-9bf04663-2073-4b4b-9798-08fe7a25798b service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Refreshing network info cache for port 3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Start _get_guest_xml network_info=[{"id": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "address": "fa:16:3e:f9:7b:5b", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8804e1-c0", "ovs_interfaceid": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:57:51 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:57:51 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-149152184',display_name='tempest-ServerRescueNegativeTestJSON-server-149152184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-149152184',id=39,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3vBCyE6q5nI66WXDqfmPgjhRHEH8SIKzGzERVNDwjRqS88kAZzFoeCZqEn8fKloo/IDS4Ul1cGss1JK9h0KmMVz4QwDFTCNUHkpu02hNM01o6i8wM7G4pctSEySvLrUg==',key_name='tempest-keypair-1978844049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b253fd3ef3284dd885d3a0efc1ec07d7',ramdisk_id='',reservation_id='r-pl392su4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-295230580',owner_user_name='tempest-ServerRescueNegativeTestJSON-295230580-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='deac43cb03b440ff9de75801065ec9af',uuid=16dd787d-6abe-48f3-ac3c-fd55853b4e23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "address": "fa:16:3e:f9:7b:5b", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8804e1-c0", "ovs_interfaceid": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Converting VIF {"id": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "address": "fa:16:3e:f9:7b:5b", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8804e1-c0", "ovs_interfaceid": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:7b:5b,bridge_name='br-int',has_traffic_filtering=True,id=3a8804e1-c0a2-4f4a-941e-5fc617f45d93,network=Network(579972e2-9933-47d9-b56b-f64b5650d611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8804e1-c0') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.objects.instance [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'pci_devices' on Instance uuid 16dd787d-6abe-48f3-ac3c-fd55853b4e23 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:57:51 user nova-compute[75247]:   <uuid>16dd787d-6abe-48f3-ac3c-fd55853b4e23</uuid>
Dec 06 12:57:51 user nova-compute[75247]:   <name>instance-00000027</name>
Dec 06 12:57:51 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:57:51 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:57:51 user nova-compute[75247]:   <metadata>
Dec 06 12:57:51 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:57:51 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:57:51 user nova-compute[75247]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-149152184</nova:name>
Dec 06 12:57:51 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:57:51</nova:creationTime>
Dec 06 12:57:51 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:57:51 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:57:51 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:57:51 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:57:51 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:57:51 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:57:51 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:57:51 user nova-compute[75247]:       <nova:owner>
Dec 06 12:57:51 user nova-compute[75247]:         <nova:user uuid="deac43cb03b440ff9de75801065ec9af">tempest-ServerRescueNegativeTestJSON-295230580-project-member</nova:user>
Dec 06 12:57:51 user nova-compute[75247]:         <nova:project uuid="b253fd3ef3284dd885d3a0efc1ec07d7">tempest-ServerRescueNegativeTestJSON-295230580</nova:project>
Dec 06 12:57:51 user nova-compute[75247]:       </nova:owner>
Dec 06 12:57:51 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:57:51 user nova-compute[75247]:       <nova:ports>
Dec 06 12:57:51 user nova-compute[75247]:         <nova:port uuid="3a8804e1-c0a2-4f4a-941e-5fc617f45d93">
Dec 06 12:57:51 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 06 12:57:51 user nova-compute[75247]:         </nova:port>
Dec 06 12:57:51 user nova-compute[75247]:       </nova:ports>
Dec 06 12:57:51 user nova-compute[75247]:     </nova:instance>
Dec 06 12:57:51 user nova-compute[75247]:   </metadata>
Dec 06 12:57:51 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:57:51 user nova-compute[75247]:     <system>
Dec 06 12:57:51 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:57:51 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:57:51 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:57:51 user nova-compute[75247]:       <entry name="serial">16dd787d-6abe-48f3-ac3c-fd55853b4e23</entry>
Dec 06 12:57:51 user nova-compute[75247]:       <entry name="uuid">16dd787d-6abe-48f3-ac3c-fd55853b4e23</entry>
Dec 06 12:57:51 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:57:51 user nova-compute[75247]:     </system>
Dec 06 12:57:51 user nova-compute[75247]:   </sysinfo>
Dec 06 12:57:51 user nova-compute[75247]:   <os>
Dec 06 12:57:51 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:57:51 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:57:51 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:57:51 user nova-compute[75247]:   </os>
Dec 06 12:57:51 user nova-compute[75247]:   <features>
Dec 06 12:57:51 user nova-compute[75247]:     <acpi/>
Dec 06 12:57:51 user nova-compute[75247]:     <apic/>
Dec 06 12:57:51 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:57:51 user nova-compute[75247]:   </features>
Dec 06 12:57:51 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:57:51 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:57:51 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:57:51 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:57:51 user nova-compute[75247]:   </clock>
Dec 06 12:57:51 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:57:51 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:57:51 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:57:51 user nova-compute[75247]:   </cpu>
Dec 06 12:57:51 user nova-compute[75247]:   <devices>
Dec 06 12:57:51 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:57:51 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:57:51 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk"/>
Dec 06 12:57:51 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:57:51 user nova-compute[75247]:     </disk>
Dec 06 12:57:51 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:57:51 user nova-compute[75247]:       <mac address="fa:16:3e:f9:7b:5b"/>
Dec 06 12:57:51 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:57:51 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:57:51 user nova-compute[75247]:       <target dev="tap3a8804e1-c0"/>
Dec 06 12:57:51 user nova-compute[75247]:     </interface>
Dec 06 12:57:51 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:57:51 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/console.log" append="off"/>
Dec 06 12:57:51 user nova-compute[75247]:     </serial>
Dec 06 12:57:51 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:57:51 user nova-compute[75247]:     <video>
Dec 06 12:57:51 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:57:51 user nova-compute[75247]:     </video>
Dec 06 12:57:51 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:57:51 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:57:51 user nova-compute[75247]:     </rng>
Dec 06 12:57:51 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:57:51 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:57:51 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:57:51 user nova-compute[75247]:     </memballoon>
Dec 06 12:57:51 user nova-compute[75247]:   </devices>
Dec 06 12:57:51 user nova-compute[75247]: </domain>
Dec 06 12:57:51 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-149152184',display_name='tempest-ServerRescueNegativeTestJSON-server-149152184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-149152184',id=39,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3vBCyE6q5nI66WXDqfmPgjhRHEH8SIKzGzERVNDwjRqS88kAZzFoeCZqEn8fKloo/IDS4Ul1cGss1JK9h0KmMVz4QwDFTCNUHkpu02hNM01o6i8wM7G4pctSEySvLrUg==',key_name='tempest-keypair-1978844049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b253fd3ef3284dd885d3a0efc1ec07d7',ramdisk_id='',reservation_id='r-pl392su4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-295230580',owner_user_name='tempest-ServerRescueNegativeTestJSON-295230580-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='deac43cb03b440ff9de75801065ec9af',uuid=16dd787d-6abe-48f3-ac3c-fd55853b4e23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "address": "fa:16:3e:f9:7b:5b", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8804e1-c0", "ovs_interfaceid": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Converting VIF {"id": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "address": "fa:16:3e:f9:7b:5b", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8804e1-c0", "ovs_interfaceid": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:7b:5b,bridge_name='br-int',has_traffic_filtering=True,id=3a8804e1-c0a2-4f4a-941e-5fc617f45d93,network=Network(579972e2-9933-47d9-b56b-f64b5650d611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8804e1-c0') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG os_vif [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:7b:5b,bridge_name='br-int',has_traffic_filtering=True,id=3a8804e1-c0a2-4f4a-941e-5fc617f45d93,network=Network(579972e2-9933-47d9-b56b-f64b5650d611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8804e1-c0') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76993563-e32d-5c54-93b1-b9714097a69d', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a8804e1-c0, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a8804e1-c0, col_values=(('qos', UUID('cc8c7661-67ef-4080-95d7-160123f0a275')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a8804e1-c0, col_values=(('external_ids', {'iface-id': '3a8804e1-c0a2-4f4a-941e-5fc617f45d93', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:7b:5b', 'vm-uuid': '16dd787d-6abe-48f3-ac3c-fd55853b4e23'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:51 user nova-compute[75247]: INFO os_vif [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:7b:5b,bridge_name='br-int',has_traffic_filtering=True,id=3a8804e1-c0a2-4f4a-941e-5fc617f45d93,network=Network(579972e2-9933-47d9-b56b-f64b5650d611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8804e1-c0')
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] No VIF found with MAC fa:16:3e:f9:7b:5b, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.network.neutron [req-743ef3df-febe-4d72-ba14-8389eb9b63f6 req-9bf04663-2073-4b4b-9798-08fe7a25798b service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Updated VIF entry in instance network info cache for port 3a8804e1-c0a2-4f4a-941e-5fc617f45d93. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG nova.network.neutron [req-743ef3df-febe-4d72-ba14-8389eb9b63f6 req-9bf04663-2073-4b4b-9798-08fe7a25798b service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Updating instance_info_cache with network_info: [{"id": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "address": "fa:16:3e:f9:7b:5b", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8804e1-c0", "ovs_interfaceid": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:57:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-743ef3df-febe-4d72-ba14-8389eb9b63f6 req-9bf04663-2073-4b4b-9798-08fe7a25798b service nova] Releasing lock "refresh_cache-16dd787d-6abe-48f3-ac3c-fd55853b4e23" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:57:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:54 user nova-compute[75247]: DEBUG nova.compute.manager [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:57:54 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:57:54 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Instance spawned successfully.
Dec 06 12:57:54 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:57:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:57:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:57:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:57:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:57:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:57:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:57:55 user nova-compute[75247]: INFO nova.compute.manager [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Took 5.50 seconds to spawn the instance on the hypervisor.
Dec 06 12:57:55 user nova-compute[75247]: DEBUG nova.compute.manager [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:57:55 user nova-compute[75247]: INFO nova.compute.manager [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Took 6.30 seconds to build instance.
Dec 06 12:57:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-026b02f8-f2c9-474a-b122-52ece32e1bd1 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.405s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:55 user nova-compute[75247]: DEBUG nova.compute.manager [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 12:57:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:56 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 12:57:56 user nova-compute[75247]: INFO nova.compute.claims [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Claim successful on node user
Dec 06 12:57:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:56 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:57:56 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:57:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:56 user nova-compute[75247]: DEBUG nova.compute.manager [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 12:57:56 user nova-compute[75247]: DEBUG nova.compute.manager [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 12:57:56 user nova-compute[75247]: DEBUG nova.network.neutron [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 12:57:56 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 12:57:56 user nova-compute[75247]: DEBUG nova.compute.manager [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 12:57:56 user nova-compute[75247]: DEBUG nova.policy [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ac9a9c6e8f34a828c737e8b45da7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f3c1de288423e8964c31ca35664c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 12:57:56 user nova-compute[75247]: DEBUG nova.compute.manager [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 12:57:56 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 12:57:56 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Creating image(s)
Dec 06 12:57:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "/opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "/opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.180s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.182s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk 1073741824" returned: 0 in 0.048s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.182s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:57 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 12:57:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:57:57 user nova-compute[75247]: DEBUG nova.network.neutron [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Successfully created port: 58e08de5-6c1a-48bc-aa1a-242ec3b175a1 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 12:57:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:57:57 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Cannot resize image /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 12:57:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:57:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Ensure instance console log exists: /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 12:57:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:57:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:57:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.network.neutron [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Successfully updated port: 58e08de5-6c1a-48bc-aa1a-242ec3b175a1 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "refresh_cache-e1f21135-43cd-4dbb-ae7a-b12dffdc5816" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquired lock "refresh_cache-e1f21135-43cd-4dbb-ae7a-b12dffdc5816" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.network.neutron [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.compute.manager [req-f04f8026-1b0f-4594-96fc-6b1ee5737120 req-f077aabc-b799-4ac2-b222-2556d0769fbf service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Received event network-changed-58e08de5-6c1a-48bc-aa1a-242ec3b175a1 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.compute.manager [req-f04f8026-1b0f-4594-96fc-6b1ee5737120 req-f077aabc-b799-4ac2-b222-2556d0769fbf service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Refreshing instance network info cache due to event network-changed-58e08de5-6c1a-48bc-aa1a-242ec3b175a1. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f04f8026-1b0f-4594-96fc-6b1ee5737120 req-f077aabc-b799-4ac2-b222-2556d0769fbf service nova] Acquiring lock "refresh_cache-e1f21135-43cd-4dbb-ae7a-b12dffdc5816" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.network.neutron [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.network.neutron [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Updating instance_info_cache with network_info: [{"id": "58e08de5-6c1a-48bc-aa1a-242ec3b175a1", "address": "fa:16:3e:d6:b6:ce", "network": {"id": "053733b9-e8f4-4da1-a5fe-ee7d0704684c", "bridge": "br-int", "label": "tempest-TestStampPattern-239755854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "135f3c1de288423e8964c31ca35664c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e08de5-6c", "ovs_interfaceid": "58e08de5-6c1a-48bc-aa1a-242ec3b175a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Releasing lock "refresh_cache-e1f21135-43cd-4dbb-ae7a-b12dffdc5816" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.compute.manager [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Instance network_info: |[{"id": "58e08de5-6c1a-48bc-aa1a-242ec3b175a1", "address": "fa:16:3e:d6:b6:ce", "network": {"id": "053733b9-e8f4-4da1-a5fe-ee7d0704684c", "bridge": "br-int", "label": "tempest-TestStampPattern-239755854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "135f3c1de288423e8964c31ca35664c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e08de5-6c", "ovs_interfaceid": "58e08de5-6c1a-48bc-aa1a-242ec3b175a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f04f8026-1b0f-4594-96fc-6b1ee5737120 req-f077aabc-b799-4ac2-b222-2556d0769fbf service nova] Acquired lock "refresh_cache-e1f21135-43cd-4dbb-ae7a-b12dffdc5816" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.network.neutron [req-f04f8026-1b0f-4594-96fc-6b1ee5737120 req-f077aabc-b799-4ac2-b222-2556d0769fbf service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Refreshing network info cache for port 58e08de5-6c1a-48bc-aa1a-242ec3b175a1 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Start _get_guest_xml network_info=[{"id": "58e08de5-6c1a-48bc-aa1a-242ec3b175a1", "address": "fa:16:3e:d6:b6:ce", "network": {"id": "053733b9-e8f4-4da1-a5fe-ee7d0704684c", "bridge": "br-int", "label": "tempest-TestStampPattern-239755854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "135f3c1de288423e8964c31ca35664c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e08de5-6c", "ovs_interfaceid": "58e08de5-6c1a-48bc-aa1a-242ec3b175a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:57:58 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:57:58 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:57:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-305885949',display_name='tempest-TestStampPattern-server-305885949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-305885949',id=40,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0R56ocpUVDhrbWezba5KdSt9CClipCfqGo33mBvmQ86FzrqlnssF888NmN27WHariFI9cN7fX+09ONrvhHiWT31I4taIadhAyTDm1d90LRTwaNyayfF9CNEjQpjWnVDw==',key_name='tempest-TestStampPattern-181483636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='135f3c1de288423e8964c31ca35664c0',ramdisk_id='',reservation_id='r-nl00ebex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1741400309',owner_user_name='tempest-TestStampPattern-1741400309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:57:57Z,user_data=None,user_id='9ac9a9c6e8f34a828c737e8b45da7721',uuid=e1f21135-43cd-4dbb-ae7a-b12dffdc5816,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58e08de5-6c1a-48bc-aa1a-242ec3b175a1", "address": "fa:16:3e:d6:b6:ce", "network": {"id": "053733b9-e8f4-4da1-a5fe-ee7d0704684c", "bridge": "br-int", "label": "tempest-TestStampPattern-239755854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "135f3c1de288423e8964c31ca35664c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e08de5-6c", "ovs_interfaceid": "58e08de5-6c1a-48bc-aa1a-242ec3b175a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Converting VIF {"id": "58e08de5-6c1a-48bc-aa1a-242ec3b175a1", "address": "fa:16:3e:d6:b6:ce", "network": {"id": "053733b9-e8f4-4da1-a5fe-ee7d0704684c", "bridge": "br-int", "label": "tempest-TestStampPattern-239755854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "135f3c1de288423e8964c31ca35664c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e08de5-6c", "ovs_interfaceid": "58e08de5-6c1a-48bc-aa1a-242ec3b175a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:b6:ce,bridge_name='br-int',has_traffic_filtering=True,id=58e08de5-6c1a-48bc-aa1a-242ec3b175a1,network=Network(053733b9-e8f4-4da1-a5fe-ee7d0704684c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e08de5-6c') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:57:58 user nova-compute[75247]: DEBUG nova.objects.instance [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lazy-loading 'pci_devices' on Instance uuid e1f21135-43cd-4dbb-ae7a-b12dffdc5816 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:57:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:57:59 user nova-compute[75247]:   <uuid>e1f21135-43cd-4dbb-ae7a-b12dffdc5816</uuid>
Dec 06 12:57:59 user nova-compute[75247]:   <name>instance-00000028</name>
Dec 06 12:57:59 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:57:59 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:57:59 user nova-compute[75247]:   <metadata>
Dec 06 12:57:59 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:57:59 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:57:59 user nova-compute[75247]:       <nova:name>tempest-TestStampPattern-server-305885949</nova:name>
Dec 06 12:57:59 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:57:58</nova:creationTime>
Dec 06 12:57:59 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:57:59 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:57:59 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:57:59 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:57:59 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:57:59 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:57:59 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:57:59 user nova-compute[75247]:       <nova:owner>
Dec 06 12:57:59 user nova-compute[75247]:         <nova:user uuid="9ac9a9c6e8f34a828c737e8b45da7721">tempest-TestStampPattern-1741400309-project-member</nova:user>
Dec 06 12:57:59 user nova-compute[75247]:         <nova:project uuid="135f3c1de288423e8964c31ca35664c0">tempest-TestStampPattern-1741400309</nova:project>
Dec 06 12:57:59 user nova-compute[75247]:       </nova:owner>
Dec 06 12:57:59 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:57:59 user nova-compute[75247]:       <nova:ports>
Dec 06 12:57:59 user nova-compute[75247]:         <nova:port uuid="58e08de5-6c1a-48bc-aa1a-242ec3b175a1">
Dec 06 12:57:59 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 12:57:59 user nova-compute[75247]:         </nova:port>
Dec 06 12:57:59 user nova-compute[75247]:       </nova:ports>
Dec 06 12:57:59 user nova-compute[75247]:     </nova:instance>
Dec 06 12:57:59 user nova-compute[75247]:   </metadata>
Dec 06 12:57:59 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:57:59 user nova-compute[75247]:     <system>
Dec 06 12:57:59 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:57:59 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:57:59 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:57:59 user nova-compute[75247]:       <entry name="serial">e1f21135-43cd-4dbb-ae7a-b12dffdc5816</entry>
Dec 06 12:57:59 user nova-compute[75247]:       <entry name="uuid">e1f21135-43cd-4dbb-ae7a-b12dffdc5816</entry>
Dec 06 12:57:59 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:57:59 user nova-compute[75247]:     </system>
Dec 06 12:57:59 user nova-compute[75247]:   </sysinfo>
Dec 06 12:57:59 user nova-compute[75247]:   <os>
Dec 06 12:57:59 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:57:59 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 12:57:59 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:57:59 user nova-compute[75247]:   </os>
Dec 06 12:57:59 user nova-compute[75247]:   <features>
Dec 06 12:57:59 user nova-compute[75247]:     <acpi/>
Dec 06 12:57:59 user nova-compute[75247]:     <apic/>
Dec 06 12:57:59 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:57:59 user nova-compute[75247]:   </features>
Dec 06 12:57:59 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:57:59 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:57:59 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:57:59 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:57:59 user nova-compute[75247]:   </clock>
Dec 06 12:57:59 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:57:59 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:57:59 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:57:59 user nova-compute[75247]:   </cpu>
Dec 06 12:57:59 user nova-compute[75247]:   <devices>
Dec 06 12:57:59 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:57:59 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:57:59 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk"/>
Dec 06 12:57:59 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:57:59 user nova-compute[75247]:     </disk>
Dec 06 12:57:59 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:57:59 user nova-compute[75247]:       <mac address="fa:16:3e:d6:b6:ce"/>
Dec 06 12:57:59 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:57:59 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:57:59 user nova-compute[75247]:       <target dev="tap58e08de5-6c"/>
Dec 06 12:57:59 user nova-compute[75247]:     </interface>
Dec 06 12:57:59 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:57:59 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/console.log" append="off"/>
Dec 06 12:57:59 user nova-compute[75247]:     </serial>
Dec 06 12:57:59 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:57:59 user nova-compute[75247]:     <video>
Dec 06 12:57:59 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:57:59 user nova-compute[75247]:     </video>
Dec 06 12:57:59 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:57:59 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:57:59 user nova-compute[75247]:     </rng>
Dec 06 12:57:59 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:57:59 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:57:59 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:57:59 user nova-compute[75247]:     </memballoon>
Dec 06 12:57:59 user nova-compute[75247]:   </devices>
Dec 06 12:57:59 user nova-compute[75247]: </domain>
Dec 06 12:57:59 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:57:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:57:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-305885949',display_name='tempest-TestStampPattern-server-305885949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-305885949',id=40,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0R56ocpUVDhrbWezba5KdSt9CClipCfqGo33mBvmQ86FzrqlnssF888NmN27WHariFI9cN7fX+09ONrvhHiWT31I4taIadhAyTDm1d90LRTwaNyayfF9CNEjQpjWnVDw==',key_name='tempest-TestStampPattern-181483636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='135f3c1de288423e8964c31ca35664c0',ramdisk_id='',reservation_id='r-nl00ebex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1741400309',owner_user_name='tempest-TestStampPattern-1741400309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:57:57Z,user_data=None,user_id='9ac9a9c6e8f34a828c737e8b45da7721',uuid=e1f21135-43cd-4dbb-ae7a-b12dffdc5816,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58e08de5-6c1a-48bc-aa1a-242ec3b175a1", "address": "fa:16:3e:d6:b6:ce", "network": {"id": "053733b9-e8f4-4da1-a5fe-ee7d0704684c", "bridge": "br-int", "label": "tempest-TestStampPattern-239755854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "135f3c1de288423e8964c31ca35664c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e08de5-6c", "ovs_interfaceid": "58e08de5-6c1a-48bc-aa1a-242ec3b175a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 12:57:59 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Converting VIF {"id": "58e08de5-6c1a-48bc-aa1a-242ec3b175a1", "address": "fa:16:3e:d6:b6:ce", "network": {"id": "053733b9-e8f4-4da1-a5fe-ee7d0704684c", "bridge": "br-int", "label": "tempest-TestStampPattern-239755854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "135f3c1de288423e8964c31ca35664c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e08de5-6c", "ovs_interfaceid": "58e08de5-6c1a-48bc-aa1a-242ec3b175a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:57:59 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:b6:ce,bridge_name='br-int',has_traffic_filtering=True,id=58e08de5-6c1a-48bc-aa1a-242ec3b175a1,network=Network(053733b9-e8f4-4da1-a5fe-ee7d0704684c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e08de5-6c') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:57:59 user nova-compute[75247]: DEBUG os_vif [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:b6:ce,bridge_name='br-int',has_traffic_filtering=True,id=58e08de5-6c1a-48bc-aa1a-242ec3b175a1,network=Network(053733b9-e8f4-4da1-a5fe-ee7d0704684c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e08de5-6c') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 12:57:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:57:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 12:57:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '325a7e74-5c1a-5b36-92a1-391abc4c4534', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:57:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:57:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58e08de5-6c, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:57:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap58e08de5-6c, col_values=(('qos', UUID('51c6a0b0-fa8e-40ff-9e9e-457252033d30')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:57:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap58e08de5-6c, col_values=(('external_ids', {'iface-id': '58e08de5-6c1a-48bc-aa1a-242ec3b175a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:b6:ce', 'vm-uuid': 'e1f21135-43cd-4dbb-ae7a-b12dffdc5816'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:57:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:57:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:57:59 user nova-compute[75247]: INFO os_vif [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:b6:ce,bridge_name='br-int',has_traffic_filtering=True,id=58e08de5-6c1a-48bc-aa1a-242ec3b175a1,network=Network(053733b9-e8f4-4da1-a5fe-ee7d0704684c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e08de5-6c')
Dec 06 12:57:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:57:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] No VIF found with MAC fa:16:3e:d6:b6:ce, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:57:59 user nova-compute[75247]: DEBUG nova.network.neutron [req-f04f8026-1b0f-4594-96fc-6b1ee5737120 req-f077aabc-b799-4ac2-b222-2556d0769fbf service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Updated VIF entry in instance network info cache for port 58e08de5-6c1a-48bc-aa1a-242ec3b175a1. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:57:59 user nova-compute[75247]: DEBUG nova.network.neutron [req-f04f8026-1b0f-4594-96fc-6b1ee5737120 req-f077aabc-b799-4ac2-b222-2556d0769fbf service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Updating instance_info_cache with network_info: [{"id": "58e08de5-6c1a-48bc-aa1a-242ec3b175a1", "address": "fa:16:3e:d6:b6:ce", "network": {"id": "053733b9-e8f4-4da1-a5fe-ee7d0704684c", "bridge": "br-int", "label": "tempest-TestStampPattern-239755854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "135f3c1de288423e8964c31ca35664c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e08de5-6c", "ovs_interfaceid": "58e08de5-6c1a-48bc-aa1a-242ec3b175a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:57:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f04f8026-1b0f-4594-96fc-6b1ee5737120 req-f077aabc-b799-4ac2-b222-2556d0769fbf service nova] Releasing lock "refresh_cache-e1f21135-43cd-4dbb-ae7a-b12dffdc5816" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:57:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:00 user nova-compute[75247]: DEBUG nova.compute.manager [req-03036718-3f7a-44b4-940d-2493b6d618cf req-f2d52103-71a7-4e88-affa-7f5d1fce6cbc service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received event network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:58:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-03036718-3f7a-44b4-940d-2493b6d618cf req-f2d52103-71a7-4e88-affa-7f5d1fce6cbc service nova] Acquiring lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-03036718-3f7a-44b4-940d-2493b6d618cf req-f2d52103-71a7-4e88-affa-7f5d1fce6cbc service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-03036718-3f7a-44b4-940d-2493b6d618cf req-f2d52103-71a7-4e88-affa-7f5d1fce6cbc service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:00 user nova-compute[75247]: DEBUG nova.compute.manager [req-03036718-3f7a-44b4-940d-2493b6d618cf req-f2d52103-71a7-4e88-affa-7f5d1fce6cbc service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] No waiting events found dispatching network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:58:00 user nova-compute[75247]: WARNING nova.compute.manager [req-03036718-3f7a-44b4-940d-2493b6d618cf req-f2d52103-71a7-4e88-affa-7f5d1fce6cbc service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received unexpected event network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 for instance with vm_state active and task_state None.
Dec 06 12:58:00 user nova-compute[75247]: DEBUG nova.compute.manager [req-03036718-3f7a-44b4-940d-2493b6d618cf req-f2d52103-71a7-4e88-affa-7f5d1fce6cbc service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received event network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:58:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-03036718-3f7a-44b4-940d-2493b6d618cf req-f2d52103-71a7-4e88-affa-7f5d1fce6cbc service nova] Acquiring lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-03036718-3f7a-44b4-940d-2493b6d618cf req-f2d52103-71a7-4e88-affa-7f5d1fce6cbc service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-03036718-3f7a-44b4-940d-2493b6d618cf req-f2d52103-71a7-4e88-affa-7f5d1fce6cbc service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:00 user nova-compute[75247]: DEBUG nova.compute.manager [req-03036718-3f7a-44b4-940d-2493b6d618cf req-f2d52103-71a7-4e88-affa-7f5d1fce6cbc service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] No waiting events found dispatching network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:58:00 user nova-compute[75247]: WARNING nova.compute.manager [req-03036718-3f7a-44b4-940d-2493b6d618cf req-f2d52103-71a7-4e88-affa-7f5d1fce6cbc service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received unexpected event network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 for instance with vm_state active and task_state None.
Dec 06 12:58:00 user nova-compute[75247]: DEBUG nova.compute.manager [req-50b98ddb-c768-440a-acf6-43d292970c95 req-67e51364-ee14-4826-b74e-f046284ea426 service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Received event network-vif-plugged-58e08de5-6c1a-48bc-aa1a-242ec3b175a1 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:58:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-50b98ddb-c768-440a-acf6-43d292970c95 req-67e51364-ee14-4826-b74e-f046284ea426 service nova] Acquiring lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-50b98ddb-c768-440a-acf6-43d292970c95 req-67e51364-ee14-4826-b74e-f046284ea426 service nova] Lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-50b98ddb-c768-440a-acf6-43d292970c95 req-67e51364-ee14-4826-b74e-f046284ea426 service nova] Lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:00 user nova-compute[75247]: DEBUG nova.compute.manager [req-50b98ddb-c768-440a-acf6-43d292970c95 req-67e51364-ee14-4826-b74e-f046284ea426 service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] No waiting events found dispatching network-vif-plugged-58e08de5-6c1a-48bc-aa1a-242ec3b175a1 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:58:00 user nova-compute[75247]: WARNING nova.compute.manager [req-50b98ddb-c768-440a-acf6-43d292970c95 req-67e51364-ee14-4826-b74e-f046284ea426 service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Received unexpected event network-vif-plugged-58e08de5-6c1a-48bc-aa1a-242ec3b175a1 for instance with vm_state building and task_state spawning.
Dec 06 12:58:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:02 user nova-compute[75247]: DEBUG nova.compute.manager [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 12:58:02 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 12:58:02 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Instance spawned successfully.
Dec 06 12:58:02 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 12:58:02 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:58:02 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:58:02 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:58:02 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:58:02 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:58:02 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 12:58:02 user nova-compute[75247]: INFO nova.compute.manager [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Took 5.88 seconds to spawn the instance on the hypervisor.
Dec 06 12:58:02 user nova-compute[75247]: DEBUG nova.compute.manager [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 12:58:02 user nova-compute[75247]: INFO nova.compute.manager [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Took 6.76 seconds to build instance.
Dec 06 12:58:02 user nova-compute[75247]: DEBUG nova.compute.manager [req-561e347b-e46e-477b-aae5-67d06a8aa21f req-9a8ffb79-dc69-4dba-9312-c51c0181a03b service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Received event network-vif-plugged-58e08de5-6c1a-48bc-aa1a-242ec3b175a1 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:58:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-561e347b-e46e-477b-aae5-67d06a8aa21f req-9a8ffb79-dc69-4dba-9312-c51c0181a03b service nova] Acquiring lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-561e347b-e46e-477b-aae5-67d06a8aa21f req-9a8ffb79-dc69-4dba-9312-c51c0181a03b service nova] Lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-561e347b-e46e-477b-aae5-67d06a8aa21f req-9a8ffb79-dc69-4dba-9312-c51c0181a03b service nova] Lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:02 user nova-compute[75247]: DEBUG nova.compute.manager [req-561e347b-e46e-477b-aae5-67d06a8aa21f req-9a8ffb79-dc69-4dba-9312-c51c0181a03b service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] No waiting events found dispatching network-vif-plugged-58e08de5-6c1a-48bc-aa1a-242ec3b175a1 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:58:02 user nova-compute[75247]: WARNING nova.compute.manager [req-561e347b-e46e-477b-aae5-67d06a8aa21f req-9a8ffb79-dc69-4dba-9312-c51c0181a03b service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Received unexpected event network-vif-plugged-58e08de5-6c1a-48bc-aa1a-242ec3b175a1 for instance with vm_state active and task_state None.
Dec 06 12:58:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-34034c9e-0984-4d29-b0ab-64c4a5ecfbe9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.911s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5a5f8711-c7f5-4751-9197-6024dc396cb6 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Acquiring lock "a94db53f-e791-4e0f-8c4f-3b292f00a24a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5a5f8711-c7f5-4751-9197-6024dc396cb6 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "a94db53f-e791-4e0f-8c4f-3b292f00a24a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5a5f8711-c7f5-4751-9197-6024dc396cb6 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Acquiring lock "a94db53f-e791-4e0f-8c4f-3b292f00a24a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5a5f8711-c7f5-4751-9197-6024dc396cb6 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "a94db53f-e791-4e0f-8c4f-3b292f00a24a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5a5f8711-c7f5-4751-9197-6024dc396cb6 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "a94db53f-e791-4e0f-8c4f-3b292f00a24a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:07 user nova-compute[75247]: INFO nova.compute.manager [None req-5a5f8711-c7f5-4751-9197-6024dc396cb6 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Terminating instance
Dec 06 12:58:07 user nova-compute[75247]: DEBUG nova.compute.manager [None req-5a5f8711-c7f5-4751-9197-6024dc396cb6 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:58:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:07 user nova-compute[75247]: DEBUG nova.compute.manager [req-c4c9d353-fcec-4daa-b959-9fc83ec369ec req-9f4f3d18-cf57-4d6d-8a07-808fa8912563 service nova] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Received event network-vif-unplugged-01209cad-6739-4725-9f7e-5836a9ad691e {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:58:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c4c9d353-fcec-4daa-b959-9fc83ec369ec req-9f4f3d18-cf57-4d6d-8a07-808fa8912563 service nova] Acquiring lock "a94db53f-e791-4e0f-8c4f-3b292f00a24a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c4c9d353-fcec-4daa-b959-9fc83ec369ec req-9f4f3d18-cf57-4d6d-8a07-808fa8912563 service nova] Lock "a94db53f-e791-4e0f-8c4f-3b292f00a24a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c4c9d353-fcec-4daa-b959-9fc83ec369ec req-9f4f3d18-cf57-4d6d-8a07-808fa8912563 service nova] Lock "a94db53f-e791-4e0f-8c4f-3b292f00a24a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:07 user nova-compute[75247]: DEBUG nova.compute.manager [req-c4c9d353-fcec-4daa-b959-9fc83ec369ec req-9f4f3d18-cf57-4d6d-8a07-808fa8912563 service nova] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] No waiting events found dispatching network-vif-unplugged-01209cad-6739-4725-9f7e-5836a9ad691e {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:58:07 user nova-compute[75247]: DEBUG nova.compute.manager [req-c4c9d353-fcec-4daa-b959-9fc83ec369ec req-9f4f3d18-cf57-4d6d-8a07-808fa8912563 service nova] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Received event network-vif-unplugged-01209cad-6739-4725-9f7e-5836a9ad691e for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:58:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:08 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Instance destroyed successfully.
Dec 06 12:58:08 user nova-compute[75247]: DEBUG nova.objects.instance [None req-5a5f8711-c7f5-4751-9197-6024dc396cb6 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lazy-loading 'resources' on Instance uuid a94db53f-e791-4e0f-8c4f-3b292f00a24a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:58:08 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-5a5f8711-c7f5-4751-9197-6024dc396cb6 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:56:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1622790842',display_name='tempest-ServersNegativeTestJSON-server-1622790842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1622790842',id=36,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:56:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8c750eec93d4bfb9f7d61b6445d9e42',ramdisk_id='',reservation_id='r-mfoyxp13',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-521653173',owner_user_name='tempest-ServersNegativeTestJSON-521653173-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:56:25Z,user_data=None,user_id='9462e4a57abb48f88f022c3486304df1',uuid=a94db53f-e791-4e0f-8c4f-3b292f00a24a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01209cad-6739-4725-9f7e-5836a9ad691e", "address": "fa:16:3e:b7:54:dd", "network": {"id": "8691a7c7-5761-40a7-962e-880f95352b9a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-919731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8c750eec93d4bfb9f7d61b6445d9e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01209cad-67", "ovs_interfaceid": "01209cad-6739-4725-9f7e-5836a9ad691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:58:08 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-5a5f8711-c7f5-4751-9197-6024dc396cb6 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Converting VIF {"id": "01209cad-6739-4725-9f7e-5836a9ad691e", "address": "fa:16:3e:b7:54:dd", "network": {"id": "8691a7c7-5761-40a7-962e-880f95352b9a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-919731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8c750eec93d4bfb9f7d61b6445d9e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01209cad-67", "ovs_interfaceid": "01209cad-6739-4725-9f7e-5836a9ad691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:58:08 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-5a5f8711-c7f5-4751-9197-6024dc396cb6 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:54:dd,bridge_name='br-int',has_traffic_filtering=True,id=01209cad-6739-4725-9f7e-5836a9ad691e,network=Network(8691a7c7-5761-40a7-962e-880f95352b9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01209cad-67') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:58:08 user nova-compute[75247]: DEBUG os_vif [None req-5a5f8711-c7f5-4751-9197-6024dc396cb6 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:54:dd,bridge_name='br-int',has_traffic_filtering=True,id=01209cad-6739-4725-9f7e-5836a9ad691e,network=Network(8691a7c7-5761-40a7-962e-880f95352b9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01209cad-67') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:58:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01209cad-67, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:58:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10edb670-eb27-40ad-9281-3511ef65e64e) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:58:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:58:08 user nova-compute[75247]: INFO os_vif [None req-5a5f8711-c7f5-4751-9197-6024dc396cb6 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:54:dd,bridge_name='br-int',has_traffic_filtering=True,id=01209cad-6739-4725-9f7e-5836a9ad691e,network=Network(8691a7c7-5761-40a7-962e-880f95352b9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01209cad-67')
Dec 06 12:58:08 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-5a5f8711-c7f5-4751-9197-6024dc396cb6 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Deleting instance files /opt/stack/data/nova/instances/a94db53f-e791-4e0f-8c4f-3b292f00a24a_del
Dec 06 12:58:08 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-5a5f8711-c7f5-4751-9197-6024dc396cb6 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Deletion of /opt/stack/data/nova/instances/a94db53f-e791-4e0f-8c4f-3b292f00a24a_del complete
Dec 06 12:58:08 user nova-compute[75247]: INFO nova.compute.manager [None req-5a5f8711-c7f5-4751-9197-6024dc396cb6 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Took 0.68 seconds to destroy the instance on the hypervisor.
Dec 06 12:58:08 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-5a5f8711-c7f5-4751-9197-6024dc396cb6 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:58:08 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:58:08 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:58:08 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:58:08 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Took 0.53 seconds to deallocate network for instance.
Dec 06 12:58:08 user nova-compute[75247]: DEBUG nova.compute.manager [req-22316dc1-6fdd-442d-900c-836efa4ed875 req-2903dbf3-d60d-4b7b-b3f2-45c39a0a266c service nova] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Received event network-vif-deleted-01209cad-6739-4725-9f7e-5836a9ad691e {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:58:08 user nova-compute[75247]: INFO nova.compute.manager [req-22316dc1-6fdd-442d-900c-836efa4ed875 req-2903dbf3-d60d-4b7b-b3f2-45c39a0a266c service nova] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Neutron deleted interface 01209cad-6739-4725-9f7e-5836a9ad691e; detaching it from the instance and deleting it from the info cache
Dec 06 12:58:08 user nova-compute[75247]: DEBUG nova.network.neutron [req-22316dc1-6fdd-442d-900c-836efa4ed875 req-2903dbf3-d60d-4b7b-b3f2-45c39a0a266c service nova] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:58:08 user nova-compute[75247]: DEBUG nova.compute.manager [req-22316dc1-6fdd-442d-900c-836efa4ed875 req-2903dbf3-d60d-4b7b-b3f2-45c39a0a266c service nova] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Detach interface failed, port_id=01209cad-6739-4725-9f7e-5836a9ad691e, reason: Instance a94db53f-e791-4e0f-8c4f-3b292f00a24a could not be found. {{(pid=75247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 12:58:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5a5f8711-c7f5-4751-9197-6024dc396cb6 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5a5f8711-c7f5-4751-9197-6024dc396cb6 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:09 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-5a5f8711-c7f5-4751-9197-6024dc396cb6 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:58:09 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-5a5f8711-c7f5-4751-9197-6024dc396cb6 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:58:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5a5f8711-c7f5-4751-9197-6024dc396cb6 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.645s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:09 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-5a5f8711-c7f5-4751-9197-6024dc396cb6 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Deleted allocations for instance a94db53f-e791-4e0f-8c4f-3b292f00a24a
Dec 06 12:58:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5a5f8711-c7f5-4751-9197-6024dc396cb6 tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "a94db53f-e791-4e0f-8c4f-3b292f00a24a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.138s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:09 user nova-compute[75247]: DEBUG nova.compute.manager [req-0e188753-3cb9-4e21-8e3f-2edd259395b7 req-2bd2e097-290c-4539-b91f-3d02d3ffeb3c service nova] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Received event network-vif-plugged-01209cad-6739-4725-9f7e-5836a9ad691e {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:58:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0e188753-3cb9-4e21-8e3f-2edd259395b7 req-2bd2e097-290c-4539-b91f-3d02d3ffeb3c service nova] Acquiring lock "a94db53f-e791-4e0f-8c4f-3b292f00a24a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0e188753-3cb9-4e21-8e3f-2edd259395b7 req-2bd2e097-290c-4539-b91f-3d02d3ffeb3c service nova] Lock "a94db53f-e791-4e0f-8c4f-3b292f00a24a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0e188753-3cb9-4e21-8e3f-2edd259395b7 req-2bd2e097-290c-4539-b91f-3d02d3ffeb3c service nova] Lock "a94db53f-e791-4e0f-8c4f-3b292f00a24a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:09 user nova-compute[75247]: DEBUG nova.compute.manager [req-0e188753-3cb9-4e21-8e3f-2edd259395b7 req-2bd2e097-290c-4539-b91f-3d02d3ffeb3c service nova] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] No waiting events found dispatching network-vif-plugged-01209cad-6739-4725-9f7e-5836a9ad691e {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:58:09 user nova-compute[75247]: WARNING nova.compute.manager [req-0e188753-3cb9-4e21-8e3f-2edd259395b7 req-2bd2e097-290c-4539-b91f-3d02d3ffeb3c service nova] [instance: a94db53f-e791-4e0f-8c4f-3b292f00a24a] Received unexpected event network-vif-plugged-01209cad-6739-4725-9f7e-5836a9ad691e for instance with vm_state deleted and task_state None.
Dec 06 12:58:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-62381e18-6998-45c2-813b-d73a5090a3de tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-62381e18-6998-45c2-813b-d73a5090a3de tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-62381e18-6998-45c2-813b-d73a5090a3de tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-62381e18-6998-45c2-813b-d73a5090a3de tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-62381e18-6998-45c2-813b-d73a5090a3de tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:11 user nova-compute[75247]: INFO nova.compute.manager [None req-62381e18-6998-45c2-813b-d73a5090a3de tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Terminating instance
Dec 06 12:58:11 user nova-compute[75247]: DEBUG nova.compute.manager [None req-62381e18-6998-45c2-813b-d73a5090a3de tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:58:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:11 user nova-compute[75247]: DEBUG nova.compute.manager [req-44e70cf2-41ad-4005-a228-ed43e473f03c req-8c0c6492-c6c0-4746-ba60-964be982f042 service nova] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Received event network-vif-unplugged-6ed7f42b-d2d5-4663-8943-e016c1acfe5c {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:58:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-44e70cf2-41ad-4005-a228-ed43e473f03c req-8c0c6492-c6c0-4746-ba60-964be982f042 service nova] Acquiring lock "08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-44e70cf2-41ad-4005-a228-ed43e473f03c req-8c0c6492-c6c0-4746-ba60-964be982f042 service nova] Lock "08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-44e70cf2-41ad-4005-a228-ed43e473f03c req-8c0c6492-c6c0-4746-ba60-964be982f042 service nova] Lock "08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:11 user nova-compute[75247]: DEBUG nova.compute.manager [req-44e70cf2-41ad-4005-a228-ed43e473f03c req-8c0c6492-c6c0-4746-ba60-964be982f042 service nova] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] No waiting events found dispatching network-vif-unplugged-6ed7f42b-d2d5-4663-8943-e016c1acfe5c {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:58:11 user nova-compute[75247]: DEBUG nova.compute.manager [req-44e70cf2-41ad-4005-a228-ed43e473f03c req-8c0c6492-c6c0-4746-ba60-964be982f042 service nova] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Received event network-vif-unplugged-6ed7f42b-d2d5-4663-8943-e016c1acfe5c for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:58:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:11 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Instance destroyed successfully.
Dec 06 12:58:11 user nova-compute[75247]: DEBUG nova.objects.instance [None req-62381e18-6998-45c2-813b-d73a5090a3de tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lazy-loading 'resources' on Instance uuid 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:58:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-62381e18-6998-45c2-813b-d73a5090a3de tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1325546850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1325546850',id=23,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:48:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='222da79e3583495d90d5442029996343',ramdisk_id='',reservation_id='r-9cv0o6lv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:50:45Z,user_data=None,user_id='d0efa55fc4754d96a33d07d52342d8f7',uuid=08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ed7f42b-d2d5-4663-8943-e016c1acfe5c", "address": "fa:16:3e:30:47:63", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed7f42b-d2", "ovs_interfaceid": "6ed7f42b-d2d5-4663-8943-e016c1acfe5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:58:11 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-62381e18-6998-45c2-813b-d73a5090a3de tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converting VIF {"id": "6ed7f42b-d2d5-4663-8943-e016c1acfe5c", "address": "fa:16:3e:30:47:63", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed7f42b-d2", "ovs_interfaceid": "6ed7f42b-d2d5-4663-8943-e016c1acfe5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:58:11 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-62381e18-6998-45c2-813b-d73a5090a3de tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:47:63,bridge_name='br-int',has_traffic_filtering=True,id=6ed7f42b-d2d5-4663-8943-e016c1acfe5c,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed7f42b-d2') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:58:11 user nova-compute[75247]: DEBUG os_vif [None req-62381e18-6998-45c2-813b-d73a5090a3de tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:47:63,bridge_name='br-int',has_traffic_filtering=True,id=6ed7f42b-d2d5-4663-8943-e016c1acfe5c,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed7f42b-d2') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:58:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ed7f42b-d2, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:58:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:58:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7cfbe178-d207-4ebd-8893-039dc345a51b) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:58:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:11 user nova-compute[75247]: INFO os_vif [None req-62381e18-6998-45c2-813b-d73a5090a3de tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:47:63,bridge_name='br-int',has_traffic_filtering=True,id=6ed7f42b-d2d5-4663-8943-e016c1acfe5c,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed7f42b-d2')
Dec 06 12:58:11 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-62381e18-6998-45c2-813b-d73a5090a3de tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Deleting instance files /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9_del
Dec 06 12:58:11 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-62381e18-6998-45c2-813b-d73a5090a3de tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Deletion of /opt/stack/data/nova/instances/08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9_del complete
Dec 06 12:58:11 user nova-compute[75247]: INFO nova.compute.manager [None req-62381e18-6998-45c2-813b-d73a5090a3de tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Took 0.69 seconds to destroy the instance on the hypervisor.
Dec 06 12:58:11 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-62381e18-6998-45c2-813b-d73a5090a3de tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:58:11 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:58:11 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:58:12 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:58:12 user nova-compute[75247]: DEBUG nova.compute.manager [req-5116df20-0b5e-4952-bbf9-390eacdd0395 req-08fca9fc-6690-49ea-ab6a-b3da90bdf30d service nova] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Received event network-vif-deleted-6ed7f42b-d2d5-4663-8943-e016c1acfe5c {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:58:12 user nova-compute[75247]: INFO nova.compute.manager [req-5116df20-0b5e-4952-bbf9-390eacdd0395 req-08fca9fc-6690-49ea-ab6a-b3da90bdf30d service nova] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Neutron deleted interface 6ed7f42b-d2d5-4663-8943-e016c1acfe5c; detaching it from the instance and deleting it from the info cache
Dec 06 12:58:12 user nova-compute[75247]: DEBUG nova.network.neutron [req-5116df20-0b5e-4952-bbf9-390eacdd0395 req-08fca9fc-6690-49ea-ab6a-b3da90bdf30d service nova] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:58:12 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Took 0.51 seconds to deallocate network for instance.
Dec 06 12:58:12 user nova-compute[75247]: DEBUG nova.compute.manager [req-5116df20-0b5e-4952-bbf9-390eacdd0395 req-08fca9fc-6690-49ea-ab6a-b3da90bdf30d service nova] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Detach interface failed, port_id=6ed7f42b-d2d5-4663-8943-e016c1acfe5c, reason: Instance 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9 could not be found. {{(pid=75247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 12:58:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-62381e18-6998-45c2-813b-d73a5090a3de tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-62381e18-6998-45c2-813b-d73a5090a3de tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:12 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-62381e18-6998-45c2-813b-d73a5090a3de tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:58:12 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-62381e18-6998-45c2-813b-d73a5090a3de tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:58:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-62381e18-6998-45c2-813b-d73a5090a3de tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:12 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-62381e18-6998-45c2-813b-d73a5090a3de tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Deleted allocations for instance 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9
Dec 06 12:58:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-62381e18-6998-45c2-813b-d73a5090a3de tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.785s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-a3145003-7430-499a-9085-2b73b7eb8070 req-76999b96-7d52-4c9a-af0a-95b2a8a48b18 service nova] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Received event network-vif-plugged-6ed7f42b-d2d5-4663-8943-e016c1acfe5c {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:58:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a3145003-7430-499a-9085-2b73b7eb8070 req-76999b96-7d52-4c9a-af0a-95b2a8a48b18 service nova] Acquiring lock "08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a3145003-7430-499a-9085-2b73b7eb8070 req-76999b96-7d52-4c9a-af0a-95b2a8a48b18 service nova] Lock "08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a3145003-7430-499a-9085-2b73b7eb8070 req-76999b96-7d52-4c9a-af0a-95b2a8a48b18 service nova] Lock "08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-a3145003-7430-499a-9085-2b73b7eb8070 req-76999b96-7d52-4c9a-af0a-95b2a8a48b18 service nova] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] No waiting events found dispatching network-vif-plugged-6ed7f42b-d2d5-4663-8943-e016c1acfe5c {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:58:13 user nova-compute[75247]: WARNING nova.compute.manager [req-a3145003-7430-499a-9085-2b73b7eb8070 req-76999b96-7d52-4c9a-af0a-95b2a8a48b18 service nova] [instance: 08ff10ed-e4ad-4c8d-a6b6-bbc8f084e0c9] Received unexpected event network-vif-plugged-6ed7f42b-d2d5-4663-8943-e016c1acfe5c for instance with vm_state deleted and task_state None.
Dec 06 12:58:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "f5b69324-579d-4833-9bb4-c43c511f820d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:17 user nova-compute[75247]: DEBUG nova.objects.instance [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lazy-loading 'flavor' on Instance uuid f5b69324-579d-4833-9bb4-c43c511f820d {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:58:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "f5b69324-579d-4833-9bb4-c43c511f820d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:17 user nova-compute[75247]: INFO nova.compute.manager [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Attaching volume ba7ca147-dc3c-47f6-81c2-24fb210b61f4 to /dev/vdb
Dec 06 12:58:17 user nova-compute[75247]: DEBUG os_brick.utils [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:58:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:17 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7776dec-8cf0-4807-bd8e-3946b1c2d777]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:17 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdda252-3751-4f91-a2be-8d72db9c63b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:17 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adabe0e-b35d-48fb-829f-2f34017cadf3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:17 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d31bba0-bf2d-469b-9fc6-3257ec6452ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:58:17 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:58:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:17 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:58:17 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:58:17 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[56aba180-3786-4b7f-8a93-2ebf00b6448e]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:17 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:58:17 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:58:17 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:58:17 user nova-compute[75247]: DEBUG os_brick.utils [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:58:17 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Updating existing volume attachment record: bccbf880-0cdb-4252-8d4a-1415ede60075 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:58:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:19 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:58:19 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:58:19 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:58:19 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:58:19 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:58:19 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:58:19 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 12:58:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-530cfb75-7aa8-4e57-b282-8f7a21401b34" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:58:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-530cfb75-7aa8-4e57-b282-8f7a21401b34" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:58:20 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 12:58:20 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Updating instance_info_cache with network_info: [{"id": "d924dd21-056e-413d-8fc1-493933e7e7e6", "address": "fa:16:3e:76:c7:97", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd924dd21-05", "ovs_interfaceid": "d924dd21-056e-413d-8fc1-493933e7e7e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:58:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-530cfb75-7aa8-4e57-b282-8f7a21401b34" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:58:20 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 12:58:20 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:58:20 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:58:20 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 12:58:20 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:58:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:20 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 12:58:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3800b293-6987-43c1-893f-e8919ee17243/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3800b293-6987-43c1-893f-e8919ee17243/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3800b293-6987-43c1-893f-e8919ee17243/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3800b293-6987-43c1-893f-e8919ee17243/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:58:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b8adc91-c4d4-4484-bd4e-cc3d356338c7/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b8adc91-c4d4-4484-bd4e-cc3d356338c7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b8adc91-c4d4-4484-bd4e-cc3d356338c7/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b8adc91-c4d4-4484-bd4e-cc3d356338c7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 12:58:25 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:58:25 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:58:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=7352MB free_disk=24.932209014892578GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 12:58:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 70c4664e-ae7a-47de-bba7-18300391d209 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:58:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 782289e2-91cd-4aee-9a08-eadfb2a5965b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:58:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 3e1b5197-dc38-48a5-b9f9-e053be499433 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:58:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance bc3ddb40-b05f-4170-b269-d44dec6ecdaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:58:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 530cfb75-7aa8-4e57-b282-8f7a21401b34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:58:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance f5b69324-579d-4833-9bb4-c43c511f820d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:58:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance b3720cc0-ff80-4ca2-8b13-d83dded593ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:58:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance c603d6dc-804e-4c0d-be1f-40e09de74e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:58:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 3800b293-6987-43c1-893f-e8919ee17243 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:58:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 3b8adc91-c4d4-4484-bd4e-cc3d356338c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:58:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 16dd787d-6abe-48f3-ac3c-fd55853b4e23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:58:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance e1f21135-43cd-4dbb-ae7a-b12dffdc5816 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:58:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 12:58:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 12:58:25 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:58:25 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:58:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 12:58:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:26 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TUdrpFeN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:58:27 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:58:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:58:27 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:58:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:58:27 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe95303-fdac-45f4-8016-4c2c35c748df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:58:27 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6160ae1c-2fde-4b24-9cbb-17be206b87e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4] added
Dec 06 12:58:27 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d158f3eb-dc11-4237-9403-ea47c807da27]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e557b399-53e4-402e-a6f8-454a3964c37b]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TUdrpFeN {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TUdrpFeN" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7713c6-9292-4998-b577-bbdd8025cc42]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TUdrpFeN'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eada60fe-e582-4a45-a913-a32fd08a0de4]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[588787cf-bed2-4036-a5b4-7be7c88cbcb7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:58:27 user nova-compute[75247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:58:27 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:58:27 user nova-compute[75247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:58:27 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8192aa7-d8a4-4cb9-8cdc-a2276f8bf3a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4, portal: 172.16.0.220,3260]
Dec 06 12:58:27 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4, portal: 172.16.0.220,3260] successful.
Dec 06 12:58:27 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c837159-59a2-4b1a-b4e8-77c7424f7043]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fd4733-8305-4754-b390-e0c2afa7b4c5]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:58:27 user nova-compute[75247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:58:27 user nova-compute[75247]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 (non-flash)
Dec 06 12:58:27 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:58:27 user nova-compute[75247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:58:27 user nova-compute[75247]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 (non-flash)
Dec 06 12:58:27 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[37987683-6da2-4dee-8f49-6e572ac7fa71]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:27 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:58:28 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:58:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TUdrpFeN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:58:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:58:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23731633863636565', 'path': '/dev/sdb'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:58:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731633863636565', 'path': '/dev/sdb'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:58:28 user nova-compute[75247]: DEBUG nova.objects.instance [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lazy-loading 'flavor' on Instance uuid f5b69324-579d-4833-9bb4-c43c511f820d {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:58:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 12:58:28 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:58:28 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:58:28 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:58:28 user nova-compute[75247]:   <serial>ba7ca147-dc3c-47f6-81c2-24fb210b61f4</serial>
Dec 06 12:58:28 user nova-compute[75247]: </disk>
Dec 06 12:58:28 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 12:58:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:58:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:58:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] No VIF found with MAC fa:16:3e:88:16:dd, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:58:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-aef53c46-3ffe-4fe4-bdaf-028e32fb9192 tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.708s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "f5b69324-579d-4833-9bb4-c43c511f820d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:31 user nova-compute[75247]: INFO nova.compute.manager [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Detaching volume ba7ca147-dc3c-47f6-81c2-24fb210b61f4
Dec 06 12:58:32 user nova-compute[75247]: INFO nova.virt.block_device [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Attempting to driver detach volume ba7ca147-dc3c-47f6-81c2-24fb210b61f4 from mountpoint /dev/vdb
Dec 06 12:58:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Attempting to detach device vdb from instance f5b69324-579d-4833-9bb4-c43c511f820d from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 12:58:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:58:32 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:58:32 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:58:32 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:58:32 user nova-compute[75247]:   <serial>ba7ca147-dc3c-47f6-81c2-24fb210b61f4</serial>
Dec 06 12:58:32 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:58:32 user nova-compute[75247]: </disk>
Dec 06 12:58:32 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:58:32 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Successfully detached device vdb from instance f5b69324-579d-4833-9bb4-c43c511f820d from the persistent domain config.
Dec 06 12:58:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f5b69324-579d-4833-9bb4-c43c511f820d from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 12:58:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:58:32 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:58:32 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:58:32 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:58:32 user nova-compute[75247]:   <serial>ba7ca147-dc3c-47f6-81c2-24fb210b61f4</serial>
Dec 06 12:58:32 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:58:32 user nova-compute[75247]: </disk>
Dec 06 12:58:32 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:58:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f5b69324-579d-4833-9bb4-c43c511f820d {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 12:58:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:36 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:58:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:45 user nova-compute[75247]: INFO nova.compute.manager [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Terminating instance
Dec 06 12:58:45 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:58:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:45 user nova-compute[75247]: DEBUG nova.compute.manager [req-24e2be6c-3200-4dc7-a599-f270d6be787b req-9b8f2a7a-6bec-44fb-b709-72a7e041cac1 service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Received event network-vif-unplugged-41d8bb63-57dd-4479-9a1e-89e223d16677 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:58:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-24e2be6c-3200-4dc7-a599-f270d6be787b req-9b8f2a7a-6bec-44fb-b709-72a7e041cac1 service nova] Acquiring lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-24e2be6c-3200-4dc7-a599-f270d6be787b req-9b8f2a7a-6bec-44fb-b709-72a7e041cac1 service nova] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-24e2be6c-3200-4dc7-a599-f270d6be787b req-9b8f2a7a-6bec-44fb-b709-72a7e041cac1 service nova] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:45 user nova-compute[75247]: DEBUG nova.compute.manager [req-24e2be6c-3200-4dc7-a599-f270d6be787b req-9b8f2a7a-6bec-44fb-b709-72a7e041cac1 service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] No waiting events found dispatching network-vif-unplugged-41d8bb63-57dd-4479-9a1e-89e223d16677 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:58:45 user nova-compute[75247]: DEBUG nova.compute.manager [req-24e2be6c-3200-4dc7-a599-f270d6be787b req-9b8f2a7a-6bec-44fb-b709-72a7e041cac1 service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Received event network-vif-unplugged-41d8bb63-57dd-4479-9a1e-89e223d16677 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:58:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:46 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Instance destroyed successfully.
Dec 06 12:58:46 user nova-compute[75247]: DEBUG nova.objects.instance [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lazy-loading 'resources' on Instance uuid b3720cc0-ff80-4ca2-8b13-d83dded593ad {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:52:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1873472062',display_name='tempest-ServerActionsTestOtherA-server-1873472062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1873472062',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1PSIn5waVLUBUVXmci26Bjo3OHYSVHL8/oxs3uvNoObvAgLe5HgiP5u61wX8nEvgm8XgeBjcCfcP/HNC/vep9hMtkBYH/Pz/i1rF8IkHYEtoKU1LHCX3Qi/2pvpu4Reg==',key_name='tempest-keypair-1071092699',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:54:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0ccf15765714ca2a8c4700d2d6e3ed2',ramdisk_id='',reservation_id='r-80mdy70u',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2075667053',owner_user_name='tempest-ServerActionsTestOtherA-2075667053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:55:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13843d8f074da189dbd3e93750b811',uuid=b3720cc0-ff80-4ca2-8b13-d83dded593ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41d8bb63-57dd-4479-9a1e-89e223d16677", "address": "fa:16:3e:9a:8b:8a", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d8bb63-57", "ovs_interfaceid": "41d8bb63-57dd-4479-9a1e-89e223d16677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converting VIF {"id": "41d8bb63-57dd-4479-9a1e-89e223d16677", "address": "fa:16:3e:9a:8b:8a", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d8bb63-57", "ovs_interfaceid": "41d8bb63-57dd-4479-9a1e-89e223d16677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:8b:8a,bridge_name='br-int',has_traffic_filtering=True,id=41d8bb63-57dd-4479-9a1e-89e223d16677,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d8bb63-57') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG os_vif [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:8b:8a,bridge_name='br-int',has_traffic_filtering=True,id=41d8bb63-57dd-4479-9a1e-89e223d16677,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d8bb63-57') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41d8bb63-57, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a2b0d02-32de-477b-97e9-082a6785da99) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:46 user nova-compute[75247]: INFO os_vif [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:8b:8a,bridge_name='br-int',has_traffic_filtering=True,id=41d8bb63-57dd-4479-9a1e-89e223d16677,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d8bb63-57')
Dec 06 12:58:46 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmYCPVNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:58:46 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:58:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a54b953-1bf7-473e-9577-a6470506e8ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:58:46 user nova-compute[75247]: No targets found.
Dec 06 12:58:46 user nova-compute[75247]: iSNS:
Dec 06 12:58:46 user nova-compute[75247]: No targets found.
Dec 06 12:58:46 user nova-compute[75247]: STATIC:
Dec 06 12:58:46 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:58:46 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:58:46 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:58:46 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4
Dec 06 12:58:46 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:58:46 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:58:46 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31
Dec 06 12:58:46 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:58:46 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:58:46 user nova-compute[75247]: FIRMWARE:
Dec 06 12:58:46 user nova-compute[75247]: No targets found.
Dec 06 12:58:46 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:58:46 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:58:46 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a478967-14c3-465e-853d-227327050111]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edf383b-eb60-4c29-8719-d563149c1acf]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:58:46 user nova-compute[75247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:58:46 user nova-compute[75247]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 (non-flash)
Dec 06 12:58:46 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:58:46 user nova-compute[75247]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 (non-flash)
Dec 06 12:58:46 user nova-compute[75247]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 (non-flash)
Dec 06 12:58:46 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c624550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31'): ({'sdc'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Removing single pathed devices sdc {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fceae3-58ee-48a3-9916-db887fd64657]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6529b235-b7e6-4769-b5fb-89244f51395c]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Flushing IO for device /dev/sdc {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22e99d1-8a1d-4fc8-ac6e-ae93bc88a7a7]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0e4282-cb70-4263-bd21-610d8055c636]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] SCSI volumes sdc have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_22fe4f3e', '/dev/disk/by-id/scsi-26530663838663662', '/dev/disk/by-id/scsi-1SCST_BIO22fe4f3e-e0f88f6b293c6d60') {{(pid=86354) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b492bc7f-aa75-4a83-9185-07721864d0aa]: (4, None) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe207115-f222-4faa-8e21-af68814272c6]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f752aa3-ce32-4008-a2da-159efd67e342]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31, portal: 172.16.0.220,3260]
Dec 06 12:58:46 user nova-compute[75247]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31, portal: 172.16.0.220,3260] successful.
Dec 06 12:58:46 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce8f69d-d096-4c5d-ae72-af142a835d31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e0dc1a-f881-4472-a077-329f57d48ead]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] <== disconnect_volume: return (346ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:58:46 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Deleting instance files /opt/stack/data/nova/instances/b3720cc0-ff80-4ca2-8b13-d83dded593ad_del
Dec 06 12:58:46 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Deletion of /opt/stack/data/nova/instances/b3720cc0-ff80-4ca2-8b13-d83dded593ad_del complete
Dec 06 12:58:46 user nova-compute[75247]: INFO nova.compute.manager [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Took 1.29 seconds to destroy the instance on the hypervisor.
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d28d0a5f-22f8-4ff0-996f-6e8a64dbdfcb tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Acquiring lock "3800b293-6987-43c1-893f-e8919ee17243" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d28d0a5f-22f8-4ff0-996f-6e8a64dbdfcb tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "3800b293-6987-43c1-893f-e8919ee17243" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d28d0a5f-22f8-4ff0-996f-6e8a64dbdfcb tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Acquiring lock "3800b293-6987-43c1-893f-e8919ee17243-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d28d0a5f-22f8-4ff0-996f-6e8a64dbdfcb tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "3800b293-6987-43c1-893f-e8919ee17243-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d28d0a5f-22f8-4ff0-996f-6e8a64dbdfcb tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "3800b293-6987-43c1-893f-e8919ee17243-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:46 user nova-compute[75247]: INFO nova.compute.manager [None req-d28d0a5f-22f8-4ff0-996f-6e8a64dbdfcb tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Terminating instance
Dec 06 12:58:46 user nova-compute[75247]: DEBUG nova.compute.manager [None req-d28d0a5f-22f8-4ff0-996f-6e8a64dbdfcb tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:47 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:58:47 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Took 0.73 seconds to deallocate network for instance.
Dec 06 12:58:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-3d6d2394-46ed-4243-ab34-0ff2f27d63a8 req-0f024b5a-7756-4381-ab2e-943d8c2bea06 service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Received event network-vif-deleted-41d8bb63-57dd-4479-9a1e-89e223d16677 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:58:47 user nova-compute[75247]: INFO nova.compute.manager [req-3d6d2394-46ed-4243-ab34-0ff2f27d63a8 req-0f024b5a-7756-4381-ab2e-943d8c2bea06 service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Neutron deleted interface 41d8bb63-57dd-4479-9a1e-89e223d16677; detaching it from the instance and deleting it from the info cache
Dec 06 12:58:47 user nova-compute[75247]: DEBUG nova.network.neutron [req-3d6d2394-46ed-4243-ab34-0ff2f27d63a8 req-0f024b5a-7756-4381-ab2e-943d8c2bea06 service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:58:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-3d6d2394-46ed-4243-ab34-0ff2f27d63a8 req-0f024b5a-7756-4381-ab2e-943d8c2bea06 service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Detach interface failed, port_id=41d8bb63-57dd-4479-9a1e-89e223d16677, reason: Instance b3720cc0-ff80-4ca2-8b13-d83dded593ad could not be found. {{(pid=75247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 12:58:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-85287f22-e989-48c1-9f56-1aaca9b63140 req-1a031413-abc6-4c71-931b-0c8145bcaeb0 service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Received event network-vif-plugged-41d8bb63-57dd-4479-9a1e-89e223d16677 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:58:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-85287f22-e989-48c1-9f56-1aaca9b63140 req-1a031413-abc6-4c71-931b-0c8145bcaeb0 service nova] Acquiring lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-85287f22-e989-48c1-9f56-1aaca9b63140 req-1a031413-abc6-4c71-931b-0c8145bcaeb0 service nova] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-85287f22-e989-48c1-9f56-1aaca9b63140 req-1a031413-abc6-4c71-931b-0c8145bcaeb0 service nova] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-85287f22-e989-48c1-9f56-1aaca9b63140 req-1a031413-abc6-4c71-931b-0c8145bcaeb0 service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] No waiting events found dispatching network-vif-plugged-41d8bb63-57dd-4479-9a1e-89e223d16677 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:58:47 user nova-compute[75247]: WARNING nova.compute.manager [req-85287f22-e989-48c1-9f56-1aaca9b63140 req-1a031413-abc6-4c71-931b-0c8145bcaeb0 service nova] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Received unexpected event network-vif-plugged-41d8bb63-57dd-4479-9a1e-89e223d16677 for instance with vm_state active and task_state deleting.
Dec 06 12:58:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-85287f22-e989-48c1-9f56-1aaca9b63140 req-1a031413-abc6-4c71-931b-0c8145bcaeb0 service nova] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Received event network-vif-unplugged-5a7b1d76-a210-436f-827b-8ce4a2f04d35 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:58:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-85287f22-e989-48c1-9f56-1aaca9b63140 req-1a031413-abc6-4c71-931b-0c8145bcaeb0 service nova] Acquiring lock "3800b293-6987-43c1-893f-e8919ee17243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-85287f22-e989-48c1-9f56-1aaca9b63140 req-1a031413-abc6-4c71-931b-0c8145bcaeb0 service nova] Lock "3800b293-6987-43c1-893f-e8919ee17243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-85287f22-e989-48c1-9f56-1aaca9b63140 req-1a031413-abc6-4c71-931b-0c8145bcaeb0 service nova] Lock "3800b293-6987-43c1-893f-e8919ee17243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-85287f22-e989-48c1-9f56-1aaca9b63140 req-1a031413-abc6-4c71-931b-0c8145bcaeb0 service nova] [instance: 3800b293-6987-43c1-893f-e8919ee17243] No waiting events found dispatching network-vif-unplugged-5a7b1d76-a210-436f-827b-8ce4a2f04d35 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:58:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-85287f22-e989-48c1-9f56-1aaca9b63140 req-1a031413-abc6-4c71-931b-0c8145bcaeb0 service nova] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Received event network-vif-unplugged-5a7b1d76-a210-436f-827b-8ce4a2f04d35 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:58:47 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Instance destroyed successfully.
Dec 06 12:58:47 user nova-compute[75247]: DEBUG nova.objects.instance [None req-d28d0a5f-22f8-4ff0-996f-6e8a64dbdfcb tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lazy-loading 'resources' on Instance uuid 3800b293-6987-43c1-893f-e8919ee17243 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:58:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-d28d0a5f-22f8-4ff0-996f-6e8a64dbdfcb tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:56:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-704332245',display_name='tempest-VolumesActionsTest-instance-704332245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-704332245',id=37,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:57:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea74e3cf3f254f0b8b6eec14ecc8c80e',ramdisk_id='',reservation_id='r-vexlko85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-72234739',owner_user_name='tempest-VolumesActionsTest-72234739-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:57:04Z,user_data=None,user_id='7d662e0050774501a04828dcd6d3b63f',uuid=3800b293-6987-43c1-893f-e8919ee17243,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a7b1d76-a210-436f-827b-8ce4a2f04d35", "address": "fa:16:3e:a8:28:e4", "network": {"id": "c46a4b1b-086d-48c6-83cb-a4b88077781f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-70878896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea74e3cf3f254f0b8b6eec14ecc8c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a7b1d76-a2", "ovs_interfaceid": "5a7b1d76-a210-436f-827b-8ce4a2f04d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:58:47 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-d28d0a5f-22f8-4ff0-996f-6e8a64dbdfcb tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Converting VIF {"id": "5a7b1d76-a210-436f-827b-8ce4a2f04d35", "address": "fa:16:3e:a8:28:e4", "network": {"id": "c46a4b1b-086d-48c6-83cb-a4b88077781f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-70878896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea74e3cf3f254f0b8b6eec14ecc8c80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a7b1d76-a2", "ovs_interfaceid": "5a7b1d76-a210-436f-827b-8ce4a2f04d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:58:47 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-d28d0a5f-22f8-4ff0-996f-6e8a64dbdfcb tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:28:e4,bridge_name='br-int',has_traffic_filtering=True,id=5a7b1d76-a210-436f-827b-8ce4a2f04d35,network=Network(c46a4b1b-086d-48c6-83cb-a4b88077781f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a7b1d76-a2') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:58:47 user nova-compute[75247]: DEBUG os_vif [None req-d28d0a5f-22f8-4ff0-996f-6e8a64dbdfcb tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:28:e4,bridge_name='br-int',has_traffic_filtering=True,id=5a7b1d76-a210-436f-827b-8ce4a2f04d35,network=Network(c46a4b1b-086d-48c6-83cb-a4b88077781f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a7b1d76-a2') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:58:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a7b1d76-a2, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:58:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8f187f6-9df4-4583-ab4d-90b7f7018939) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:58:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:47 user nova-compute[75247]: INFO os_vif [None req-d28d0a5f-22f8-4ff0-996f-6e8a64dbdfcb tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:28:e4,bridge_name='br-int',has_traffic_filtering=True,id=5a7b1d76-a210-436f-827b-8ce4a2f04d35,network=Network(c46a4b1b-086d-48c6-83cb-a4b88077781f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a7b1d76-a2')
Dec 06 12:58:47 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-d28d0a5f-22f8-4ff0-996f-6e8a64dbdfcb tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Deleting instance files /opt/stack/data/nova/instances/3800b293-6987-43c1-893f-e8919ee17243_del
Dec 06 12:58:47 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-d28d0a5f-22f8-4ff0-996f-6e8a64dbdfcb tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Deletion of /opt/stack/data/nova/instances/3800b293-6987-43c1-893f-e8919ee17243_del complete
Dec 06 12:58:47 user nova-compute[75247]: INFO nova.compute.manager [None req-d28d0a5f-22f8-4ff0-996f-6e8a64dbdfcb tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Took 0.89 seconds to destroy the instance on the hypervisor.
Dec 06 12:58:47 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-d28d0a5f-22f8-4ff0-996f-6e8a64dbdfcb tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:58:47 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:58:47 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 3800b293-6987-43c1-893f-e8919ee17243] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:58:48 user nova-compute[75247]: INFO nova.compute.manager [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Took 0.83 seconds to detach 1 volumes for instance.
Dec 06 12:58:48 user nova-compute[75247]: DEBUG nova.compute.manager [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: b3720cc0-ff80-4ca2-8b13-d83dded593ad] Deleting volume: 7ce8f69d-d096-4c5d-ae72-af142a835d31 {{(pid=75247) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 06 12:58:48 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:58:48 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Took 0.45 seconds to deallocate network for instance.
Dec 06 12:58:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d28d0a5f-22f8-4ff0-996f-6e8a64dbdfcb tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d28d0a5f-22f8-4ff0-996f-6e8a64dbdfcb tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:48 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-d28d0a5f-22f8-4ff0-996f-6e8a64dbdfcb tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:58:48 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-d28d0a5f-22f8-4ff0-996f-6e8a64dbdfcb tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:58:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d28d0a5f-22f8-4ff0-996f-6e8a64dbdfcb tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.376s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:48 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-d28d0a5f-22f8-4ff0-996f-6e8a64dbdfcb tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Deleted allocations for instance 3800b293-6987-43c1-893f-e8919ee17243
Dec 06 12:58:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d28d0a5f-22f8-4ff0-996f-6e8a64dbdfcb tempest-VolumesActionsTest-72234739 tempest-VolumesActionsTest-72234739-project-member] Lock "3800b293-6987-43c1-893f-e8919ee17243" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.960s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:48 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:58:48 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:58:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:48 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Deleted allocations for instance b3720cc0-ff80-4ca2-8b13-d83dded593ad
Dec 06 12:58:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f72add4e-e468-4e6b-9f22-e77cb977890b tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "b3720cc0-ff80-4ca2-8b13-d83dded593ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.847s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-36b6a401-a4c9-4dcc-a17a-ccade29333cd req-cc69b344-85e1-40a2-895b-1c7c024456a8 service nova] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Received event network-vif-deleted-5a7b1d76-a210-436f-827b-8ce4a2f04d35 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:58:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-e6dd9247-a773-4be9-abb4-b03990db67a5 req-b6a7b384-b6dd-4119-aa7f-85064284d4be service nova] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Received event network-vif-plugged-5a7b1d76-a210-436f-827b-8ce4a2f04d35 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:58:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e6dd9247-a773-4be9-abb4-b03990db67a5 req-b6a7b384-b6dd-4119-aa7f-85064284d4be service nova] Acquiring lock "3800b293-6987-43c1-893f-e8919ee17243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e6dd9247-a773-4be9-abb4-b03990db67a5 req-b6a7b384-b6dd-4119-aa7f-85064284d4be service nova] Lock "3800b293-6987-43c1-893f-e8919ee17243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e6dd9247-a773-4be9-abb4-b03990db67a5 req-b6a7b384-b6dd-4119-aa7f-85064284d4be service nova] Lock "3800b293-6987-43c1-893f-e8919ee17243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-e6dd9247-a773-4be9-abb4-b03990db67a5 req-b6a7b384-b6dd-4119-aa7f-85064284d4be service nova] [instance: 3800b293-6987-43c1-893f-e8919ee17243] No waiting events found dispatching network-vif-plugged-5a7b1d76-a210-436f-827b-8ce4a2f04d35 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:58:49 user nova-compute[75247]: WARNING nova.compute.manager [req-e6dd9247-a773-4be9-abb4-b03990db67a5 req-b6a7b384-b6dd-4119-aa7f-85064284d4be service nova] [instance: 3800b293-6987-43c1-893f-e8919ee17243] Received unexpected event network-vif-plugged-5a7b1d76-a210-436f-827b-8ce4a2f04d35 for instance with vm_state deleted and task_state None.
Dec 06 12:58:52 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f5b69324-579d-4833-9bb4-c43c511f820d is timed out.
Dec 06 12:58:52 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Successfully detached device vdb from instance f5b69324-579d-4833-9bb4-c43c511f820d from the live domain config.
Dec 06 12:58:52 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TUdrpFeN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:58:52 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:58:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[688c7dee-b36a-4754-945c-e75dc2fcf9ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:58:52 user nova-compute[75247]: No targets found.
Dec 06 12:58:52 user nova-compute[75247]: iSNS:
Dec 06 12:58:52 user nova-compute[75247]: No targets found.
Dec 06 12:58:52 user nova-compute[75247]: STATIC:
Dec 06 12:58:52 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:58:52 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:58:52 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:58:52 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4
Dec 06 12:58:52 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:58:52 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:58:52 user nova-compute[75247]: FIRMWARE:
Dec 06 12:58:52 user nova-compute[75247]: No targets found.
Dec 06 12:58:52 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:58:52 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:58:52 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[42959bc2-afe7-4048-a11c-1d5df3dc7571]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b6eadb-48e1-4b7a-b98f-b4b90bfb7491]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:58:52 user nova-compute[75247]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 (non-flash)
Dec 06 12:58:52 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:58:52 user nova-compute[75247]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 (non-flash)
Dec 06 12:58:52 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd74c029750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4'): ({'sdb'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Removing single pathed devices sdb {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e9076b-6d1a-42ef-bf63-bc43ba25678d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.176s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddba2356-c0ea-4070-85fd-ed14133e444d]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Flushing IO for device /dev/sdb {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8f30c3-6608-46ab-825c-e34c306bd16d]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b0312f-2ad6-4bce-be84-9f1cc2664dfb]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff654b09-fbde-4f58-bc13-8d8b3552d8e0]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f49fd6-6132-47c7-a417-000671a84b07]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4, portal: 172.16.0.220,3260]
Dec 06 12:58:52 user nova-compute[75247]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4, portal: 172.16.0.220,3260] successful.
Dec 06 12:58:52 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca147-dc3c-47f6-81c2-24fb210b61f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb915b71-82f5-4157-b1d9-b6cb083b121c]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.460s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] <== disconnect_volume: return (462ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:58:52 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:58:53 user nova-compute[75247]: DEBUG nova.compute.manager [req-d88f731d-0f1d-4ef7-88e4-3929229b102c req-7adc511e-71f1-46ad-a696-82178d0300fe service nova] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Received event network-changed-9674b746-bc7e-4ca4-bb83-28ac0adb21c4 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:58:53 user nova-compute[75247]: DEBUG nova.compute.manager [req-d88f731d-0f1d-4ef7-88e4-3929229b102c req-7adc511e-71f1-46ad-a696-82178d0300fe service nova] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Refreshing instance network info cache due to event network-changed-9674b746-bc7e-4ca4-bb83-28ac0adb21c4. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:58:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d88f731d-0f1d-4ef7-88e4-3929229b102c req-7adc511e-71f1-46ad-a696-82178d0300fe service nova] Acquiring lock "refresh_cache-3b8adc91-c4d4-4484-bd4e-cc3d356338c7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:58:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d88f731d-0f1d-4ef7-88e4-3929229b102c req-7adc511e-71f1-46ad-a696-82178d0300fe service nova] Acquired lock "refresh_cache-3b8adc91-c4d4-4484-bd4e-cc3d356338c7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:58:53 user nova-compute[75247]: DEBUG nova.network.neutron [req-d88f731d-0f1d-4ef7-88e4-3929229b102c req-7adc511e-71f1-46ad-a696-82178d0300fe service nova] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Refreshing network info cache for port 9674b746-bc7e-4ca4-bb83-28ac0adb21c4 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:58:53 user nova-compute[75247]: DEBUG nova.network.neutron [req-d88f731d-0f1d-4ef7-88e4-3929229b102c req-7adc511e-71f1-46ad-a696-82178d0300fe service nova] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Updated VIF entry in instance network info cache for port 9674b746-bc7e-4ca4-bb83-28ac0adb21c4. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:58:53 user nova-compute[75247]: DEBUG nova.network.neutron [req-d88f731d-0f1d-4ef7-88e4-3929229b102c req-7adc511e-71f1-46ad-a696-82178d0300fe service nova] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Updating instance_info_cache with network_info: [{"id": "9674b746-bc7e-4ca4-bb83-28ac0adb21c4", "address": "fa:16:3e:1a:02:be", "network": {"id": "3e1570a1-1d0a-4f71-b103-39a83a25c7a1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1788872216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc47c1410bde45648e4c65ea542b12d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9674b746-bc", "ovs_interfaceid": "9674b746-bc7e-4ca4-bb83-28ac0adb21c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:58:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d88f731d-0f1d-4ef7-88e4-3929229b102c req-7adc511e-71f1-46ad-a696-82178d0300fe service nova] Releasing lock "refresh_cache-3b8adc91-c4d4-4484-bd4e-cc3d356338c7" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:58:53 user nova-compute[75247]: DEBUG nova.objects.instance [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lazy-loading 'flavor' on Instance uuid f5b69324-579d-4833-9bb4-c43c511f820d {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:58:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f7e18e24-adfc-4ff7-b68b-8ddc15ee874c tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.021s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Acquiring lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:56 user nova-compute[75247]: DEBUG nova.objects.instance [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lazy-loading 'flavor' on Instance uuid 3b8adc91-c4d4-4484-bd4e-cc3d356338c7 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:58:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:58:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Acquiring lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:58:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:58:56 user nova-compute[75247]: INFO nova.compute.manager [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Attaching volume fc2dd237-61c9-448f-93c2-d35d3aab99fa to /dev/vdb
Dec 06 12:58:56 user nova-compute[75247]: DEBUG os_brick.utils [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:58:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:56 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[56846b6b-cce1-4627-9d3c-5d062f8a6f00]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:56 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d24f2a-81c6-48e5-add3-c1e18ec4f723]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:58:56 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[782a51ff-3131-4db9-bd55-c9ec225e9d4c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:56 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e73e53-daba-4bfd-b9ce-7873fca5eb48]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:58:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:58:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:58:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:58:56 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:58:56 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bdb2c0-317d-4d01-b358-8a56b6d8a60d]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:58:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:58:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:58:56 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:58:56 user nova-compute[75247]: DEBUG os_brick.utils [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:58:56 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Updating existing volume attachment record: 1f36ce04-53c0-4346-a413-531260690a4d {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:58:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:58:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "3e1b5197-dc38-48a5-b9f9-e053be499433" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:01 user nova-compute[75247]: INFO nova.compute.manager [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Terminating instance
Dec 06 12:59:01 user nova-compute[75247]: DEBUG nova.compute.manager [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:59:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:01 user nova-compute[75247]: DEBUG nova.compute.manager [req-3800f872-da46-40dd-9686-77f944e6882e req-1d9bc26f-1151-4582-943a-dfecda66f6da service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Received event network-vif-unplugged-f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:59:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3800f872-da46-40dd-9686-77f944e6882e req-1d9bc26f-1151-4582-943a-dfecda66f6da service nova] Acquiring lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3800f872-da46-40dd-9686-77f944e6882e req-1d9bc26f-1151-4582-943a-dfecda66f6da service nova] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3800f872-da46-40dd-9686-77f944e6882e req-1d9bc26f-1151-4582-943a-dfecda66f6da service nova] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:01 user nova-compute[75247]: DEBUG nova.compute.manager [req-3800f872-da46-40dd-9686-77f944e6882e req-1d9bc26f-1151-4582-943a-dfecda66f6da service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] No waiting events found dispatching network-vif-unplugged-f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:59:01 user nova-compute[75247]: DEBUG nova.compute.manager [req-3800f872-da46-40dd-9686-77f944e6882e req-1d9bc26f-1151-4582-943a-dfecda66f6da service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Received event network-vif-unplugged-f373c320-8b0c-440d-b825-d7ec2555b89d for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:59:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:02 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Instance destroyed successfully.
Dec 06 12:59:02 user nova-compute[75247]: DEBUG nova.objects.instance [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lazy-loading 'resources' on Instance uuid 3e1b5197-dc38-48a5-b9f9-e053be499433 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:43:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-36313688',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-36313688',id=14,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:45:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='222da79e3583495d90d5442029996343',ramdisk_id='',reservation_id='r-0exfvqwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:47:02Z,user_data=None,user_id='d0efa55fc4754d96a33d07d52342d8f7',uuid=3e1b5197-dc38-48a5-b9f9-e053be499433,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f373c320-8b0c-440d-b825-d7ec2555b89d", "address": "fa:16:3e:3f:8d:92", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf373c320-8b", "ovs_interfaceid": "f373c320-8b0c-440d-b825-d7ec2555b89d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converting VIF {"id": "f373c320-8b0c-440d-b825-d7ec2555b89d", "address": "fa:16:3e:3f:8d:92", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf373c320-8b", "ovs_interfaceid": "f373c320-8b0c-440d-b825-d7ec2555b89d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:8d:92,bridge_name='br-int',has_traffic_filtering=True,id=f373c320-8b0c-440d-b825-d7ec2555b89d,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf373c320-8b') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG os_vif [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:8d:92,bridge_name='br-int',has_traffic_filtering=True,id=f373c320-8b0c-440d-b825-d7ec2555b89d,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf373c320-8b') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf373c320-8b, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8aeab400-823b-47e1-834f-eab45f86964a) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:02 user nova-compute[75247]: INFO os_vif [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:8d:92,bridge_name='br-int',has_traffic_filtering=True,id=f373c320-8b0c-440d-b825-d7ec2555b89d,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf373c320-8b')
Dec 06 12:59:02 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQyuETeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:59:02 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:59:02 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a326dc-9670-49c8-88ad-a6d791de6232]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:59:02 user nova-compute[75247]: No targets found.
Dec 06 12:59:02 user nova-compute[75247]: iSNS:
Dec 06 12:59:02 user nova-compute[75247]: No targets found.
Dec 06 12:59:02 user nova-compute[75247]: STATIC:
Dec 06 12:59:02 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518
Dec 06 12:59:02 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:59:02 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:59:02 user nova-compute[75247]: FIRMWARE:
Dec 06 12:59:02 user nova-compute[75247]: No targets found.
Dec 06 12:59:02 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:59:02 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:59:02 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a3321d-0be9-48b7-a6e5-d6c00c46612d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8eb5a4-7203-49a3-b88e-ee4df169e6ef]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:59:02 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 (non-flash)
Dec 06 12:59:02 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd730191bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518'): ({'sdd'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Removing single pathed devices sdd {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44c67fb-7c7e-47ea-91e2-ce41f7280244]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[534e21c3-37e3-4e32-8271-d292f0c0930e]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Flushing IO for device /dev/sdd {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bdc47a-21ab-416d-984a-13a75ed96f6f]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb4c25b-2832-453c-b6df-16cd376136d1]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] SCSI volumes sdd have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[afda70c5-65eb-4a11-b120-b9fcb477ec9c]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[120194fd-2b79-4e92-8bfd-e61da933ed6e]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518, portal: 172.16.0.220,3260]
Dec 06 12:59:02 user nova-compute[75247]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518, portal: 172.16.0.220,3260] successful.
Dec 06 12:59:02 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15434b10-a21d-4ff5-a7d1-d097cc403518 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6502a7c2-70f7-46d0-bd4a-2ce04323bf15]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] <== disconnect_volume: return (273ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:59:02 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Deleting instance files /opt/stack/data/nova/instances/3e1b5197-dc38-48a5-b9f9-e053be499433_del
Dec 06 12:59:02 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Deletion of /opt/stack/data/nova/instances/3e1b5197-dc38-48a5-b9f9-e053be499433_del complete
Dec 06 12:59:02 user nova-compute[75247]: INFO nova.compute.manager [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Took 1.20 seconds to destroy the instance on the hypervisor.
Dec 06 12:59:02 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:59:02 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:59:03 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:59:03 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Took 0.39 seconds to deallocate network for instance.
Dec 06 12:59:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-12f6b6a6-35d7-4b07-84a5-af349f16fb9e req-bb6b95e8-b2d1-4e53-973a-01e29683ca3f service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Received event network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:59:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-12f6b6a6-35d7-4b07-84a5-af349f16fb9e req-bb6b95e8-b2d1-4e53-973a-01e29683ca3f service nova] Acquiring lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-12f6b6a6-35d7-4b07-84a5-af349f16fb9e req-bb6b95e8-b2d1-4e53-973a-01e29683ca3f service nova] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-12f6b6a6-35d7-4b07-84a5-af349f16fb9e req-bb6b95e8-b2d1-4e53-973a-01e29683ca3f service nova] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-12f6b6a6-35d7-4b07-84a5-af349f16fb9e req-bb6b95e8-b2d1-4e53-973a-01e29683ca3f service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] No waiting events found dispatching network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:59:03 user nova-compute[75247]: WARNING nova.compute.manager [req-12f6b6a6-35d7-4b07-84a5-af349f16fb9e req-bb6b95e8-b2d1-4e53-973a-01e29683ca3f service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Received unexpected event network-vif-plugged-f373c320-8b0c-440d-b825-d7ec2555b89d for instance with vm_state active and task_state deleting.
Dec 06 12:59:03 user nova-compute[75247]: DEBUG nova.compute.manager [req-12f6b6a6-35d7-4b07-84a5-af349f16fb9e req-bb6b95e8-b2d1-4e53-973a-01e29683ca3f service nova] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Received event network-vif-deleted-f373c320-8b0c-440d-b825-d7ec2555b89d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:59:03 user nova-compute[75247]: INFO nova.compute.manager [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 3e1b5197-dc38-48a5-b9f9-e053be499433] Took 0.81 seconds to detach 1 volumes for instance.
Dec 06 12:59:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:04 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:59:04 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:59:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:04 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Deleted allocations for instance 3e1b5197-dc38-48a5-b9f9-e053be499433
Dec 06 12:59:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a7754a8a-2024-4d97-973d-0fbe20441796 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "3e1b5197-dc38-48a5-b9f9-e053be499433" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.893s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCUQnsKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:59:06 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:59:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:59:06 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:59:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:59:06 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69a615b-84c2-40fb-98bc-033cc50e9dc2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:59:06 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0d82c8-dbd0-4ed0-8bda-bdb98d6e214b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa] added
Dec 06 12:59:06 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[19438150-6a61-441f-affa-058126070542]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7bf68d-f290-49a9-9d2c-92dd0a048338]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SCUQnsKy {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SCUQnsKy" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1f0b54-b9de-4860-bfe9-3e5081928f21]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SCUQnsKy'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fbd6d7-5c84-4dc8-a301-31d86a31ce0e]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cdd4ce-3571-47c3-b4e4-016fae19fba7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 12:59:06 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 12:59:06 user nova-compute[75247]:  {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:59:06 user nova-compute[75247]: WARNING os_brick.initiator.connectors.iscsi [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 12:59:06 user nova-compute[75247]: 
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b2d76e-ec84-4252-b0e8-d35577ffe873]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa, portal: 172.16.0.220,3260]
Dec 06 12:59:06 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa, portal: 172.16.0.220,3260] successful.
Dec 06 12:59:06 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[083e7777-9e75-4618-9d55-30ca312094bf]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[62741d4a-590e-44ad-ae6c-2c4b526e55c3]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa (non-flash)
Dec 06 12:59:06 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa (non-flash)
Dec 06 12:59:06 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[632d24a2-a877-4832-9db8-c5da107f5547]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:59:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCUQnsKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:59:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:59:07 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26535623132626330', 'path': '/dev/sdb'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:59:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535623132626330', 'path': '/dev/sdb'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:59:07 user nova-compute[75247]: DEBUG nova.objects.instance [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lazy-loading 'flavor' on Instance uuid 3b8adc91-c4d4-4484-bd4e-cc3d356338c7 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:59:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 12:59:07 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:59:07 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:59:07 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:59:07 user nova-compute[75247]:   <serial>fc2dd237-61c9-448f-93c2-d35d3aab99fa</serial>
Dec 06 12:59:07 user nova-compute[75247]: </disk>
Dec 06 12:59:07 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 12:59:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:59:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:59:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] No VIF found with MAC fa:16:3e:1a:02:be, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:59:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d9e2289d-1e7e-4863-9e8e-81737279b756 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.507s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Acquiring lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:10 user nova-compute[75247]: INFO nova.compute.manager [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Detaching volume fc2dd237-61c9-448f-93c2-d35d3aab99fa
Dec 06 12:59:10 user nova-compute[75247]: INFO nova.virt.block_device [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Attempting to driver detach volume fc2dd237-61c9-448f-93c2-d35d3aab99fa from mountpoint /dev/vdb
Dec 06 12:59:10 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Attempting to detach device vdb from instance 3b8adc91-c4d4-4484-bd4e-cc3d356338c7 from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 12:59:10 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:59:10 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:59:10 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:59:10 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:59:10 user nova-compute[75247]:   <serial>fc2dd237-61c9-448f-93c2-d35d3aab99fa</serial>
Dec 06 12:59:10 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:59:10 user nova-compute[75247]: </disk>
Dec 06 12:59:10 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:59:10 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Successfully detached device vdb from instance 3b8adc91-c4d4-4484-bd4e-cc3d356338c7 from the persistent domain config.
Dec 06 12:59:10 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3b8adc91-c4d4-4484-bd4e-cc3d356338c7 from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 12:59:10 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:59:10 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:59:10 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:59:10 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:59:10 user nova-compute[75247]:   <serial>fc2dd237-61c9-448f-93c2-d35d3aab99fa</serial>
Dec 06 12:59:10 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:59:10 user nova-compute[75247]: </disk>
Dec 06 12:59:10 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:59:10 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3b8adc91-c4d4-4484-bd4e-cc3d356338c7 {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 12:59:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:13 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:59:13 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:59:15 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:59:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:17 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:59:18 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:59:19 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:59:19 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 12:59:20 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:59:21 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:59:21 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 12:59:22 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Didn't find any instances for network info cache update. {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 12:59:22 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 12:59:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:22 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 12:59:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "f5b69324-579d-4833-9bb4-c43c511f820d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG nova.objects.instance [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lazy-loading 'flavor' on Instance uuid f5b69324-579d-4833-9bb4-c43c511f820d {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "f5b69324-579d-4833-9bb4-c43c511f820d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:25 user nova-compute[75247]: INFO nova.compute.manager [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Attaching volume 6c1e9998-3aaf-4ba5-a932-f6f77332c9dc to /dev/vdb
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b8adc91-c4d4-4484-bd4e-cc3d356338c7/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG os_brick.utils [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6908d40e-665d-42af-8ee3-1bdda9973fc2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a7820c-04d8-49bd-b79e-471d2cde78db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a31b65-73ca-4f1f-bf82-6eaeb97c8dd7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b8adc91-c4d4-4484-bd4e-cc3d356338c7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b8adc91-c4d4-4484-bd4e-cc3d356338c7/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[db520ef7-5bf3-45eb-9164-b567a2a41e1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:59:25 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d247433d-716d-446e-b115-9eae4328beb5]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG os_brick.utils [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Updating existing volume attachment record: 0bedd122-d3b4-434c-bf35-e0481f8311e3 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b8adc91-c4d4-4484-bd4e-cc3d356338c7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:26 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:59:26 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:59:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=7715MB free_disk=24.95602035522461GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 12:59:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 70c4664e-ae7a-47de-bba7-18300391d209 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:59:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 782289e2-91cd-4aee-9a08-eadfb2a5965b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:59:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance bc3ddb40-b05f-4170-b269-d44dec6ecdaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:59:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 530cfb75-7aa8-4e57-b282-8f7a21401b34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:59:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance f5b69324-579d-4833-9bb4-c43c511f820d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:59:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance c603d6dc-804e-4c0d-be1f-40e09de74e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:59:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 3b8adc91-c4d4-4484-bd4e-cc3d356338c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:59:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 16dd787d-6abe-48f3-ac3c-fd55853b4e23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:59:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance e1f21135-43cd-4dbb-ae7a-b12dffdc5816 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 12:59:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 12:59:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 12:59:26 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:59:26 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:59:26 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 12:59:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:30 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3b8adc91-c4d4-4484-bd4e-cc3d356338c7 is timed out.
Dec 06 12:59:30 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Successfully detached device vdb from instance 3b8adc91-c4d4-4484-bd4e-cc3d356338c7 from the live domain config.
Dec 06 12:59:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCUQnsKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:59:30 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:59:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8228ca7a-803a-4ec2-bbe3-7486056b2bde]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 12:59:30 user nova-compute[75247]: No targets found.
Dec 06 12:59:30 user nova-compute[75247]: iSNS:
Dec 06 12:59:30 user nova-compute[75247]: No targets found.
Dec 06 12:59:30 user nova-compute[75247]: STATIC:
Dec 06 12:59:30 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa
Dec 06 12:59:30 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 12:59:30 user nova-compute[75247]:                 Iface Name: default
Dec 06 12:59:30 user nova-compute[75247]: FIRMWARE:
Dec 06 12:59:30 user nova-compute[75247]: No targets found.
Dec 06 12:59:30 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 12:59:30 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 12:59:30 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f3b793-278a-4a70-abc1-78c5608ebff0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[24064091-63f8-49b8-9433-2633056b0e58]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa (non-flash)
Dec 06 12:59:30 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa (non-flash)
Dec 06 12:59:30 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c6b57e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa'): ({'sdb'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Removing single pathed devices sdb {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b07145-4031-4ce6-a41e-31f4da91beac]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1885f49f-8d18-4b9c-9da4-6e4cadc5c898]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Flushing IO for device /dev/sdb {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[015f71f7-d9e0-4dc7-bce3-aae89011e25e]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[07118e71-d7e1-4e9e-9ea9-b899ac8e0bf9]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa062d1-8fb2-4314-88f7-23ec671e0296]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e19c29-f753-4421-8e4c-a166c48c1cfe]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa, portal: 172.16.0.220,3260]
Dec 06 12:59:30 user nova-compute[75247]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa, portal: 172.16.0.220,3260] successful.
Dec 06 12:59:30 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dd237-61c9-448f-93c2-d35d3aab99fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8242354-6cb2-463a-9c85-1536c19d6f3c]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] <== disconnect_volume: return (279ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:59:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 12:59:31 user nova-compute[75247]: DEBUG nova.objects.instance [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lazy-loading 'flavor' on Instance uuid 3b8adc91-c4d4-4484-bd4e-cc3d356338c7 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:59:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-f524c4d2-e307-489c-acc6-85a4ee9a6759 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.719s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:34 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:59:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITkQEJgw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:59:34 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:59:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:59:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:59:34 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:59:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:59:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:59:34 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:59:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:34 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6a5467-d30d-4ebc-bc51-47e81d0bebfe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:59:34 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:34 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45538a9-80c5-4a9a-a689-347d68ca2093]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc] added
Dec 06 12:59:34 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ead562b-8bbc-4f1e-b5e8-bd8aa0446ee4]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c638b9a3-291c-42be-aaf4-3e72564a767f]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ITkQEJgw {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ITkQEJgw" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0bda3a-4383-4605-9fc7-b1b74ac8e9bc]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ITkQEJgw'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[84aaad75-8586-4a7b-9524-767d0e94e7cb]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1867fa2-f850-4c94-8b3f-02121e89d6fb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 12:59:35 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 12:59:35 user nova-compute[75247]:  {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:59:35 user nova-compute[75247]: WARNING os_brick.initiator.connectors.iscsi [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 12:59:35 user nova-compute[75247]: 
Dec 06 12:59:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[00662afa-1d8e-4a1d-9a27-9de3b1b56749]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc, portal: 172.16.0.220,3260]
Dec 06 12:59:35 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc, portal: 172.16.0.220,3260] successful.
Dec 06 12:59:35 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefeb177-8b1a-4ca9-a6ef-ce9899a9b3a2]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f2606a-d3ee-4357-a888-8bee1ec45f35]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc (non-flash)
Dec 06 12:59:35 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc (non-flash)
Dec 06 12:59:35 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d600d9-c611-4aaa-bef2-2e9468e105fb]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:35 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:59:36 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:59:36 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITkQEJgw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:59:36 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:59:36 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23332643463353132', 'path': '/dev/sdb'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:59:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332643463353132', 'path': '/dev/sdb'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:59:36 user nova-compute[75247]: DEBUG nova.objects.instance [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lazy-loading 'flavor' on Instance uuid f5b69324-579d-4833-9bb4-c43c511f820d {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:59:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 12:59:36 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:59:36 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:59:36 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:59:36 user nova-compute[75247]:   <serial>6c1e9998-3aaf-4ba5-a932-f6f77332c9dc</serial>
Dec 06 12:59:36 user nova-compute[75247]: </disk>
Dec 06 12:59:36 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 12:59:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:59:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:59:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] No VIF found with MAC fa:16:3e:88:16:dd, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:59:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-20d323a5-9efa-49f2-a8f9-812986642efa tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.629s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:59:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "f5b69324-579d-4833-9bb4-c43c511f820d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:38 user nova-compute[75247]: INFO nova.compute.manager [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Detaching volume 6c1e9998-3aaf-4ba5-a932-f6f77332c9dc
Dec 06 12:59:38 user nova-compute[75247]: INFO nova.virt.block_device [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Attempting to driver detach volume 6c1e9998-3aaf-4ba5-a932-f6f77332c9dc from mountpoint /dev/vdb
Dec 06 12:59:38 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Attempting to detach device vdb from instance f5b69324-579d-4833-9bb4-c43c511f820d from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 12:59:38 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:59:38 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:59:38 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:59:38 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:59:38 user nova-compute[75247]:   <serial>6c1e9998-3aaf-4ba5-a932-f6f77332c9dc</serial>
Dec 06 12:59:38 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:59:38 user nova-compute[75247]: </disk>
Dec 06 12:59:38 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:59:38 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Successfully detached device vdb from instance f5b69324-579d-4833-9bb4-c43c511f820d from the persistent domain config.
Dec 06 12:59:38 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f5b69324-579d-4833-9bb4-c43c511f820d from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 12:59:38 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 12:59:38 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:59:38 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 12:59:38 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:59:38 user nova-compute[75247]:   <serial>6c1e9998-3aaf-4ba5-a932-f6f77332c9dc</serial>
Dec 06 12:59:38 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 12:59:38 user nova-compute[75247]: </disk>
Dec 06 12:59:38 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 12:59:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f5b69324-579d-4833-9bb4-c43c511f820d {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 12:59:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:40 user nova-compute[75247]: DEBUG nova.compute.manager [req-eb8fa5b2-b3b3-47d7-a04d-97eae3ac611d req-33aa1c6e-10dc-442a-a7e9-251d49981e88 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received event network-changed-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:59:40 user nova-compute[75247]: DEBUG nova.compute.manager [req-eb8fa5b2-b3b3-47d7-a04d-97eae3ac611d req-33aa1c6e-10dc-442a-a7e9-251d49981e88 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Refreshing instance network info cache due to event network-changed-3a8804e1-c0a2-4f4a-941e-5fc617f45d93. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:59:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-eb8fa5b2-b3b3-47d7-a04d-97eae3ac611d req-33aa1c6e-10dc-442a-a7e9-251d49981e88 service nova] Acquiring lock "refresh_cache-16dd787d-6abe-48f3-ac3c-fd55853b4e23" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:59:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-eb8fa5b2-b3b3-47d7-a04d-97eae3ac611d req-33aa1c6e-10dc-442a-a7e9-251d49981e88 service nova] Acquired lock "refresh_cache-16dd787d-6abe-48f3-ac3c-fd55853b4e23" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:59:40 user nova-compute[75247]: DEBUG nova.network.neutron [req-eb8fa5b2-b3b3-47d7-a04d-97eae3ac611d req-33aa1c6e-10dc-442a-a7e9-251d49981e88 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Refreshing network info cache for port 3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:59:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4a8c4bb8-f9f5-4b67-a209-8b999275d478 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "782289e2-91cd-4aee-9a08-eadfb2a5965b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4a8c4bb8-f9f5-4b67-a209-8b999275d478 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "782289e2-91cd-4aee-9a08-eadfb2a5965b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4a8c4bb8-f9f5-4b67-a209-8b999275d478 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "782289e2-91cd-4aee-9a08-eadfb2a5965b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4a8c4bb8-f9f5-4b67-a209-8b999275d478 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "782289e2-91cd-4aee-9a08-eadfb2a5965b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4a8c4bb8-f9f5-4b67-a209-8b999275d478 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "782289e2-91cd-4aee-9a08-eadfb2a5965b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:41 user nova-compute[75247]: INFO nova.compute.manager [None req-4a8c4bb8-f9f5-4b67-a209-8b999275d478 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Terminating instance
Dec 06 12:59:41 user nova-compute[75247]: DEBUG nova.compute.manager [None req-4a8c4bb8-f9f5-4b67-a209-8b999275d478 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:59:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:41 user nova-compute[75247]: DEBUG nova.network.neutron [req-eb8fa5b2-b3b3-47d7-a04d-97eae3ac611d req-33aa1c6e-10dc-442a-a7e9-251d49981e88 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Updated VIF entry in instance network info cache for port 3a8804e1-c0a2-4f4a-941e-5fc617f45d93. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:59:41 user nova-compute[75247]: DEBUG nova.network.neutron [req-eb8fa5b2-b3b3-47d7-a04d-97eae3ac611d req-33aa1c6e-10dc-442a-a7e9-251d49981e88 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Updating instance_info_cache with network_info: [{"id": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "address": "fa:16:3e:f9:7b:5b", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8804e1-c0", "ovs_interfaceid": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:59:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-eb8fa5b2-b3b3-47d7-a04d-97eae3ac611d req-33aa1c6e-10dc-442a-a7e9-251d49981e88 service nova] Releasing lock "refresh_cache-16dd787d-6abe-48f3-ac3c-fd55853b4e23" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:59:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:41 user nova-compute[75247]: DEBUG nova.objects.instance [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'flavor' on Instance uuid 16dd787d-6abe-48f3-ac3c-fd55853b4e23 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:59:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:42 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Instance destroyed successfully.
Dec 06 12:59:42 user nova-compute[75247]: DEBUG nova.objects.instance [None req-4a8c4bb8-f9f5-4b67-a209-8b999275d478 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lazy-loading 'resources' on Instance uuid 782289e2-91cd-4aee-9a08-eadfb2a5965b {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:42 user nova-compute[75247]: INFO nova.compute.manager [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Attaching volume 29be7905-6db7-4b52-a629-d772283ff9aa to /dev/vdb
Dec 06 12:59:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-4a8c4bb8-f9f5-4b67-a209-8b999275d478 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-784837433',display_name='tempest-ServerActionsTestOtherA-server-784837433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-784837433',id=3,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1PSIn5waVLUBUVXmci26Bjo3OHYSVHL8/oxs3uvNoObvAgLe5HgiP5u61wX8nEvgm8XgeBjcCfcP/HNC/vep9hMtkBYH/Pz/i1rF8IkHYEtoKU1LHCX3Qi/2pvpu4Reg==',key_name='tempest-keypair-1071092699',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:40:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0ccf15765714ca2a8c4700d2d6e3ed2',ramdisk_id='',reservation_id='r-460343j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2075667053',owner_user_name='tempest-ServerActionsTestOtherA-2075667053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13843d8f074da189dbd3e93750b811',uuid=782289e2-91cd-4aee-9a08-eadfb2a5965b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "address": "fa:16:3e:e4:cb:02", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924c627-a1", "ovs_interfaceid": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-4a8c4bb8-f9f5-4b67-a209-8b999275d478 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converting VIF {"id": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "address": "fa:16:3e:e4:cb:02", "network": {"id": "90c51a65-4382-4e01-9d83-d44824209c97", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2059292391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0ccf15765714ca2a8c4700d2d6e3ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924c627-a1", "ovs_interfaceid": "b924c627-a11e-4fc4-8e23-d1a974c4de3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-4a8c4bb8-f9f5-4b67-a209-8b999275d478 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:cb:02,bridge_name='br-int',has_traffic_filtering=True,id=b924c627-a11e-4fc4-8e23-d1a974c4de3d,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb924c627-a1') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG os_vif [None req-4a8c4bb8-f9f5-4b67-a209-8b999275d478 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:cb:02,bridge_name='br-int',has_traffic_filtering=True,id=b924c627-a11e-4fc4-8e23-d1a974c4de3d,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb924c627-a1') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb924c627-a1, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=23ec1a69-e1a5-4728-87f3-07e49d32ff36) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:59:42 user nova-compute[75247]: INFO os_vif [None req-4a8c4bb8-f9f5-4b67-a209-8b999275d478 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:cb:02,bridge_name='br-int',has_traffic_filtering=True,id=b924c627-a11e-4fc4-8e23-d1a974c4de3d,network=Network(90c51a65-4382-4e01-9d83-d44824209c97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb924c627-a1')
Dec 06 12:59:42 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-4a8c4bb8-f9f5-4b67-a209-8b999275d478 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Deleting instance files /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b_del
Dec 06 12:59:42 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-4a8c4bb8-f9f5-4b67-a209-8b999275d478 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Deletion of /opt/stack/data/nova/instances/782289e2-91cd-4aee-9a08-eadfb2a5965b_del complete
Dec 06 12:59:42 user nova-compute[75247]: DEBUG os_brick.utils [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecf543c-e479-4a16-9c33-a1502c750866]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1a206d-a433-4944-acf1-674dfe5cd166]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:42 user nova-compute[75247]: INFO nova.compute.manager [None req-4a8c4bb8-f9f5-4b67-a209-8b999275d478 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Took 0.98 seconds to destroy the instance on the hypervisor.
Dec 06 12:59:42 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-4a8c4bb8-f9f5-4b67-a209-8b999275d478 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a3d330-4859-44d3-abbf-08f93d1cbc09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dca820-d845-4a61-959e-27e1f13c4fbb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:59:42 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:59:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc921c9c-3f40-4ff2-8102-4f2dc5da609c]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG os_brick.utils [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Updating existing volume attachment record: cf0fdcd7-c566-414f-945d-1976c9889f8a {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG nova.compute.manager [req-d5e7aeaf-fc86-4205-aa2b-4485b77685b5 req-17713707-5822-4acd-ba63-bd18dfd26c16 service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Received event network-vif-unplugged-b924c627-a11e-4fc4-8e23-d1a974c4de3d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d5e7aeaf-fc86-4205-aa2b-4485b77685b5 req-17713707-5822-4acd-ba63-bd18dfd26c16 service nova] Acquiring lock "782289e2-91cd-4aee-9a08-eadfb2a5965b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d5e7aeaf-fc86-4205-aa2b-4485b77685b5 req-17713707-5822-4acd-ba63-bd18dfd26c16 service nova] Lock "782289e2-91cd-4aee-9a08-eadfb2a5965b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d5e7aeaf-fc86-4205-aa2b-4485b77685b5 req-17713707-5822-4acd-ba63-bd18dfd26c16 service nova] Lock "782289e2-91cd-4aee-9a08-eadfb2a5965b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG nova.compute.manager [req-d5e7aeaf-fc86-4205-aa2b-4485b77685b5 req-17713707-5822-4acd-ba63-bd18dfd26c16 service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] No waiting events found dispatching network-vif-unplugged-b924c627-a11e-4fc4-8e23-d1a974c4de3d {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG nova.compute.manager [req-d5e7aeaf-fc86-4205-aa2b-4485b77685b5 req-17713707-5822-4acd-ba63-bd18dfd26c16 service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Received event network-vif-unplugged-b924c627-a11e-4fc4-8e23-d1a974c4de3d for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG nova.compute.manager [req-d5e7aeaf-fc86-4205-aa2b-4485b77685b5 req-17713707-5822-4acd-ba63-bd18dfd26c16 service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Received event network-vif-plugged-b924c627-a11e-4fc4-8e23-d1a974c4de3d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d5e7aeaf-fc86-4205-aa2b-4485b77685b5 req-17713707-5822-4acd-ba63-bd18dfd26c16 service nova] Acquiring lock "782289e2-91cd-4aee-9a08-eadfb2a5965b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d5e7aeaf-fc86-4205-aa2b-4485b77685b5 req-17713707-5822-4acd-ba63-bd18dfd26c16 service nova] Lock "782289e2-91cd-4aee-9a08-eadfb2a5965b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d5e7aeaf-fc86-4205-aa2b-4485b77685b5 req-17713707-5822-4acd-ba63-bd18dfd26c16 service nova] Lock "782289e2-91cd-4aee-9a08-eadfb2a5965b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG nova.compute.manager [req-d5e7aeaf-fc86-4205-aa2b-4485b77685b5 req-17713707-5822-4acd-ba63-bd18dfd26c16 service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] No waiting events found dispatching network-vif-plugged-b924c627-a11e-4fc4-8e23-d1a974c4de3d {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:59:42 user nova-compute[75247]: WARNING nova.compute.manager [req-d5e7aeaf-fc86-4205-aa2b-4485b77685b5 req-17713707-5822-4acd-ba63-bd18dfd26c16 service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Received unexpected event network-vif-plugged-b924c627-a11e-4fc4-8e23-d1a974c4de3d for instance with vm_state active and task_state deleting.
Dec 06 12:59:42 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:59:42 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Took 0.59 seconds to deallocate network for instance.
Dec 06 12:59:42 user nova-compute[75247]: DEBUG nova.compute.manager [req-6a7b5dd8-05db-4965-9d79-0b203ae28856 req-13b96940-0596-416a-b628-29cdc518864b service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Received event network-vif-deleted-b924c627-a11e-4fc4-8e23-d1a974c4de3d {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:59:42 user nova-compute[75247]: INFO nova.compute.manager [req-6a7b5dd8-05db-4965-9d79-0b203ae28856 req-13b96940-0596-416a-b628-29cdc518864b service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Neutron deleted interface b924c627-a11e-4fc4-8e23-d1a974c4de3d; detaching it from the instance and deleting it from the info cache
Dec 06 12:59:42 user nova-compute[75247]: DEBUG nova.network.neutron [req-6a7b5dd8-05db-4965-9d79-0b203ae28856 req-13b96940-0596-416a-b628-29cdc518864b service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG nova.compute.manager [req-6a7b5dd8-05db-4965-9d79-0b203ae28856 req-13b96940-0596-416a-b628-29cdc518864b service nova] [instance: 782289e2-91cd-4aee-9a08-eadfb2a5965b] Detach interface failed, port_id=b924c627-a11e-4fc4-8e23-d1a974c4de3d, reason: Instance 782289e2-91cd-4aee-9a08-eadfb2a5965b could not be found. {{(pid=75247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4a8c4bb8-f9f5-4b67-a209-8b999275d478 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4a8c4bb8-f9f5-4b67-a209-8b999275d478 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:43 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-4a8c4bb8-f9f5-4b67-a209-8b999275d478 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:59:43 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-4a8c4bb8-f9f5-4b67-a209-8b999275d478 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:59:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4a8c4bb8-f9f5-4b67-a209-8b999275d478 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:43 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-4a8c4bb8-f9f5-4b67-a209-8b999275d478 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Deleted allocations for instance 782289e2-91cd-4aee-9a08-eadfb2a5965b
Dec 06 12:59:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4a8c4bb8-f9f5-4b67-a209-8b999275d478 tempest-ServerActionsTestOtherA-2075667053 tempest-ServerActionsTestOtherA-2075667053-project-member] Lock "782289e2-91cd-4aee-9a08-eadfb2a5965b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.136s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-0603151c-374e-4aa1-942f-1aed79e6103a req-31723ffe-087a-4e62-85ce-0eee324fe91b service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Received event network-changed-58e08de5-6c1a-48bc-aa1a-242ec3b175a1 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:59:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-0603151c-374e-4aa1-942f-1aed79e6103a req-31723ffe-087a-4e62-85ce-0eee324fe91b service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Refreshing instance network info cache due to event network-changed-58e08de5-6c1a-48bc-aa1a-242ec3b175a1. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 12:59:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0603151c-374e-4aa1-942f-1aed79e6103a req-31723ffe-087a-4e62-85ce-0eee324fe91b service nova] Acquiring lock "refresh_cache-e1f21135-43cd-4dbb-ae7a-b12dffdc5816" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:59:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0603151c-374e-4aa1-942f-1aed79e6103a req-31723ffe-087a-4e62-85ce-0eee324fe91b service nova] Acquired lock "refresh_cache-e1f21135-43cd-4dbb-ae7a-b12dffdc5816" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:59:47 user nova-compute[75247]: DEBUG nova.network.neutron [req-0603151c-374e-4aa1-942f-1aed79e6103a req-31723ffe-087a-4e62-85ce-0eee324fe91b service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Refreshing network info cache for port 58e08de5-6c1a-48bc-aa1a-242ec3b175a1 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 12:59:47 user nova-compute[75247]: DEBUG nova.network.neutron [req-0603151c-374e-4aa1-942f-1aed79e6103a req-31723ffe-087a-4e62-85ce-0eee324fe91b service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Updated VIF entry in instance network info cache for port 58e08de5-6c1a-48bc-aa1a-242ec3b175a1. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 12:59:47 user nova-compute[75247]: DEBUG nova.network.neutron [req-0603151c-374e-4aa1-942f-1aed79e6103a req-31723ffe-087a-4e62-85ce-0eee324fe91b service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Updating instance_info_cache with network_info: [{"id": "58e08de5-6c1a-48bc-aa1a-242ec3b175a1", "address": "fa:16:3e:d6:b6:ce", "network": {"id": "053733b9-e8f4-4da1-a5fe-ee7d0704684c", "bridge": "br-int", "label": "tempest-TestStampPattern-239755854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "135f3c1de288423e8964c31ca35664c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e08de5-6c", "ovs_interfaceid": "58e08de5-6c1a-48bc-aa1a-242ec3b175a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:59:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0603151c-374e-4aa1-942f-1aed79e6103a req-31723ffe-087a-4e62-85ce-0eee324fe91b service nova] Releasing lock "refresh_cache-e1f21135-43cd-4dbb-ae7a-b12dffdc5816" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:59:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:47 user nova-compute[75247]: DEBUG nova.objects.instance [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lazy-loading 'flavor' on Instance uuid e1f21135-43cd-4dbb-ae7a-b12dffdc5816 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:59:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:48 user nova-compute[75247]: INFO nova.compute.manager [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Attaching volume ca217b52-78b5-4b84-a972-695d4d67a099 to /dev/vdb
Dec 06 12:59:48 user nova-compute[75247]: DEBUG os_brick.utils [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:59:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:48 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f69eb4-4ee4-497a-b70e-912dccd872b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:48 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb60662-1eee-4801-9651-5908eaaa9d04]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:48 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4673e58-f46d-4bd2-adba-e846abe18d96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:48 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[63437085-fd97-4821-a717-5098b6f58006]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:59:48 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 12:59:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 12:59:48 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 12:59:48 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be78579-7ce2-405f-9db6-14f313f3d811]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:48 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 12:59:48 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 12:59:48 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 12:59:48 user nova-compute[75247]: DEBUG os_brick.utils [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:59:48 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Updating existing volume attachment record: ac46140a-e2e5-4aba-b462-a1d86cbde561 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 12:59:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrOiqozp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:59:52 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:59:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:59:52 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:59:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:59:52 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7959a59-3503-43dc-a814-0f1b04ec649d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:59:52 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb6124e-eb95-40eb-a85b-ffdb9ab67a7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa] added
Dec 06 12:59:52 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb7c777-078e-4e23-b14e-332b00e83dad]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecc1ac5-a95b-49c6-a90d-fbbcf6326852]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CrOiqozp {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CrOiqozp" returned: 0 in 0.037s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cf40e8-83aa-4db2-9862-33e499e5db5d]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CrOiqozp'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6435a183-6b8b-496a-88a1-b53674cfe710]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2511c99b-c237-469c-8608-b348f775f75c]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e1970-1107-4d19-b52b-cc2bb593aa5e (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc (non-flash)
Dec 06 12:59:52 user nova-compute[75247]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e1970-1107-4d19-b52b-cc2bb593aa5e (non-flash)
Dec 06 12:59:52 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc (non-flash)
Dec 06 12:59:52 user nova-compute[75247]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e1970-1107-4d19-b52b-cc2bb593aa5e (non-flash)
Dec 06 12:59:52 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bc1c96-38c0-4ca6-9f71-7620edb6fd4b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa, portal: 172.16.0.220,3260]
Dec 06 12:59:52 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa, portal: 172.16.0.220,3260] successful.
Dec 06 12:59:52 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed3f51a-0c05-404e-bb57-b9a5dbe76a66]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[02121eb8-5550-4baf-93f7-7238141d02ff]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e1970-1107-4d19-b52b-cc2bb593aa5e (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc (non-flash)
Dec 06 12:59:52 user nova-compute[75247]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e1970-1107-4d19-b52b-cc2bb593aa5e (non-flash)
Dec 06 12:59:52 user nova-compute[75247]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)
Dec 06 12:59:52 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc (non-flash)
Dec 06 12:59:52 user nova-compute[75247]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e1970-1107-4d19-b52b-cc2bb593aa5e (non-flash)
Dec 06 12:59:52 user nova-compute[75247]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)
Dec 06 12:59:52 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[165b15d2-6ab5-48b1-b6c6-9d80caafd656]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: None {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c8b2ea21-b6ce-4ccd-9a4c-fea3fe4312b2 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "70c4664e-ae7a-47de-bba7-18300391d209" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c8b2ea21-b6ce-4ccd-9a4c-fea3fe4312b2 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "70c4664e-ae7a-47de-bba7-18300391d209" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c8b2ea21-b6ce-4ccd-9a4c-fea3fe4312b2 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "70c4664e-ae7a-47de-bba7-18300391d209-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c8b2ea21-b6ce-4ccd-9a4c-fea3fe4312b2 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "70c4664e-ae7a-47de-bba7-18300391d209-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c8b2ea21-b6ce-4ccd-9a4c-fea3fe4312b2 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "70c4664e-ae7a-47de-bba7-18300391d209-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:52 user nova-compute[75247]: INFO nova.compute.manager [None req-c8b2ea21-b6ce-4ccd-9a4c-fea3fe4312b2 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Terminating instance
Dec 06 12:59:52 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c8b2ea21-b6ce-4ccd-9a4c-fea3fe4312b2 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG nova.compute.manager [req-f53db17d-ab5a-4fd4-aeed-28f3cba4715e req-b51ffb2f-98b8-4a40-ad26-faaa4e708c09 service nova] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Received event network-vif-unplugged-4f46192c-414a-4af4-b5de-5bd99d31d1fe {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f53db17d-ab5a-4fd4-aeed-28f3cba4715e req-b51ffb2f-98b8-4a40-ad26-faaa4e708c09 service nova] Acquiring lock "70c4664e-ae7a-47de-bba7-18300391d209-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f53db17d-ab5a-4fd4-aeed-28f3cba4715e req-b51ffb2f-98b8-4a40-ad26-faaa4e708c09 service nova] Lock "70c4664e-ae7a-47de-bba7-18300391d209-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f53db17d-ab5a-4fd4-aeed-28f3cba4715e req-b51ffb2f-98b8-4a40-ad26-faaa4e708c09 service nova] Lock "70c4664e-ae7a-47de-bba7-18300391d209-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG nova.compute.manager [req-f53db17d-ab5a-4fd4-aeed-28f3cba4715e req-b51ffb2f-98b8-4a40-ad26-faaa4e708c09 service nova] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] No waiting events found dispatching network-vif-unplugged-4f46192c-414a-4af4-b5de-5bd99d31d1fe {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG nova.compute.manager [req-f53db17d-ab5a-4fd4-aeed-28f3cba4715e req-b51ffb2f-98b8-4a40-ad26-faaa4e708c09 service nova] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Received event network-vif-unplugged-4f46192c-414a-4af4-b5de-5bd99d31d1fe for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrOiqozp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23530643066653539', 'path': '/dev/sdd'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530643066653539', 'path': '/dev/sdd'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG nova.objects.instance [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'flavor' on Instance uuid 16dd787d-6abe-48f3-ac3c-fd55853b4e23 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:59:53 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Instance destroyed successfully.
Dec 06 12:59:53 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c8b2ea21-b6ce-4ccd-9a4c-fea3fe4312b2 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lazy-loading 'resources' on Instance uuid 70c4664e-ae7a-47de-bba7-18300391d209 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-c8b2ea21-b6ce-4ccd-9a4c-fea3fe4312b2 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1363181667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1363181667',id=2,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:40:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='222da79e3583495d90d5442029996343',ramdisk_id='',reservation_id='r-k3i92vzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:42:11Z,user_data=None,user_id='d0efa55fc4754d96a33d07d52342d8f7',uuid=70c4664e-ae7a-47de-bba7-18300391d209,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f46192c-414a-4af4-b5de-5bd99d31d1fe", "address": "fa:16:3e:b5:83:aa", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f46192c-41", "ovs_interfaceid": "4f46192c-414a-4af4-b5de-5bd99d31d1fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-c8b2ea21-b6ce-4ccd-9a4c-fea3fe4312b2 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converting VIF {"id": "4f46192c-414a-4af4-b5de-5bd99d31d1fe", "address": "fa:16:3e:b5:83:aa", "network": {"id": "28e6c6e7-68ca-41a8-919a-cebdba97d6ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1052291605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222da79e3583495d90d5442029996343", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f46192c-41", "ovs_interfaceid": "4f46192c-414a-4af4-b5de-5bd99d31d1fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-c8b2ea21-b6ce-4ccd-9a4c-fea3fe4312b2 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:83:aa,bridge_name='br-int',has_traffic_filtering=True,id=4f46192c-414a-4af4-b5de-5bd99d31d1fe,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f46192c-41') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG os_vif [None req-c8b2ea21-b6ce-4ccd-9a4c-fea3fe4312b2 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:83:aa,bridge_name='br-int',has_traffic_filtering=True,id=4f46192c-414a-4af4-b5de-5bd99d31d1fe,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f46192c-41') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f46192c-41, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 12:59:53 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 12:59:53 user nova-compute[75247]:   <source dev="/dev/sdd"/>
Dec 06 12:59:53 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 12:59:53 user nova-compute[75247]:   <serial>29be7905-6db7-4b52-a629-d772283ff9aa</serial>
Dec 06 12:59:53 user nova-compute[75247]: </disk>
Dec 06 12:59:53 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=596dfaed-cecc-4242-9ed6-dc5f5d5f0d91) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:53 user nova-compute[75247]: INFO os_vif [None req-c8b2ea21-b6ce-4ccd-9a4c-fea3fe4312b2 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:83:aa,bridge_name='br-int',has_traffic_filtering=True,id=4f46192c-414a-4af4-b5de-5bd99d31d1fe,network=Network(28e6c6e7-68ca-41a8-919a-cebdba97d6ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f46192c-41')
Dec 06 12:59:53 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-c8b2ea21-b6ce-4ccd-9a4c-fea3fe4312b2 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Deleting instance files /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209_del
Dec 06 12:59:53 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-c8b2ea21-b6ce-4ccd-9a4c-fea3fe4312b2 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Deletion of /opt/stack/data/nova/instances/70c4664e-ae7a-47de-bba7-18300391d209_del complete
Dec 06 12:59:53 user nova-compute[75247]: INFO nova.compute.manager [None req-c8b2ea21-b6ce-4ccd-9a4c-fea3fe4312b2 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Took 0.93 seconds to destroy the instance on the hypervisor.
Dec 06 12:59:53 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-c8b2ea21-b6ce-4ccd-9a4c-fea3fe4312b2 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:59:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] No VIF found with MAC fa:16:3e:f9:7b:5b, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:59:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3f277e8b-5a63-4fed-8970-5c2df23bc631 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.963s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:54 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:59:54 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Took 0.57 seconds to deallocate network for instance.
Dec 06 12:59:54 user nova-compute[75247]: DEBUG nova.compute.manager [req-3338e651-528c-4f94-a392-b02bcbe20b51 req-7ab27abe-c794-4e91-bd7d-9b32381998f9 service nova] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Received event network-vif-deleted-4f46192c-414a-4af4-b5de-5bd99d31d1fe {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:59:54 user nova-compute[75247]: INFO nova.compute.manager [req-3338e651-528c-4f94-a392-b02bcbe20b51 req-7ab27abe-c794-4e91-bd7d-9b32381998f9 service nova] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Neutron deleted interface 4f46192c-414a-4af4-b5de-5bd99d31d1fe; detaching it from the instance and deleting it from the info cache
Dec 06 12:59:54 user nova-compute[75247]: DEBUG nova.network.neutron [req-3338e651-528c-4f94-a392-b02bcbe20b51 req-7ab27abe-c794-4e91-bd7d-9b32381998f9 service nova] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:59:54 user nova-compute[75247]: DEBUG nova.compute.manager [req-3338e651-528c-4f94-a392-b02bcbe20b51 req-7ab27abe-c794-4e91-bd7d-9b32381998f9 service nova] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Detach interface failed, port_id=4f46192c-414a-4af4-b5de-5bd99d31d1fe, reason: Instance 70c4664e-ae7a-47de-bba7-18300391d209 could not be found. {{(pid=75247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 12:59:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c8b2ea21-b6ce-4ccd-9a4c-fea3fe4312b2 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c8b2ea21-b6ce-4ccd-9a4c-fea3fe4312b2 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:54 user nova-compute[75247]: INFO nova.compute.manager [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Rescuing
Dec 06 12:59:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "refresh_cache-16dd787d-6abe-48f3-ac3c-fd55853b4e23" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 12:59:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquired lock "refresh_cache-16dd787d-6abe-48f3-ac3c-fd55853b4e23" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 12:59:54 user nova-compute[75247]: DEBUG nova.network.neutron [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 12:59:54 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c8b2ea21-b6ce-4ccd-9a4c-fea3fe4312b2 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 12:59:54 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c8b2ea21-b6ce-4ccd-9a4c-fea3fe4312b2 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 12:59:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c8b2ea21-b6ce-4ccd-9a4c-fea3fe4312b2 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:54 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-c8b2ea21-b6ce-4ccd-9a4c-fea3fe4312b2 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Deleted allocations for instance 70c4664e-ae7a-47de-bba7-18300391d209
Dec 06 12:59:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c8b2ea21-b6ce-4ccd-9a4c-fea3fe4312b2 tempest-ServerBootFromVolumeStableRescueTest-1200643969 tempest-ServerBootFromVolumeStableRescueTest-1200643969-project-member] Lock "70c4664e-ae7a-47de-bba7-18300391d209" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.417s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:55 user nova-compute[75247]: DEBUG nova.compute.manager [req-d24a6dd1-0c64-4b8b-8dcf-6bf370f1d020 req-2b05e20b-8e97-456a-8b36-3ec2cb8ad758 service nova] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Received event network-vif-plugged-4f46192c-414a-4af4-b5de-5bd99d31d1fe {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:59:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d24a6dd1-0c64-4b8b-8dcf-6bf370f1d020 req-2b05e20b-8e97-456a-8b36-3ec2cb8ad758 service nova] Acquiring lock "70c4664e-ae7a-47de-bba7-18300391d209-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d24a6dd1-0c64-4b8b-8dcf-6bf370f1d020 req-2b05e20b-8e97-456a-8b36-3ec2cb8ad758 service nova] Lock "70c4664e-ae7a-47de-bba7-18300391d209-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d24a6dd1-0c64-4b8b-8dcf-6bf370f1d020 req-2b05e20b-8e97-456a-8b36-3ec2cb8ad758 service nova] Lock "70c4664e-ae7a-47de-bba7-18300391d209-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:55 user nova-compute[75247]: DEBUG nova.compute.manager [req-d24a6dd1-0c64-4b8b-8dcf-6bf370f1d020 req-2b05e20b-8e97-456a-8b36-3ec2cb8ad758 service nova] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] No waiting events found dispatching network-vif-plugged-4f46192c-414a-4af4-b5de-5bd99d31d1fe {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:59:55 user nova-compute[75247]: WARNING nova.compute.manager [req-d24a6dd1-0c64-4b8b-8dcf-6bf370f1d020 req-2b05e20b-8e97-456a-8b36-3ec2cb8ad758 service nova] [instance: 70c4664e-ae7a-47de-bba7-18300391d209] Received unexpected event network-vif-plugged-4f46192c-414a-4af4-b5de-5bd99d31d1fe for instance with vm_state deleted and task_state None.
Dec 06 12:59:55 user nova-compute[75247]: DEBUG nova.network.neutron [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Updating instance_info_cache with network_info: [{"id": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "address": "fa:16:3e:f9:7b:5b", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8804e1-c0", "ovs_interfaceid": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 12:59:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Releasing lock "refresh_cache-16dd787d-6abe-48f3-ac3c-fd55853b4e23" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 12:59:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:56 user nova-compute[75247]: DEBUG nova.compute.manager [req-eed66f59-8809-4ffe-8b61-af1f512e09c4 req-e7d3973a-d314-4acb-b63e-cec1c72d25ea service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received event network-vif-unplugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:59:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-eed66f59-8809-4ffe-8b61-af1f512e09c4 req-e7d3973a-d314-4acb-b63e-cec1c72d25ea service nova] Acquiring lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-eed66f59-8809-4ffe-8b61-af1f512e09c4 req-e7d3973a-d314-4acb-b63e-cec1c72d25ea service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-eed66f59-8809-4ffe-8b61-af1f512e09c4 req-e7d3973a-d314-4acb-b63e-cec1c72d25ea service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:56 user nova-compute[75247]: DEBUG nova.compute.manager [req-eed66f59-8809-4ffe-8b61-af1f512e09c4 req-e7d3973a-d314-4acb-b63e-cec1c72d25ea service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] No waiting events found dispatching network-vif-unplugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:59:56 user nova-compute[75247]: WARNING nova.compute.manager [req-eed66f59-8809-4ffe-8b61-af1f512e09c4 req-e7d3973a-d314-4acb-b63e-cec1c72d25ea service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received unexpected event network-vif-unplugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 for instance with vm_state active and task_state rescuing.
Dec 06 12:59:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:56 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Instance destroyed successfully.
Dec 06 12:59:56 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Attempting rescue
Dec 06 12:59:56 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75247) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 06 12:59:56 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Instance directory exists: not creating {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 06 12:59:56 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Creating image(s)
Dec 06 12:59:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "/opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "/opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "/opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:56 user nova-compute[75247]: DEBUG nova.objects.instance [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'trusted_certs' on Instance uuid 16dd787d-6abe-48f3-ac3c-fd55853b4e23 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:59:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.190s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk.rescue {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk.rescue" returned: 0 in 0.049s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.objects.instance [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'migration_context' on Instance uuid 16dd787d-6abe-48f3-ac3c-fd55853b4e23 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.objects.base [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Object Instance<16dd787d-6abe-48f3-ac3c-fd55853b4e23> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Start _get_guest_xml network_info=[{"id": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "address": "fa:16:3e:f9:7b:5b", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "vif_mac": "fa:16:3e:f9:7b:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8804e1-c0", "ovs_interfaceid": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.objects.instance [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'resources' on Instance uuid 16dd787d-6abe-48f3-ac3c-fd55853b4e23 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.objects.base [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Object Instance<16dd787d-6abe-48f3-ac3c-fd55853b4e23> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.objects.instance [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'numa_topology' on Instance uuid 16dd787d-6abe-48f3-ac3c-fd55853b4e23 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.objects.base [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Object Instance<16dd787d-6abe-48f3-ac3c-fd55853b4e23> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:59:57 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:59:57 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.objects.instance [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'vcpu_model' on Instance uuid 16dd787d-6abe-48f3-ac3c-fd55853b4e23 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.objects.base [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Object Instance<16dd787d-6abe-48f3-ac3c-fd55853b4e23> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-149152184',display_name='tempest-ServerRescueNegativeTestJSON-server-149152184',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-149152184',id=39,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3vBCyE6q5nI66WXDqfmPgjhRHEH8SIKzGzERVNDwjRqS88kAZzFoeCZqEn8fKloo/IDS4Ul1cGss1JK9h0KmMVz4QwDFTCNUHkpu02hNM01o6i8wM7G4pctSEySvLrUg==',key_name='tempest-keypair-1978844049',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:57:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b253fd3ef3284dd885d3a0efc1ec07d7',ramdisk_id='',reservation_id='r-pl392su4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-295230580',owner_user_name='tempest-ServerRescueNegativeTestJSON-295230580-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T12:57:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='deac43cb03b440ff9de75801065ec9af',uuid=16dd787d-6abe-48f3-ac3c-fd55853b4e23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "address": "fa:16:3e:f9:7b:5b", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "vif_mac": "fa:16:3e:f9:7b:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8804e1-c0", "ovs_interfaceid": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Converting VIF {"id": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "address": "fa:16:3e:f9:7b:5b", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "vif_mac": "fa:16:3e:f9:7b:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8804e1-c0", "ovs_interfaceid": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:7b:5b,bridge_name='br-int',has_traffic_filtering=True,id=3a8804e1-c0a2-4f4a-941e-5fc617f45d93,network=Network(579972e2-9933-47d9-b56b-f64b5650d611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8804e1-c0') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.objects.instance [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'pci_devices' on Instance uuid 16dd787d-6abe-48f3-ac3c-fd55853b4e23 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.objects.base [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Object Instance<16dd787d-6abe-48f3-ac3c-fd55853b4e23> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] End _get_guest_xml xml=<domain type="kvm">
Dec 06 12:59:57 user nova-compute[75247]:   <uuid>16dd787d-6abe-48f3-ac3c-fd55853b4e23</uuid>
Dec 06 12:59:57 user nova-compute[75247]:   <name>instance-00000027</name>
Dec 06 12:59:57 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 12:59:57 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 12:59:57 user nova-compute[75247]:   <metadata>
Dec 06 12:59:57 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 12:59:57 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 12:59:57 user nova-compute[75247]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-149152184</nova:name>
Dec 06 12:59:57 user nova-compute[75247]:       <nova:creationTime>2023-12-06 12:59:57</nova:creationTime>
Dec 06 12:59:57 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 12:59:57 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 12:59:57 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 12:59:57 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 12:59:57 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 12:59:57 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 12:59:57 user nova-compute[75247]:       </nova:flavor>
Dec 06 12:59:57 user nova-compute[75247]:       <nova:owner>
Dec 06 12:59:57 user nova-compute[75247]:         <nova:user uuid="deac43cb03b440ff9de75801065ec9af">tempest-ServerRescueNegativeTestJSON-295230580-project-member</nova:user>
Dec 06 12:59:57 user nova-compute[75247]:         <nova:project uuid="b253fd3ef3284dd885d3a0efc1ec07d7">tempest-ServerRescueNegativeTestJSON-295230580</nova:project>
Dec 06 12:59:57 user nova-compute[75247]:       </nova:owner>
Dec 06 12:59:57 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 12:59:57 user nova-compute[75247]:       <nova:ports>
Dec 06 12:59:57 user nova-compute[75247]:         <nova:port uuid="3a8804e1-c0a2-4f4a-941e-5fc617f45d93">
Dec 06 12:59:57 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 06 12:59:57 user nova-compute[75247]:         </nova:port>
Dec 06 12:59:57 user nova-compute[75247]:       </nova:ports>
Dec 06 12:59:57 user nova-compute[75247]:     </nova:instance>
Dec 06 12:59:57 user nova-compute[75247]:   </metadata>
Dec 06 12:59:57 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 12:59:57 user nova-compute[75247]:     <system>
Dec 06 12:59:57 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 12:59:57 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 12:59:57 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 12:59:57 user nova-compute[75247]:       <entry name="serial">16dd787d-6abe-48f3-ac3c-fd55853b4e23</entry>
Dec 06 12:59:57 user nova-compute[75247]:       <entry name="uuid">16dd787d-6abe-48f3-ac3c-fd55853b4e23</entry>
Dec 06 12:59:57 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 12:59:57 user nova-compute[75247]:     </system>
Dec 06 12:59:57 user nova-compute[75247]:   </sysinfo>
Dec 06 12:59:57 user nova-compute[75247]:   <os>
Dec 06 12:59:57 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 12:59:57 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 12:59:57 user nova-compute[75247]:   </os>
Dec 06 12:59:57 user nova-compute[75247]:   <features>
Dec 06 12:59:57 user nova-compute[75247]:     <acpi/>
Dec 06 12:59:57 user nova-compute[75247]:     <apic/>
Dec 06 12:59:57 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 12:59:57 user nova-compute[75247]:   </features>
Dec 06 12:59:57 user nova-compute[75247]:   <clock offset="utc">
Dec 06 12:59:57 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 12:59:57 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 12:59:57 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 12:59:57 user nova-compute[75247]:   </clock>
Dec 06 12:59:57 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 12:59:57 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 12:59:57 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 12:59:57 user nova-compute[75247]:   </cpu>
Dec 06 12:59:57 user nova-compute[75247]:   <devices>
Dec 06 12:59:57 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:59:57 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:59:57 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk.rescue"/>
Dec 06 12:59:57 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 12:59:57 user nova-compute[75247]:     </disk>
Dec 06 12:59:57 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 12:59:57 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 12:59:57 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk"/>
Dec 06 12:59:57 user nova-compute[75247]:       <target dev="vdb" bus="virtio"/>
Dec 06 12:59:57 user nova-compute[75247]:     </disk>
Dec 06 12:59:57 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 12:59:57 user nova-compute[75247]:       <mac address="fa:16:3e:f9:7b:5b"/>
Dec 06 12:59:57 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:59:57 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 12:59:57 user nova-compute[75247]:       <target dev="tap3a8804e1-c0"/>
Dec 06 12:59:57 user nova-compute[75247]:     </interface>
Dec 06 12:59:57 user nova-compute[75247]:     <serial type="pty">
Dec 06 12:59:57 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/console.log" append="off"/>
Dec 06 12:59:57 user nova-compute[75247]:     </serial>
Dec 06 12:59:57 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 12:59:57 user nova-compute[75247]:     <video>
Dec 06 12:59:57 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 12:59:57 user nova-compute[75247]:     </video>
Dec 06 12:59:57 user nova-compute[75247]:     <rng model="virtio">
Dec 06 12:59:57 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 12:59:57 user nova-compute[75247]:     </rng>
Dec 06 12:59:57 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 12:59:57 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 12:59:57 user nova-compute[75247]:       <stats period="10"/>
Dec 06 12:59:57 user nova-compute[75247]:     </memballoon>
Dec 06 12:59:57 user nova-compute[75247]:   </devices>
Dec 06 12:59:57 user nova-compute[75247]: </domain>
Dec 06 12:59:57 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 12:59:57 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Instance destroyed successfully.
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 12:59:57 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] No VIF found with MAC fa:16:3e:f9:7b:5b, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 12:59:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:58 user nova-compute[75247]: DEBUG nova.compute.manager [req-89316887-ce9e-451b-8795-0efc217a881c req-b5a2118e-0d76-479e-8053-9aab77b5c4d2 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received event network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 12:59:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-89316887-ce9e-451b-8795-0efc217a881c req-b5a2118e-0d76-479e-8053-9aab77b5c4d2 service nova] Acquiring lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 12:59:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-89316887-ce9e-451b-8795-0efc217a881c req-b5a2118e-0d76-479e-8053-9aab77b5c4d2 service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 12:59:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-89316887-ce9e-451b-8795-0efc217a881c req-b5a2118e-0d76-479e-8053-9aab77b5c4d2 service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 12:59:58 user nova-compute[75247]: DEBUG nova.compute.manager [req-89316887-ce9e-451b-8795-0efc217a881c req-b5a2118e-0d76-479e-8053-9aab77b5c4d2 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] No waiting events found dispatching network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 12:59:58 user nova-compute[75247]: WARNING nova.compute.manager [req-89316887-ce9e-451b-8795-0efc217a881c req-b5a2118e-0d76-479e-8053-9aab77b5c4d2 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received unexpected event network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 for instance with vm_state active and task_state rescuing.
Dec 06 12:59:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JsRTSPxb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:59:59 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:59:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:59:59 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:59:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 12:59:59 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac56604-5461-498e-901d-0ed065f61173]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 12:59:59 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[675973c9-27d0-419f-900e-19f51f73ea91]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099] added
Dec 06 12:59:59 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:59 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f5b69324-579d-4833-9bb4-c43c511f820d is timed out.
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf5e711-4416-4a87-b6de-5ea7801d8c8f]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:59 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Successfully detached device vdb from instance f5b69324-579d-4833-9bb4-c43c511f820d from the live domain config.
Dec 06 12:59:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fde36a7-8ebf-4f10-bee2-6429f394aed9]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITkQEJgw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 12:59:59 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 12:59:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JsRTSPxb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JsRTSPxb" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f3d0fa-7363-4014-b0ba-bdadb60fa400]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JsRTSPxb'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a92bd0-84f3-4823-bf46-e43acbce3598]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[df904706-f6be-4030-ab84-5abeb87b5b40]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e1970-1107-4d19-b52b-cc2bb593aa5e (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc (non-flash)
Dec 06 12:59:59 user nova-compute[75247]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e1970-1107-4d19-b52b-cc2bb593aa5e (non-flash)
Dec 06 12:59:59 user nova-compute[75247]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)
Dec 06 12:59:59 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc (non-flash)
Dec 06 12:59:59 user nova-compute[75247]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e1970-1107-4d19-b52b-cc2bb593aa5e (non-flash)
Dec 06 12:59:59 user nova-compute[75247]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)
Dec 06 12:59:59 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6823273e-a6e3-43d2-95b7-c9ed7245ff3c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099, portal: 172.16.0.220,3260]
Dec 06 12:59:59 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099, portal: 172.16.0.220,3260] successful.
Dec 06 12:59:59 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccba3296-b466-4605-97a1-b7127e26479c]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53a348c-df17-4043-a280-262ab8fdf944]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e1970-1107-4d19-b52b-cc2bb593aa5e (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc (non-flash)
Dec 06 12:59:59 user nova-compute[75247]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e1970-1107-4d19-b52b-cc2bb593aa5e (non-flash)
Dec 06 12:59:59 user nova-compute[75247]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)
Dec 06 12:59:59 user nova-compute[75247]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 (non-flash)
Dec 06 12:59:59 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc (non-flash)
Dec 06 12:59:59 user nova-compute[75247]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e1970-1107-4d19-b52b-cc2bb593aa5e (non-flash)
Dec 06 12:59:59 user nova-compute[75247]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)
Dec 06 12:59:59 user nova-compute[75247]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 (non-flash)
Dec 06 12:59:59 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] HCTL ('36', '-', '-', 0) found on session 49 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2360bc96-0840-4242-a2f2-2d40c0cef6d6]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JsRTSPxb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 12:59:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23237643735363934', 'path': '/dev/sde'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237643735363934', 'path': '/dev/sde'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.262s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG nova.objects.instance [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lazy-loading 'flavor' on Instance uuid e1f21135-43cd-4dbb-ae7a-b12dffdc5816 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0caaef6-8324-40eb-b249-e1a2358b5d6e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:785e1970-1107-4d19-b52b-cc2bb593aa5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 13:00:00 user nova-compute[75247]: No targets found.
Dec 06 13:00:00 user nova-compute[75247]: iSNS:
Dec 06 13:00:00 user nova-compute[75247]: No targets found.
Dec 06 13:00:00 user nova-compute[75247]: STATIC:
Dec 06 13:00:00 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:785e1970-1107-4d19-b52b-cc2bb593aa5e
Dec 06 13:00:00 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:00:00 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:00:00 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099
Dec 06 13:00:00 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:00:00 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:00:00 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc
Dec 06 13:00:00 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:00:00 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:00:00 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa
Dec 06 13:00:00 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:00:00 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:00:00 user nova-compute[75247]: FIRMWARE:
Dec 06 13:00:00 user nova-compute[75247]: No targets found.
Dec 06 13:00:00 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 13:00:00 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 13:00:00 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cee8f6c-8a76-4fbc-962b-431aedd1dea0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:785e1970-1107-4d19-b52b-cc2bb593aa5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 13:00:00 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:00:00 user nova-compute[75247]:   <source dev="/dev/sde"/>
Dec 06 13:00:00 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 13:00:00 user nova-compute[75247]:   <serial>ca217b52-78b5-4b84-a972-695d4d67a099</serial>
Dec 06 13:00:00 user nova-compute[75247]: </disk>
Dec 06 13:00:00 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f1b2ed-c978-40b2-a5b9-41d1701eb218]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e1970-1107-4d19-b52b-cc2bb593aa5e (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc (non-flash)
Dec 06 13:00:00 user nova-compute[75247]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e1970-1107-4d19-b52b-cc2bb593aa5e (non-flash)
Dec 06 13:00:00 user nova-compute[75247]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)
Dec 06 13:00:00 user nova-compute[75247]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 (non-flash)
Dec 06 13:00:00 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc (non-flash)
Dec 06 13:00:00 user nova-compute[75247]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e1970-1107-4d19-b52b-cc2bb593aa5e (non-flash)
Dec 06 13:00:00 user nova-compute[75247]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)
Dec 06 13:00:00 user nova-compute[75247]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 (non-flash)
Dec 06 13:00:00 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd7304cf130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc'): ({'sdb'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Removing single pathed devices sdb {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[028737a2-74bc-4616-9471-dae352ace095]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5e6259-8f94-4322-abfb-436ac1d37c79]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Flushing IO for device /dev/sdb {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c720dee9-b998-40b1-aaef-22384b9b97d1]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b41f5b-3e90-477b-b1b8-ab89e463cdfc]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c565f269-f384-4d2c-b9be-5bce3b0cbe79]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG nova.compute.manager [req-b9b7798e-3bd4-4bff-81f2-4c678ff5af2f req-1c4cfa64-1c0c-4712-abb6-ce0f1da901e3 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received event network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b9b7798e-3bd4-4bff-81f2-4c678ff5af2f req-1c4cfa64-1c0c-4712-abb6-ce0f1da901e3 service nova] Acquiring lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b9b7798e-3bd4-4bff-81f2-4c678ff5af2f req-1c4cfa64-1c0c-4712-abb6-ce0f1da901e3 service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b9b7798e-3bd4-4bff-81f2-4c678ff5af2f req-1c4cfa64-1c0c-4712-abb6-ce0f1da901e3 service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG nova.compute.manager [req-b9b7798e-3bd4-4bff-81f2-4c678ff5af2f req-1c4cfa64-1c0c-4712-abb6-ce0f1da901e3 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] No waiting events found dispatching network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:00:00 user nova-compute[75247]: WARNING nova.compute.manager [req-b9b7798e-3bd4-4bff-81f2-4c678ff5af2f req-1c4cfa64-1c0c-4712-abb6-ce0f1da901e3 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received unexpected event network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 for instance with vm_state active and task_state rescuing.
Dec 06 13:00:00 user nova-compute[75247]: DEBUG nova.compute.manager [req-b9b7798e-3bd4-4bff-81f2-4c678ff5af2f req-1c4cfa64-1c0c-4712-abb6-ce0f1da901e3 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received event network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b9b7798e-3bd4-4bff-81f2-4c678ff5af2f req-1c4cfa64-1c0c-4712-abb6-ce0f1da901e3 service nova] Acquiring lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b9b7798e-3bd4-4bff-81f2-4c678ff5af2f req-1c4cfa64-1c0c-4712-abb6-ce0f1da901e3 service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b9b7798e-3bd4-4bff-81f2-4c678ff5af2f req-1c4cfa64-1c0c-4712-abb6-ce0f1da901e3 service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG nova.compute.manager [req-b9b7798e-3bd4-4bff-81f2-4c678ff5af2f req-1c4cfa64-1c0c-4712-abb6-ce0f1da901e3 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] No waiting events found dispatching network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:00:00 user nova-compute[75247]: WARNING nova.compute.manager [req-b9b7798e-3bd4-4bff-81f2-4c678ff5af2f req-1c4cfa64-1c0c-4712-abb6-ce0f1da901e3 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received unexpected event network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 for instance with vm_state active and task_state rescuing.
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[634dd68f-fb4c-4358-acf0-18f54667927a]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc, portal: 172.16.0.220,3260]
Dec 06 13:00:00 user nova-compute[75247]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc, portal: 172.16.0.220,3260] successful.
Dec 06 13:00:00 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9998-3aaf-4ba5-a932-f6f77332c9dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f5e659-d775-4c1d-a27b-c1c851e633a3]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] <== disconnect_volume: return (1637ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:00:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 13:00:01 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:00:01 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:00:01 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] No VIF found with MAC fa:16:3e:d6:b6:ce, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 13:00:01 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-3862781a-c7b5-488d-9243-08bcd7e0c4b4 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.133s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:00:01 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6522c09b-3101-4dc4-84cf-555e7468c924 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 13:00:01 user nova-compute[75247]: DEBUG nova.objects.instance [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lazy-loading 'flavor' on Instance uuid f5b69324-579d-4833-9bb4-c43c511f820d {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:00:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6eda37c7-a77b-4ebb-9cae-6a0cb387faea tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.356s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:00:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:00:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:00:05 user nova-compute[75247]: INFO nova.compute.manager [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Detaching volume ca217b52-78b5-4b84-a972-695d4d67a099
Dec 06 13:00:06 user nova-compute[75247]: INFO nova.virt.block_device [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Attempting to driver detach volume ca217b52-78b5-4b84-a972-695d4d67a099 from mountpoint /dev/vdb
Dec 06 13:00:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Attempting to detach device vdb from instance e1f21135-43cd-4dbb-ae7a-b12dffdc5816 from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 13:00:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 13:00:06 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:00:06 user nova-compute[75247]:   <source dev="/dev/sde"/>
Dec 06 13:00:06 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 13:00:06 user nova-compute[75247]:   <serial>ca217b52-78b5-4b84-a972-695d4d67a099</serial>
Dec 06 13:00:06 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 13:00:06 user nova-compute[75247]: </disk>
Dec 06 13:00:06 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 13:00:06 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Successfully detached device vdb from instance e1f21135-43cd-4dbb-ae7a-b12dffdc5816 from the persistent domain config.
Dec 06 13:00:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e1f21135-43cd-4dbb-ae7a-b12dffdc5816 from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 13:00:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 13:00:06 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:00:06 user nova-compute[75247]:   <source dev="/dev/sde"/>
Dec 06 13:00:06 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 13:00:06 user nova-compute[75247]:   <serial>ca217b52-78b5-4b84-a972-695d4d67a099</serial>
Dec 06 13:00:06 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 13:00:06 user nova-compute[75247]: </disk>
Dec 06 13:00:06 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 13:00:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-777dc50a-969c-4395-b727-37c740d0a6e6 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Acquiring lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:00:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-777dc50a-969c-4395-b727-37c740d0a6e6 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:00:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-777dc50a-969c-4395-b727-37c740d0a6e6 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Acquiring lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:00:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-777dc50a-969c-4395-b727-37c740d0a6e6 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:00:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-777dc50a-969c-4395-b727-37c740d0a6e6 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.008s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:00:06 user nova-compute[75247]: INFO nova.compute.manager [None req-777dc50a-969c-4395-b727-37c740d0a6e6 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Terminating instance
Dec 06 13:00:06 user nova-compute[75247]: DEBUG nova.compute.manager [None req-777dc50a-969c-4395-b727-37c740d0a6e6 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 13:00:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:06 user nova-compute[75247]: DEBUG nova.compute.manager [req-d6a72d1b-51be-4969-8694-08ce88473869 req-d89000f9-05c1-4cc5-90ba-5f0bb2dd913e service nova] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Received event network-vif-unplugged-9674b746-bc7e-4ca4-bb83-28ac0adb21c4 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:00:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d6a72d1b-51be-4969-8694-08ce88473869 req-d89000f9-05c1-4cc5-90ba-5f0bb2dd913e service nova] Acquiring lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:00:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d6a72d1b-51be-4969-8694-08ce88473869 req-d89000f9-05c1-4cc5-90ba-5f0bb2dd913e service nova] Lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:00:06 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d6a72d1b-51be-4969-8694-08ce88473869 req-d89000f9-05c1-4cc5-90ba-5f0bb2dd913e service nova] Lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:00:06 user nova-compute[75247]: DEBUG nova.compute.manager [req-d6a72d1b-51be-4969-8694-08ce88473869 req-d89000f9-05c1-4cc5-90ba-5f0bb2dd913e service nova] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] No waiting events found dispatching network-vif-unplugged-9674b746-bc7e-4ca4-bb83-28ac0adb21c4 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:00:06 user nova-compute[75247]: DEBUG nova.compute.manager [req-d6a72d1b-51be-4969-8694-08ce88473869 req-d89000f9-05c1-4cc5-90ba-5f0bb2dd913e service nova] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Received event network-vif-unplugged-9674b746-bc7e-4ca4-bb83-28ac0adb21c4 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 13:00:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e1f21135-43cd-4dbb-ae7a-b12dffdc5816 {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 13:00:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:07 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Instance destroyed successfully.
Dec 06 13:00:07 user nova-compute[75247]: DEBUG nova.objects.instance [None req-777dc50a-969c-4395-b727-37c740d0a6e6 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lazy-loading 'resources' on Instance uuid 3b8adc91-c4d4-4484-bd4e-cc3d356338c7 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:00:07 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-777dc50a-969c-4395-b727-37c740d0a6e6 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:57:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1289572704',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1289572704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1289572',id=38,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCok9NvOooBJ0H7CDFBEeZKI9GDOYkZFcgAbZTOkxHJGta2U+DO7HsT+Q9ih1zB+bwZtvnotX+hyor4L+o+0Bv5yo4QvZGaUIIfRr9BKw4kq/JnMES4bETI2UYLaK2TEvw==',key_name='tempest-keypair-1585112285',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:57:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc47c1410bde45648e4c65ea542b12d8',ramdisk_id='',reservation_id='r-1xnktcy5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2001652438',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:57:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72f8d05774464eb1b7043e2c945ec1ff',uuid=3b8adc91-c4d4-4484-bd4e-cc3d356338c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9674b746-bc7e-4ca4-bb83-28ac0adb21c4", "address": "fa:16:3e:1a:02:be", "network": {"id": "3e1570a1-1d0a-4f71-b103-39a83a25c7a1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1788872216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc47c1410bde45648e4c65ea542b12d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9674b746-bc", "ovs_interfaceid": "9674b746-bc7e-4ca4-bb83-28ac0adb21c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 13:00:07 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-777dc50a-969c-4395-b727-37c740d0a6e6 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Converting VIF {"id": "9674b746-bc7e-4ca4-bb83-28ac0adb21c4", "address": "fa:16:3e:1a:02:be", "network": {"id": "3e1570a1-1d0a-4f71-b103-39a83a25c7a1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1788872216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc47c1410bde45648e4c65ea542b12d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9674b746-bc", "ovs_interfaceid": "9674b746-bc7e-4ca4-bb83-28ac0adb21c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:00:07 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-777dc50a-969c-4395-b727-37c740d0a6e6 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:02:be,bridge_name='br-int',has_traffic_filtering=True,id=9674b746-bc7e-4ca4-bb83-28ac0adb21c4,network=Network(3e1570a1-1d0a-4f71-b103-39a83a25c7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9674b746-bc') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:00:07 user nova-compute[75247]: DEBUG os_vif [None req-777dc50a-969c-4395-b727-37c740d0a6e6 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:02:be,bridge_name='br-int',has_traffic_filtering=True,id=9674b746-bc7e-4ca4-bb83-28ac0adb21c4,network=Network(3e1570a1-1d0a-4f71-b103-39a83a25c7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9674b746-bc') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 13:00:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9674b746-bc, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:00:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:00:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d122608-41f6-43ee-9766-fb6dce70c059) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:00:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:00:07 user nova-compute[75247]: INFO os_vif [None req-777dc50a-969c-4395-b727-37c740d0a6e6 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:02:be,bridge_name='br-int',has_traffic_filtering=True,id=9674b746-bc7e-4ca4-bb83-28ac0adb21c4,network=Network(3e1570a1-1d0a-4f71-b103-39a83a25c7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9674b746-bc')
Dec 06 13:00:07 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-777dc50a-969c-4395-b727-37c740d0a6e6 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Deleting instance files /opt/stack/data/nova/instances/3b8adc91-c4d4-4484-bd4e-cc3d356338c7_del
Dec 06 13:00:07 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-777dc50a-969c-4395-b727-37c740d0a6e6 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Deletion of /opt/stack/data/nova/instances/3b8adc91-c4d4-4484-bd4e-cc3d356338c7_del complete
Dec 06 13:00:07 user nova-compute[75247]: INFO nova.compute.manager [None req-777dc50a-969c-4395-b727-37c740d0a6e6 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Took 1.57 seconds to destroy the instance on the hypervisor.
Dec 06 13:00:07 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-777dc50a-969c-4395-b727-37c740d0a6e6 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 13:00:07 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 13:00:07 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 13:00:08 user nova-compute[75247]: DEBUG nova.compute.manager [req-40de8f92-a31e-491b-ab23-1901fe3da2e5 req-739febbe-d8ee-4a1e-9249-5bb752b30ae7 service nova] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Received event network-vif-plugged-9674b746-bc7e-4ca4-bb83-28ac0adb21c4 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:00:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-40de8f92-a31e-491b-ab23-1901fe3da2e5 req-739febbe-d8ee-4a1e-9249-5bb752b30ae7 service nova] Acquiring lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:00:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-40de8f92-a31e-491b-ab23-1901fe3da2e5 req-739febbe-d8ee-4a1e-9249-5bb752b30ae7 service nova] Lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:00:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-40de8f92-a31e-491b-ab23-1901fe3da2e5 req-739febbe-d8ee-4a1e-9249-5bb752b30ae7 service nova] Lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:00:08 user nova-compute[75247]: DEBUG nova.compute.manager [req-40de8f92-a31e-491b-ab23-1901fe3da2e5 req-739febbe-d8ee-4a1e-9249-5bb752b30ae7 service nova] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] No waiting events found dispatching network-vif-plugged-9674b746-bc7e-4ca4-bb83-28ac0adb21c4 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:00:08 user nova-compute[75247]: WARNING nova.compute.manager [req-40de8f92-a31e-491b-ab23-1901fe3da2e5 req-739febbe-d8ee-4a1e-9249-5bb752b30ae7 service nova] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Received unexpected event network-vif-plugged-9674b746-bc7e-4ca4-bb83-28ac0adb21c4 for instance with vm_state active and task_state deleting.
Dec 06 13:00:09 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:00:09 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Took 1.37 seconds to deallocate network for instance.
Dec 06 13:00:09 user nova-compute[75247]: DEBUG nova.compute.manager [req-c413c8da-7891-4093-9475-84818513e3b8 req-d80bb259-079d-431d-91fc-4333e7555410 service nova] [instance: 3b8adc91-c4d4-4484-bd4e-cc3d356338c7] Received event network-vif-deleted-9674b746-bc7e-4ca4-bb83-28ac0adb21c4 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:00:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-777dc50a-969c-4395-b727-37c740d0a6e6 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:00:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-777dc50a-969c-4395-b727-37c740d0a6e6 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:00:09 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-777dc50a-969c-4395-b727-37c740d0a6e6 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:00:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:09 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-777dc50a-969c-4395-b727-37c740d0a6e6 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:00:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-777dc50a-969c-4395-b727-37c740d0a6e6 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:00:09 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-777dc50a-969c-4395-b727-37c740d0a6e6 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Deleted allocations for instance 3b8adc91-c4d4-4484-bd4e-cc3d356338c7
Dec 06 13:00:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-777dc50a-969c-4395-b727-37c740d0a6e6 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438 tempest-TestServerVolumeAttachScenarioOldVersion-2001652438-project-member] Lock "3b8adc91-c4d4-4484-bd4e-cc3d356338c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.528s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:00:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:19 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:00:19 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:00:19 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:00:19 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:00:19 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:00:19 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:00:20 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:00:20 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:00:21 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:00:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:00:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:00:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:00:21 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:00:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:00:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:25 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:00:25 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:00:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=8111MB free_disk=25.124897003173828GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:00:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:00:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:00:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance bc3ddb40-b05f-4170-b269-d44dec6ecdaf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:00:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 530cfb75-7aa8-4e57-b282-8f7a21401b34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:00:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance f5b69324-579d-4833-9bb4-c43c511f820d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:00:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance c603d6dc-804e-4c0d-be1f-40e09de74e8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:00:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 16dd787d-6abe-48f3-ac3c-fd55853b4e23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:00:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance e1f21135-43cd-4dbb-ae7a-b12dffdc5816 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:00:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:00:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:00:25 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:00:25 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:00:25 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:00:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.364s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 13:00:26 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e1f21135-43cd-4dbb-ae7a-b12dffdc5816 is timed out.
Dec 06 13:00:26 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Successfully detached device vdb from instance e1f21135-43cd-4dbb-ae7a-b12dffdc5816 from the live domain config.
Dec 06 13:00:26 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JsRTSPxb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:00:26 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:00:26 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-bc3ddb40-b05f-4170-b269-d44dec6ecdaf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-bc3ddb40-b05f-4170-b269-d44dec6ecdaf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lazy-loading 'info_cache' on Instance uuid bc3ddb40-b05f-4170-b269-d44dec6ecdaf {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa67b0d0-5506-4014-bff5-13c39a17c57a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 13:00:26 user nova-compute[75247]: No targets found.
Dec 06 13:00:26 user nova-compute[75247]: iSNS:
Dec 06 13:00:26 user nova-compute[75247]: No targets found.
Dec 06 13:00:26 user nova-compute[75247]: STATIC:
Dec 06 13:00:26 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099
Dec 06 13:00:26 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:00:26 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:00:26 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa
Dec 06 13:00:26 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:00:26 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:00:26 user nova-compute[75247]: FIRMWARE:
Dec 06 13:00:26 user nova-compute[75247]: No targets found.
Dec 06 13:00:26 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 13:00:26 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 13:00:26 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d46ff83-1f5b-4c87-aaae-cd5889d8f7dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[80824e4b-28cb-4823-a5d0-ecb51297b68b]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)
Dec 06 13:00:26 user nova-compute[75247]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 (non-flash)
Dec 06 13:00:26 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)
Dec 06 13:00:26 user nova-compute[75247]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 (non-flash)
Dec 06 13:00:26 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd7480e3880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099'): ({'sde'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Removing single pathed devices sde {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf791cb-540c-4023-8624-8e27397b81cc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a459986d-52eb-4459-bac8-f42edb29e800]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Flushing IO for device /dev/sde {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1439c41a-08bc-4778-b72f-c40902f17908]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 13:00:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b4e6ff-7359-4d7e-8143-70fa697e8bb5]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:00:27 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 13:00:27 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] SCSI volumes sde have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 13:00:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 13:00:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.118s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95771eb-debc-427a-99f9-d0f2edc89653]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:00:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:00:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7784c1b-f6e7-4565-b282-a758045cdb05]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:00:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099, portal: 172.16.0.220,3260]
Dec 06 13:00:27 user nova-compute[75247]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099, portal: 172.16.0.220,3260] successful.
Dec 06 13:00:27 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:00:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:00:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca217b52-78b5-4b84-a972-695d4d67a099 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:00:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cbafd6-3b86-4414-ae3c-155ca5849772]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:00:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:00:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.483s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:00:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] <== disconnect_volume: return (487ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:00:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 13:00:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:27 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Updating instance_info_cache with network_info: [{"id": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "address": "fa:16:3e:d5:71:f5", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e66d0f0-cc", "ovs_interfaceid": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:00:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-bc3ddb40-b05f-4170-b269-d44dec6ecdaf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:00:27 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 13:00:27 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:00:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:29 user nova-compute[75247]: DEBUG nova.objects.instance [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lazy-loading 'flavor' on Instance uuid e1f21135-43cd-4dbb-ae7a-b12dffdc5816 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:00:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7751d527-3af9-4f99-8871-e9f1ce2174e1 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.824s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:00:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:00:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:00:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:00:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:00:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:00:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:01:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:02 user nova-compute[75247]: DEBUG nova.compute.manager [None req-9bbdaf31-1664-4c08-9883-28f0d6766d1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 13:01:02 user nova-compute[75247]: INFO nova.compute.manager [None req-9bbdaf31-1664-4c08-9883-28f0d6766d1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] instance snapshotting
Dec 06 13:01:02 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-9bbdaf31-1664-4c08-9883-28f0d6766d1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Beginning live snapshot process
Dec 06 13:01:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-9bbdaf31-1664-4c08-9883-28f0d6766d1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json -f qcow2 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:01:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-9bbdaf31-1664-4c08-9883-28f0d6766d1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json -f qcow2" returned: 0 in 0.202s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:01:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-9bbdaf31-1664-4c08-9883-28f0d6766d1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json -f qcow2 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:01:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-9bbdaf31-1664-4c08-9883-28f0d6766d1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:01:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-9bbdaf31-1664-4c08-9883-28f0d6766d1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:01:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-9bbdaf31-1664-4c08-9883-28f0d6766d1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.190s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:01:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-9bbdaf31-1664-4c08-9883-28f0d6766d1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0j5hvdoe/ee4649fc2bcb4fcfa89c3f555be6bf26.delta 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:01:03 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-9bbdaf31-1664-4c08-9883-28f0d6766d1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0j5hvdoe/ee4649fc2bcb4fcfa89c3f555be6bf26.delta 1073741824" returned: 0 in 0.055s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:01:03 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-9bbdaf31-1664-4c08-9883-28f0d6766d1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 06 13:01:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-9bbdaf31-1664-4c08-9883-28f0d6766d1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 13:01:05 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-9bbdaf31-1664-4c08-9883-28f0d6766d1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] COPY block job progress, current cursor: 26607616 final cursor: 75563008 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 13:01:05 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-9bbdaf31-1664-4c08-9883-28f0d6766d1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75247) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 13:01:05 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-9bbdaf31-1664-4c08-9883-28f0d6766d1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 06 13:01:05 user nova-compute[75247]: DEBUG nova.privsep.utils [None req-9bbdaf31-1664-4c08-9883-28f0d6766d1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 13:01:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-9bbdaf31-1664-4c08-9883-28f0d6766d1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0j5hvdoe/ee4649fc2bcb4fcfa89c3f555be6bf26.delta /opt/stack/data/nova/instances/snapshots/tmp0j5hvdoe/ee4649fc2bcb4fcfa89c3f555be6bf26 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:01:06 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-9bbdaf31-1664-4c08-9883-28f0d6766d1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0j5hvdoe/ee4649fc2bcb4fcfa89c3f555be6bf26.delta /opt/stack/data/nova/instances/snapshots/tmp0j5hvdoe/ee4649fc2bcb4fcfa89c3f555be6bf26" returned: 0 in 0.746s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:01:06 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-9bbdaf31-1664-4c08-9883-28f0d6766d1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Snapshot extracted, beginning image upload
Dec 06 13:01:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:09 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-9bbdaf31-1664-4c08-9883-28f0d6766d1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Snapshot image upload complete
Dec 06 13:01:09 user nova-compute[75247]: INFO nova.compute.manager [None req-9bbdaf31-1664-4c08-9883-28f0d6766d1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Took 7.10 seconds to snapshot the instance on the hypervisor.
Dec 06 13:01:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "0bd88196-5493-434b-a3ba-0146f81dacea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:01:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "0bd88196-5493-434b-a3ba-0146f81dacea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:01:12 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 13:01:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:01:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:01:12 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 13:01:12 user nova-compute[75247]: INFO nova.compute.claims [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Claim successful on node user
Dec 06 13:01:12 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:01:12 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:01:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:01:13 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 13:01:13 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 13:01:13 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 13:01:13 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 13:01:13 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 13:01:13 user nova-compute[75247]: DEBUG nova.policy [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ac9a9c6e8f34a828c737e8b45da7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f3c1de288423e8964c31ca35664c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 13:01:13 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 13:01:13 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 13:01:13 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Creating image(s)
Dec 06 13:01:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "/opt/stack/data/nova/instances/0bd88196-5493-434b-a3ba-0146f81dacea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:01:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "/opt/stack/data/nova/instances/0bd88196-5493-434b-a3ba-0146f81dacea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:01:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "/opt/stack/data/nova/instances/0bd88196-5493-434b-a3ba-0146f81dacea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:01:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "0ab9a4e95586e925c511739ede48d6c97c1e178e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:01:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "0ab9a4e95586e925c511739ede48d6c97c1e178e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:01:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ab9a4e95586e925c511739ede48d6c97c1e178e.part --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:01:14 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:01:14 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75247) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 13:01:14 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Successfully created port: 2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 13:01:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83574370-c12f-4f70-86f1-17fa4720676d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "f5b69324-579d-4833-9bb4-c43c511f820d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:01:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83574370-c12f-4f70-86f1-17fa4720676d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:01:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83574370-c12f-4f70-86f1-17fa4720676d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "f5b69324-579d-4833-9bb4-c43c511f820d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:01:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83574370-c12f-4f70-86f1-17fa4720676d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:01:14 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83574370-c12f-4f70-86f1-17fa4720676d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:01:14 user nova-compute[75247]: INFO nova.compute.manager [None req-83574370-c12f-4f70-86f1-17fa4720676d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Terminating instance
Dec 06 13:01:14 user nova-compute[75247]: DEBUG nova.compute.manager [None req-83574370-c12f-4f70-86f1-17fa4720676d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 13:01:14 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ab9a4e95586e925c511739ede48d6c97c1e178e.part --force-share --output=json" returned: 0 in 0.198s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:01:14 user nova-compute[75247]: DEBUG nova.virt.images [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] 7f0f6867-a1f0-457b-b543-4f260951a4fc was qcow2, converting to raw {{(pid=75247) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG nova.privsep.utils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0ab9a4e95586e925c511739ede48d6c97c1e178e.part /opt/stack/data/nova/instances/_base/0ab9a4e95586e925c511739ede48d6c97c1e178e.converted {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0ab9a4e95586e925c511739ede48d6c97c1e178e.part /opt/stack/data/nova/instances/_base/0ab9a4e95586e925c511739ede48d6c97c1e178e.converted" returned: 0 in 0.651s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ab9a4e95586e925c511739ede48d6c97c1e178e.converted --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG nova.compute.manager [req-235d34a6-89bb-4148-8eeb-3f29398fff87 req-54d99066-517c-480e-872d-6d88e3fffe14 service nova] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Received event network-vif-unplugged-818fb644-610d-4c88-b8fe-58ab34e6a02a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-235d34a6-89bb-4148-8eeb-3f29398fff87 req-54d99066-517c-480e-872d-6d88e3fffe14 service nova] Acquiring lock "f5b69324-579d-4833-9bb4-c43c511f820d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-235d34a6-89bb-4148-8eeb-3f29398fff87 req-54d99066-517c-480e-872d-6d88e3fffe14 service nova] Lock "f5b69324-579d-4833-9bb4-c43c511f820d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-235d34a6-89bb-4148-8eeb-3f29398fff87 req-54d99066-517c-480e-872d-6d88e3fffe14 service nova] Lock "f5b69324-579d-4833-9bb4-c43c511f820d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG nova.compute.manager [req-235d34a6-89bb-4148-8eeb-3f29398fff87 req-54d99066-517c-480e-872d-6d88e3fffe14 service nova] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] No waiting events found dispatching network-vif-unplugged-818fb644-610d-4c88-b8fe-58ab34e6a02a {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG nova.compute.manager [req-235d34a6-89bb-4148-8eeb-3f29398fff87 req-54d99066-517c-480e-872d-6d88e3fffe14 service nova] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Received event network-vif-unplugged-818fb644-610d-4c88-b8fe-58ab34e6a02a for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 13:01:15 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Instance destroyed successfully.
Dec 06 13:01:15 user nova-compute[75247]: DEBUG nova.objects.instance [None req-83574370-c12f-4f70-86f1-17fa4720676d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lazy-loading 'resources' on Instance uuid f5b69324-579d-4833-9bb4-c43c511f820d {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-83574370-c12f-4f70-86f1-17fa4720676d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-484733800',display_name='tempest-SnapshotDataIntegrityTests-server-484733800',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-484733800',id=33,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMWpUvaeN4HmhK4Uk0bG4MtL5152M8z6lVCrXyCIqDghTwoaBsKc+1k0bTKDLqNTNct8jWpQAs5/yZFGk5u5YG3aVafyEnXV+cTFgVzmFlrxedUgmxftW3vMLt1aOzemA==',key_name='tempest-keypair-1000707285',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:53:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd8439b54f294add9fb59befefd54456',ramdisk_id='',reservation_id='r-m17vn4o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1400142710',owner_user_name='tempest-SnapshotDataIntegrityTests-1400142710-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:53:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fbb18188b54408c82785f12ba5a8c2d',uuid=f5b69324-579d-4833-9bb4-c43c511f820d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "818fb644-610d-4c88-b8fe-58ab34e6a02a", "address": "fa:16:3e:88:16:dd", "network": {"id": "54586963-619a-439b-94a9-13ade1a28f3f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1711423376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8439b54f294add9fb59befefd54456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fb644-61", "ovs_interfaceid": "818fb644-610d-4c88-b8fe-58ab34e6a02a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-83574370-c12f-4f70-86f1-17fa4720676d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Converting VIF {"id": "818fb644-610d-4c88-b8fe-58ab34e6a02a", "address": "fa:16:3e:88:16:dd", "network": {"id": "54586963-619a-439b-94a9-13ade1a28f3f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1711423376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8439b54f294add9fb59befefd54456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fb644-61", "ovs_interfaceid": "818fb644-610d-4c88-b8fe-58ab34e6a02a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-83574370-c12f-4f70-86f1-17fa4720676d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:16:dd,bridge_name='br-int',has_traffic_filtering=True,id=818fb644-610d-4c88-b8fe-58ab34e6a02a,network=Network(54586963-619a-439b-94a9-13ade1a28f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap818fb644-61') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG os_vif [None req-83574370-c12f-4f70-86f1-17fa4720676d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:16:dd,bridge_name='br-int',has_traffic_filtering=True,id=818fb644-610d-4c88-b8fe-58ab34e6a02a,network=Network(54586963-619a-439b-94a9-13ade1a28f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap818fb644-61') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap818fb644-61, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=361c636d-85ea-447b-8c8d-8a166c8d2924) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:01:15 user nova-compute[75247]: INFO os_vif [None req-83574370-c12f-4f70-86f1-17fa4720676d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:16:dd,bridge_name='br-int',has_traffic_filtering=True,id=818fb644-610d-4c88-b8fe-58ab34e6a02a,network=Network(54586963-619a-439b-94a9-13ade1a28f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap818fb644-61')
Dec 06 13:01:15 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-83574370-c12f-4f70-86f1-17fa4720676d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Deleting instance files /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d_del
Dec 06 13:01:15 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-83574370-c12f-4f70-86f1-17fa4720676d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Deletion of /opt/stack/data/nova/instances/f5b69324-579d-4833-9bb4-c43c511f820d_del complete
Dec 06 13:01:15 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ab9a4e95586e925c511739ede48d6c97c1e178e.converted --force-share --output=json" returned: 0 in 0.254s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "0ab9a4e95586e925c511739ede48d6c97c1e178e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.644s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:01:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ab9a4e95586e925c511739ede48d6c97c1e178e --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:01:16 user nova-compute[75247]: INFO nova.compute.manager [None req-83574370-c12f-4f70-86f1-17fa4720676d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Took 1.17 seconds to destroy the instance on the hypervisor.
Dec 06 13:01:16 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-83574370-c12f-4f70-86f1-17fa4720676d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Successfully updated port: 2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ab9a4e95586e925c511739ede48d6c97c1e178e --force-share --output=json" returned: 0 in 0.208s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "0ab9a4e95586e925c511739ede48d6c97c1e178e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "0ab9a4e95586e925c511739ede48d6c97c1e178e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ab9a4e95586e925c511739ede48d6c97c1e178e --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "refresh_cache-0bd88196-5493-434b-a3ba-0146f81dacea" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquired lock "refresh_cache-0bd88196-5493-434b-a3ba-0146f81dacea" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ab9a4e95586e925c511739ede48d6c97c1e178e --force-share --output=json" returned: 0 in 0.225s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0ab9a4e95586e925c511739ede48d6c97c1e178e,backing_fmt=raw /opt/stack/data/nova/instances/0bd88196-5493-434b-a3ba-0146f81dacea/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0ab9a4e95586e925c511739ede48d6c97c1e178e,backing_fmt=raw /opt/stack/data/nova/instances/0bd88196-5493-434b-a3ba-0146f81dacea/disk 1073741824" returned: 0 in 0.079s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "0ab9a4e95586e925c511739ede48d6c97c1e178e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ab9a4e95586e925c511739ede48d6c97c1e178e --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ab9a4e95586e925c511739ede48d6c97c1e178e --force-share --output=json" returned: 0 in 0.186s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Ensure instance console log exists: /opt/stack/data/nova/instances/0bd88196-5493-434b-a3ba-0146f81dacea/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG nova.network.neutron [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Updating instance_info_cache with network_info: [{"id": "2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73", "address": "fa:16:3e:6c:69:bf", "network": {"id": "053733b9-e8f4-4da1-a5fe-ee7d0704684c", "bridge": "br-int", "label": "tempest-TestStampPattern-239755854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "135f3c1de288423e8964c31ca35664c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e0cf76d-11", "ovs_interfaceid": "2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Releasing lock "refresh_cache-0bd88196-5493-434b-a3ba-0146f81dacea" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Instance network_info: |[{"id": "2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73", "address": "fa:16:3e:6c:69:bf", "network": {"id": "053733b9-e8f4-4da1-a5fe-ee7d0704684c", "bridge": "br-int", "label": "tempest-TestStampPattern-239755854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "135f3c1de288423e8964c31ca35664c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e0cf76d-11", "ovs_interfaceid": "2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Start _get_guest_xml network_info=[{"id": "2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73", "address": "fa:16:3e:6c:69:bf", "network": {"id": "053733b9-e8f4-4da1-a5fe-ee7d0704684c", "bridge": "br-int", "label": "tempest-TestStampPattern-239755854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "135f3c1de288423e8964c31ca35664c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e0cf76d-11", "ovs_interfaceid": "2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5a2f88ebbb152b70f33ec28042343838',container_format='bare',created_at=2023-12-06T13:01:02Z,direct_url=<?>,disk_format='qcow2',id=7f0f6867-a1f0-457b-b543-4f260951a4fc,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-851867808',owner='135f3c1de288423e8964c31ca35664c0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-12-06T13:01:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7f0f6867-a1f0-457b-b543-4f260951a4fc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 13:01:16 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:01:16 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:01:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5a2f88ebbb152b70f33ec28042343838',container_format='bare',created_at=2023-12-06T13:01:02Z,direct_url=<?>,disk_format='qcow2',id=7f0f6867-a1f0-457b-b543-4f260951a4fc,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-851867808',owner='135f3c1de288423e8964c31ca35664c0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-12-06T13:01:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 13:01:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1398873635',display_name='tempest-TestStampPattern-server-1398873635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1398873635',id=41,image_ref='7f0f6867-a1f0-457b-b543-4f260951a4fc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0R56ocpUVDhrbWezba5KdSt9CClipCfqGo33mBvmQ86FzrqlnssF888NmN27WHariFI9cN7fX+09ONrvhHiWT31I4taIadhAyTDm1d90LRTwaNyayfF9CNEjQpjWnVDw==',key_name='tempest-TestStampPattern-181483636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='135f3c1de288423e8964c31ca35664c0',ramdisk_id='',reservation_id='r-efdmqely',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e1f21135-43cd-4dbb-ae7a-b12dffdc5816',image_min_disk='1',image_min_ram='0',image_owner_id='135f3c1de288423e8964c31ca35664c0',image_owner_project_name='tempest-TestStampPattern-1741400309',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1741400309-project-member',image_user_id='9ac9a9c6e8f34a828c737e8b45da7721',network_allocated='True',owner_project_name='tempest-TestStampPattern-1741400309',owner_user_name='tempest-TestStampPattern-1741400309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:01:13Z,user_data=None,user_id='9ac9a9c6e8f34a828c737e8b45da7721',uuid=0bd88196-5493-434b-a3ba-0146f81dacea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73", "address": "fa:16:3e:6c:69:bf", "network": {"id": "053733b9-e8f4-4da1-a5fe-ee7d0704684c", "bridge": "br-int", "label": "tempest-TestStampPattern-239755854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "135f3c1de288423e8964c31ca35664c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e0cf76d-11", "ovs_interfaceid": "2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Converting VIF {"id": "2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73", "address": "fa:16:3e:6c:69:bf", "network": {"id": "053733b9-e8f4-4da1-a5fe-ee7d0704684c", "bridge": "br-int", "label": "tempest-TestStampPattern-239755854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "135f3c1de288423e8964c31ca35664c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e0cf76d-11", "ovs_interfaceid": "2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:69:bf,bridge_name='br-int',has_traffic_filtering=True,id=2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73,network=Network(053733b9-e8f4-4da1-a5fe-ee7d0704684c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e0cf76d-11') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG nova.objects.instance [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lazy-loading 'pci_devices' on Instance uuid 0bd88196-5493-434b-a3ba-0146f81dacea {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] End _get_guest_xml xml=<domain type="kvm">
Dec 06 13:01:17 user nova-compute[75247]:   <uuid>0bd88196-5493-434b-a3ba-0146f81dacea</uuid>
Dec 06 13:01:17 user nova-compute[75247]:   <name>instance-00000029</name>
Dec 06 13:01:17 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 13:01:17 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 13:01:17 user nova-compute[75247]:   <metadata>
Dec 06 13:01:17 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 13:01:17 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 13:01:17 user nova-compute[75247]:       <nova:name>tempest-TestStampPattern-server-1398873635</nova:name>
Dec 06 13:01:17 user nova-compute[75247]:       <nova:creationTime>2023-12-06 13:01:16</nova:creationTime>
Dec 06 13:01:17 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 13:01:17 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 13:01:17 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 13:01:17 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 13:01:17 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 13:01:17 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 13:01:17 user nova-compute[75247]:       </nova:flavor>
Dec 06 13:01:17 user nova-compute[75247]:       <nova:owner>
Dec 06 13:01:17 user nova-compute[75247]:         <nova:user uuid="9ac9a9c6e8f34a828c737e8b45da7721">tempest-TestStampPattern-1741400309-project-member</nova:user>
Dec 06 13:01:17 user nova-compute[75247]:         <nova:project uuid="135f3c1de288423e8964c31ca35664c0">tempest-TestStampPattern-1741400309</nova:project>
Dec 06 13:01:17 user nova-compute[75247]:       </nova:owner>
Dec 06 13:01:17 user nova-compute[75247]:       <nova:root type="image" uuid="7f0f6867-a1f0-457b-b543-4f260951a4fc"/>
Dec 06 13:01:17 user nova-compute[75247]:       <nova:ports>
Dec 06 13:01:17 user nova-compute[75247]:         <nova:port uuid="2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73">
Dec 06 13:01:17 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 06 13:01:17 user nova-compute[75247]:         </nova:port>
Dec 06 13:01:17 user nova-compute[75247]:       </nova:ports>
Dec 06 13:01:17 user nova-compute[75247]:     </nova:instance>
Dec 06 13:01:17 user nova-compute[75247]:   </metadata>
Dec 06 13:01:17 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 13:01:17 user nova-compute[75247]:     <system>
Dec 06 13:01:17 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 13:01:17 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 13:01:17 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 13:01:17 user nova-compute[75247]:       <entry name="serial">0bd88196-5493-434b-a3ba-0146f81dacea</entry>
Dec 06 13:01:17 user nova-compute[75247]:       <entry name="uuid">0bd88196-5493-434b-a3ba-0146f81dacea</entry>
Dec 06 13:01:17 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 13:01:17 user nova-compute[75247]:     </system>
Dec 06 13:01:17 user nova-compute[75247]:   </sysinfo>
Dec 06 13:01:17 user nova-compute[75247]:   <os>
Dec 06 13:01:17 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 13:01:17 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 13:01:17 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 13:01:17 user nova-compute[75247]:   </os>
Dec 06 13:01:17 user nova-compute[75247]:   <features>
Dec 06 13:01:17 user nova-compute[75247]:     <acpi/>
Dec 06 13:01:17 user nova-compute[75247]:     <apic/>
Dec 06 13:01:17 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 13:01:17 user nova-compute[75247]:   </features>
Dec 06 13:01:17 user nova-compute[75247]:   <clock offset="utc">
Dec 06 13:01:17 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 13:01:17 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 13:01:17 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 13:01:17 user nova-compute[75247]:   </clock>
Dec 06 13:01:17 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 13:01:17 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 13:01:17 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 13:01:17 user nova-compute[75247]:   </cpu>
Dec 06 13:01:17 user nova-compute[75247]:   <devices>
Dec 06 13:01:17 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 13:01:17 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 13:01:17 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/0bd88196-5493-434b-a3ba-0146f81dacea/disk"/>
Dec 06 13:01:17 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 13:01:17 user nova-compute[75247]:     </disk>
Dec 06 13:01:17 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 13:01:17 user nova-compute[75247]:       <mac address="fa:16:3e:6c:69:bf"/>
Dec 06 13:01:17 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:01:17 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 13:01:17 user nova-compute[75247]:       <target dev="tap2e0cf76d-11"/>
Dec 06 13:01:17 user nova-compute[75247]:     </interface>
Dec 06 13:01:17 user nova-compute[75247]:     <serial type="pty">
Dec 06 13:01:17 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/0bd88196-5493-434b-a3ba-0146f81dacea/console.log" append="off"/>
Dec 06 13:01:17 user nova-compute[75247]:     </serial>
Dec 06 13:01:17 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 13:01:17 user nova-compute[75247]:     <video>
Dec 06 13:01:17 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:01:17 user nova-compute[75247]:     </video>
Dec 06 13:01:17 user nova-compute[75247]:     <rng model="virtio">
Dec 06 13:01:17 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 13:01:17 user nova-compute[75247]:     </rng>
Dec 06 13:01:17 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 13:01:17 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 13:01:17 user nova-compute[75247]:       <stats period="10"/>
Dec 06 13:01:17 user nova-compute[75247]:     </memballoon>
Dec 06 13:01:17 user nova-compute[75247]:   </devices>
Dec 06 13:01:17 user nova-compute[75247]: </domain>
Dec 06 13:01:17 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1398873635',display_name='tempest-TestStampPattern-server-1398873635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1398873635',id=41,image_ref='7f0f6867-a1f0-457b-b543-4f260951a4fc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0R56ocpUVDhrbWezba5KdSt9CClipCfqGo33mBvmQ86FzrqlnssF888NmN27WHariFI9cN7fX+09ONrvhHiWT31I4taIadhAyTDm1d90LRTwaNyayfF9CNEjQpjWnVDw==',key_name='tempest-TestStampPattern-181483636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='135f3c1de288423e8964c31ca35664c0',ramdisk_id='',reservation_id='r-efdmqely',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e1f21135-43cd-4dbb-ae7a-b12dffdc5816',image_min_disk='1',image_min_ram='0',image_owner_id='135f3c1de288423e8964c31ca35664c0',image_owner_project_name='tempest-TestStampPattern-1741400309',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1741400309-project-member',image_user_id='9ac9a9c6e8f34a828c737e8b45da7721',network_allocated='True',owner_project_name='tempest-TestStampPattern-1741400309',owner_user_name='tempest-TestStampPattern-1741400309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:01:13Z,user_data=None,user_id='9ac9a9c6e8f34a828c737e8b45da7721',uuid=0bd88196-5493-434b-a3ba-0146f81dacea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73", "address": "fa:16:3e:6c:69:bf", "network": {"id": "053733b9-e8f4-4da1-a5fe-ee7d0704684c", "bridge": "br-int", "label": "tempest-TestStampPattern-239755854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "135f3c1de288423e8964c31ca35664c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e0cf76d-11", "ovs_interfaceid": "2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Converting VIF {"id": "2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73", "address": "fa:16:3e:6c:69:bf", "network": {"id": "053733b9-e8f4-4da1-a5fe-ee7d0704684c", "bridge": "br-int", "label": "tempest-TestStampPattern-239755854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "135f3c1de288423e8964c31ca35664c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e0cf76d-11", "ovs_interfaceid": "2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:69:bf,bridge_name='br-int',has_traffic_filtering=True,id=2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73,network=Network(053733b9-e8f4-4da1-a5fe-ee7d0704684c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e0cf76d-11') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG os_vif [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:69:bf,bridge_name='br-int',has_traffic_filtering=True,id=2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73,network=Network(053733b9-e8f4-4da1-a5fe-ee7d0704684c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e0cf76d-11') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ed9e385-b782-5b57-b0df-4a730381f98d', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e0cf76d-11, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e0cf76d-11, col_values=(('qos', UUID('abf27970-da6d-4b24-980d-64a740375776')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e0cf76d-11, col_values=(('external_ids', {'iface-id': '2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:69:bf', 'vm-uuid': '0bd88196-5493-434b-a3ba-0146f81dacea'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:17 user nova-compute[75247]: INFO os_vif [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:69:bf,bridge_name='br-int',has_traffic_filtering=True,id=2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73,network=Network(053733b9-e8f4-4da1-a5fe-ee7d0704684c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e0cf76d-11')
Dec 06 13:01:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] No VIF found with MAC fa:16:3e:6c:69:bf, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:01:17 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Took 1.30 seconds to deallocate network for instance.
Dec 06 13:01:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83574370-c12f-4f70-86f1-17fa4720676d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83574370-c12f-4f70-86f1-17fa4720676d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG nova.compute.manager [req-6e3bf1e5-37ae-4613-89fa-951e8c272ad6 req-b2944cac-b1c5-4125-8fcc-1adf38a2b738 service nova] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Received event network-vif-plugged-818fb644-610d-4c88-b8fe-58ab34e6a02a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6e3bf1e5-37ae-4613-89fa-951e8c272ad6 req-b2944cac-b1c5-4125-8fcc-1adf38a2b738 service nova] Acquiring lock "f5b69324-579d-4833-9bb4-c43c511f820d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6e3bf1e5-37ae-4613-89fa-951e8c272ad6 req-b2944cac-b1c5-4125-8fcc-1adf38a2b738 service nova] Lock "f5b69324-579d-4833-9bb4-c43c511f820d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6e3bf1e5-37ae-4613-89fa-951e8c272ad6 req-b2944cac-b1c5-4125-8fcc-1adf38a2b738 service nova] Lock "f5b69324-579d-4833-9bb4-c43c511f820d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG nova.compute.manager [req-6e3bf1e5-37ae-4613-89fa-951e8c272ad6 req-b2944cac-b1c5-4125-8fcc-1adf38a2b738 service nova] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] No waiting events found dispatching network-vif-plugged-818fb644-610d-4c88-b8fe-58ab34e6a02a {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:01:17 user nova-compute[75247]: WARNING nova.compute.manager [req-6e3bf1e5-37ae-4613-89fa-951e8c272ad6 req-b2944cac-b1c5-4125-8fcc-1adf38a2b738 service nova] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Received unexpected event network-vif-plugged-818fb644-610d-4c88-b8fe-58ab34e6a02a for instance with vm_state deleted and task_state None.
Dec 06 13:01:17 user nova-compute[75247]: DEBUG nova.compute.manager [req-6e3bf1e5-37ae-4613-89fa-951e8c272ad6 req-b2944cac-b1c5-4125-8fcc-1adf38a2b738 service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Received event network-changed-2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG nova.compute.manager [req-6e3bf1e5-37ae-4613-89fa-951e8c272ad6 req-b2944cac-b1c5-4125-8fcc-1adf38a2b738 service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Refreshing instance network info cache due to event network-changed-2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6e3bf1e5-37ae-4613-89fa-951e8c272ad6 req-b2944cac-b1c5-4125-8fcc-1adf38a2b738 service nova] Acquiring lock "refresh_cache-0bd88196-5493-434b-a3ba-0146f81dacea" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6e3bf1e5-37ae-4613-89fa-951e8c272ad6 req-b2944cac-b1c5-4125-8fcc-1adf38a2b738 service nova] Acquired lock "refresh_cache-0bd88196-5493-434b-a3ba-0146f81dacea" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG nova.network.neutron [req-6e3bf1e5-37ae-4613-89fa-951e8c272ad6 req-b2944cac-b1c5-4125-8fcc-1adf38a2b738 service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Refreshing network info cache for port 2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-83574370-c12f-4f70-86f1-17fa4720676d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-83574370-c12f-4f70-86f1-17fa4720676d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:01:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83574370-c12f-4f70-86f1-17fa4720676d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:01:18 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-83574370-c12f-4f70-86f1-17fa4720676d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Deleted allocations for instance f5b69324-579d-4833-9bb4-c43c511f820d
Dec 06 13:01:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83574370-c12f-4f70-86f1-17fa4720676d tempest-SnapshotDataIntegrityTests-1400142710 tempest-SnapshotDataIntegrityTests-1400142710-project-member] Lock "f5b69324-579d-4833-9bb4-c43c511f820d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.403s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:01:18 user nova-compute[75247]: DEBUG nova.network.neutron [req-6e3bf1e5-37ae-4613-89fa-951e8c272ad6 req-b2944cac-b1c5-4125-8fcc-1adf38a2b738 service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Updated VIF entry in instance network info cache for port 2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:01:18 user nova-compute[75247]: DEBUG nova.network.neutron [req-6e3bf1e5-37ae-4613-89fa-951e8c272ad6 req-b2944cac-b1c5-4125-8fcc-1adf38a2b738 service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Updating instance_info_cache with network_info: [{"id": "2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73", "address": "fa:16:3e:6c:69:bf", "network": {"id": "053733b9-e8f4-4da1-a5fe-ee7d0704684c", "bridge": "br-int", "label": "tempest-TestStampPattern-239755854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "135f3c1de288423e8964c31ca35664c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e0cf76d-11", "ovs_interfaceid": "2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:01:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6e3bf1e5-37ae-4613-89fa-951e8c272ad6 req-b2944cac-b1c5-4125-8fcc-1adf38a2b738 service nova] Releasing lock "refresh_cache-0bd88196-5493-434b-a3ba-0146f81dacea" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:01:18 user nova-compute[75247]: DEBUG nova.compute.manager [req-6e3bf1e5-37ae-4613-89fa-951e8c272ad6 req-b2944cac-b1c5-4125-8fcc-1adf38a2b738 service nova] [instance: f5b69324-579d-4833-9bb4-c43c511f820d] Received event network-vif-deleted-818fb644-610d-4c88-b8fe-58ab34e6a02a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:01:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:19 user nova-compute[75247]: DEBUG nova.compute.manager [req-1aa7b0fd-15b6-4a10-b0e3-c611b3ca8773 req-2dc10a68-464e-4585-a68b-3f505511d022 service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Received event network-vif-plugged-2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:01:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1aa7b0fd-15b6-4a10-b0e3-c611b3ca8773 req-2dc10a68-464e-4585-a68b-3f505511d022 service nova] Acquiring lock "0bd88196-5493-434b-a3ba-0146f81dacea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:01:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1aa7b0fd-15b6-4a10-b0e3-c611b3ca8773 req-2dc10a68-464e-4585-a68b-3f505511d022 service nova] Lock "0bd88196-5493-434b-a3ba-0146f81dacea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:01:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1aa7b0fd-15b6-4a10-b0e3-c611b3ca8773 req-2dc10a68-464e-4585-a68b-3f505511d022 service nova] Lock "0bd88196-5493-434b-a3ba-0146f81dacea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:01:19 user nova-compute[75247]: DEBUG nova.compute.manager [req-1aa7b0fd-15b6-4a10-b0e3-c611b3ca8773 req-2dc10a68-464e-4585-a68b-3f505511d022 service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] No waiting events found dispatching network-vif-plugged-2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:01:19 user nova-compute[75247]: WARNING nova.compute.manager [req-1aa7b0fd-15b6-4a10-b0e3-c611b3ca8773 req-2dc10a68-464e-4585-a68b-3f505511d022 service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Received unexpected event network-vif-plugged-2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73 for instance with vm_state building and task_state spawning.
Dec 06 13:01:19 user nova-compute[75247]: DEBUG nova.compute.manager [req-1aa7b0fd-15b6-4a10-b0e3-c611b3ca8773 req-2dc10a68-464e-4585-a68b-3f505511d022 service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Received event network-vif-plugged-2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:01:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1aa7b0fd-15b6-4a10-b0e3-c611b3ca8773 req-2dc10a68-464e-4585-a68b-3f505511d022 service nova] Acquiring lock "0bd88196-5493-434b-a3ba-0146f81dacea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:01:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1aa7b0fd-15b6-4a10-b0e3-c611b3ca8773 req-2dc10a68-464e-4585-a68b-3f505511d022 service nova] Lock "0bd88196-5493-434b-a3ba-0146f81dacea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:01:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1aa7b0fd-15b6-4a10-b0e3-c611b3ca8773 req-2dc10a68-464e-4585-a68b-3f505511d022 service nova] Lock "0bd88196-5493-434b-a3ba-0146f81dacea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:01:19 user nova-compute[75247]: DEBUG nova.compute.manager [req-1aa7b0fd-15b6-4a10-b0e3-c611b3ca8773 req-2dc10a68-464e-4585-a68b-3f505511d022 service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] No waiting events found dispatching network-vif-plugged-2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:01:19 user nova-compute[75247]: WARNING nova.compute.manager [req-1aa7b0fd-15b6-4a10-b0e3-c611b3ca8773 req-2dc10a68-464e-4585-a68b-3f505511d022 service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Received unexpected event network-vif-plugged-2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73 for instance with vm_state building and task_state spawning.
Dec 06 13:01:19 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:01:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:20 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:01:21 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 13:01:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 13:01:21 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Instance spawned successfully.
Dec 06 13:01:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 13:01:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:01:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:01:21 user nova-compute[75247]: INFO nova.compute.manager [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Took 8.07 seconds to spawn the instance on the hypervisor.
Dec 06 13:01:21 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 13:01:21 user nova-compute[75247]: INFO nova.compute.manager [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Took 8.94 seconds to build instance.
Dec 06 13:01:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e68bba8d-c297-4328-b418-9dc1839dbff9 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "0bd88196-5493-434b-a3ba-0146f81dacea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.046s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:01:21 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:01:21 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:01:21 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:01:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:23 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:01:23 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:01:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:01:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:01:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:01:23 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:01:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:01:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:01:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:01:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:01:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:01:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:01:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:01:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:01:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:01:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:01:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:01:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:01:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:01:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:01:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:01:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:01:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:01:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:01:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:01:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:01:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:01:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:01:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:01:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:01:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:01:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd88196-5493-434b-a3ba-0146f81dacea/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:01:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd88196-5493-434b-a3ba-0146f81dacea/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:01:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd88196-5493-434b-a3ba-0146f81dacea/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:01:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd88196-5493-434b-a3ba-0146f81dacea/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:01:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:27 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:01:27 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:01:27 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=8302MB free_disk=24.994579315185547GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:01:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:01:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:01:27 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance bc3ddb40-b05f-4170-b269-d44dec6ecdaf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:01:27 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 530cfb75-7aa8-4e57-b282-8f7a21401b34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:01:27 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance c603d6dc-804e-4c0d-be1f-40e09de74e8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:01:27 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 16dd787d-6abe-48f3-ac3c-fd55853b4e23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:01:27 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance e1f21135-43cd-4dbb-ae7a-b12dffdc5816 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:01:27 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 0bd88196-5493-434b-a3ba-0146f81dacea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:01:27 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:01:27 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:01:27 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Refreshing inventories for resource provider d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 13:01:27 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Updating ProviderTree inventory for provider d326b140-3450-4409-964c-9eafc6cc025d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 13:01:27 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Updating inventory in ProviderTree for provider d326b140-3450-4409-964c-9eafc6cc025d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 13:01:27 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Refreshing aggregate associations for resource provider d326b140-3450-4409-964c-9eafc6cc025d, aggregates: None {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 13:01:27 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Refreshing trait associations for resource provider d326b140-3450-4409-964c-9eafc6cc025d, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 13:01:27 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:01:27 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:01:27 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:01:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.510s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:01:27 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:01:27 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Cleaning up deleted instances {{(pid=75247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 13:01:27 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] There are 0 instances to clean {{(pid=75247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 13:01:28 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:01:28 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:01:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-530cfb75-7aa8-4e57-b282-8f7a21401b34" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:01:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-530cfb75-7aa8-4e57-b282-8f7a21401b34" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:01:28 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 13:01:29 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Updating instance_info_cache with network_info: [{"id": "d924dd21-056e-413d-8fc1-493933e7e7e6", "address": "fa:16:3e:76:c7:97", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd924dd21-05", "ovs_interfaceid": "d924dd21-056e-413d-8fc1-493933e7e7e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:01:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-530cfb75-7aa8-4e57-b282-8f7a21401b34" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:01:29 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 13:01:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:01:37 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:01:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:45 user nova-compute[75247]: INFO nova.compute.manager [None req-64026935-602f-4f8d-9e70-c3491a70fe52 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Unrescuing
Dec 06 13:01:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-64026935-602f-4f8d-9e70-c3491a70fe52 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "refresh_cache-16dd787d-6abe-48f3-ac3c-fd55853b4e23" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:01:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-64026935-602f-4f8d-9e70-c3491a70fe52 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquired lock "refresh_cache-16dd787d-6abe-48f3-ac3c-fd55853b4e23" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:01:45 user nova-compute[75247]: DEBUG nova.network.neutron [None req-64026935-602f-4f8d-9e70-c3491a70fe52 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 13:01:45 user nova-compute[75247]: DEBUG nova.network.neutron [None req-64026935-602f-4f8d-9e70-c3491a70fe52 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Updating instance_info_cache with network_info: [{"id": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "address": "fa:16:3e:f9:7b:5b", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8804e1-c0", "ovs_interfaceid": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:01:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-64026935-602f-4f8d-9e70-c3491a70fe52 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Releasing lock "refresh_cache-16dd787d-6abe-48f3-ac3c-fd55853b4e23" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:01:46 user nova-compute[75247]: DEBUG nova.objects.instance [None req-64026935-602f-4f8d-9e70-c3491a70fe52 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'flavor' on Instance uuid 16dd787d-6abe-48f3-ac3c-fd55853b4e23 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:01:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:46 user nova-compute[75247]: DEBUG nova.compute.manager [req-a4289904-8a53-4555-92af-b68cc54f01cc req-62584e50-e32a-4a5d-b62b-c052c054ccf6 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received event network-vif-unplugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:01:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a4289904-8a53-4555-92af-b68cc54f01cc req-62584e50-e32a-4a5d-b62b-c052c054ccf6 service nova] Acquiring lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:01:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a4289904-8a53-4555-92af-b68cc54f01cc req-62584e50-e32a-4a5d-b62b-c052c054ccf6 service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:01:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a4289904-8a53-4555-92af-b68cc54f01cc req-62584e50-e32a-4a5d-b62b-c052c054ccf6 service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:01:46 user nova-compute[75247]: DEBUG nova.compute.manager [req-a4289904-8a53-4555-92af-b68cc54f01cc req-62584e50-e32a-4a5d-b62b-c052c054ccf6 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] No waiting events found dispatching network-vif-unplugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:01:46 user nova-compute[75247]: WARNING nova.compute.manager [req-a4289904-8a53-4555-92af-b68cc54f01cc req-62584e50-e32a-4a5d-b62b-c052c054ccf6 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received unexpected event network-vif-unplugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 for instance with vm_state rescued and task_state unrescuing.
Dec 06 13:01:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:46 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Instance destroyed successfully.
Dec 06 13:01:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:48 user nova-compute[75247]: DEBUG nova.compute.manager [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received event network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:01:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] Acquiring lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:01:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:01:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:01:48 user nova-compute[75247]: DEBUG nova.compute.manager [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] No waiting events found dispatching network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:01:48 user nova-compute[75247]: WARNING nova.compute.manager [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received unexpected event network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 for instance with vm_state rescued and task_state unrescuing.
Dec 06 13:01:48 user nova-compute[75247]: DEBUG nova.compute.manager [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received event network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:01:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] Acquiring lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:01:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:01:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:01:48 user nova-compute[75247]: DEBUG nova.compute.manager [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] No waiting events found dispatching network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:01:48 user nova-compute[75247]: WARNING nova.compute.manager [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received unexpected event network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 for instance with vm_state rescued and task_state unrescuing.
Dec 06 13:01:48 user nova-compute[75247]: DEBUG nova.compute.manager [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received event network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:01:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] Acquiring lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:01:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:01:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:01:48 user nova-compute[75247]: DEBUG nova.compute.manager [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] No waiting events found dispatching network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:01:48 user nova-compute[75247]: WARNING nova.compute.manager [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received unexpected event network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 for instance with vm_state rescued and task_state unrescuing.
Dec 06 13:01:48 user nova-compute[75247]: DEBUG nova.compute.manager [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received event network-vif-unplugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:01:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] Acquiring lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:01:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:01:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:01:48 user nova-compute[75247]: DEBUG nova.compute.manager [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] No waiting events found dispatching network-vif-unplugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:01:48 user nova-compute[75247]: WARNING nova.compute.manager [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received unexpected event network-vif-unplugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 for instance with vm_state rescued and task_state unrescuing.
Dec 06 13:01:48 user nova-compute[75247]: DEBUG nova.compute.manager [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received event network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:01:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] Acquiring lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:01:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:01:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:01:48 user nova-compute[75247]: DEBUG nova.compute.manager [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] No waiting events found dispatching network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:01:48 user nova-compute[75247]: WARNING nova.compute.manager [req-becf124f-ca0b-4c06-8841-07d2e3559a13 req-ad1a03e1-3afb-4728-b9eb-0de9ceaf4324 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received unexpected event network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 for instance with vm_state rescued and task_state unrescuing.
Dec 06 13:01:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "4a2b157c-2630-4578-b970-5b64c0697ae2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:01:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "4a2b157c-2630-4578-b970-5b64c0697ae2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:01:49 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 13:01:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:01:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:01:49 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 13:01:49 user nova-compute[75247]: INFO nova.compute.claims [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Claim successful on node user
Dec 06 13:01:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:49 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:01:49 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:01:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:01:49 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 13:01:49 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 13:01:49 user nova-compute[75247]: DEBUG nova.network.neutron [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 13:01:49 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 13:01:49 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 13:01:49 user nova-compute[75247]: DEBUG nova.policy [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '016714f7502b4a8fa12ed0ce6644c5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9493d9b0b1024cea9a550e2a42c1e6a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 13:01:49 user nova-compute[75247]: INFO nova.virt.block_device [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Booting with volume snapshot ffa52806-ed96-4f8a-9efe-c60ec47f3136 at /dev/vda
Dec 06 13:01:50 user nova-compute[75247]: DEBUG nova.compute.manager [None req-64026935-602f-4f8d-9e70-c3491a70fe52 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 13:01:50 user nova-compute[75247]: DEBUG nova.compute.manager [req-a89033ff-2968-4e53-92b1-ed7ffacf2abd req-521040b5-42b9-4346-83e7-f76f82e6b19d service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received event network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:01:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a89033ff-2968-4e53-92b1-ed7ffacf2abd req-521040b5-42b9-4346-83e7-f76f82e6b19d service nova] Acquiring lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:01:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a89033ff-2968-4e53-92b1-ed7ffacf2abd req-521040b5-42b9-4346-83e7-f76f82e6b19d service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:01:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a89033ff-2968-4e53-92b1-ed7ffacf2abd req-521040b5-42b9-4346-83e7-f76f82e6b19d service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:01:50 user nova-compute[75247]: DEBUG nova.compute.manager [req-a89033ff-2968-4e53-92b1-ed7ffacf2abd req-521040b5-42b9-4346-83e7-f76f82e6b19d service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] No waiting events found dispatching network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:01:50 user nova-compute[75247]: WARNING nova.compute.manager [req-a89033ff-2968-4e53-92b1-ed7ffacf2abd req-521040b5-42b9-4346-83e7-f76f82e6b19d service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received unexpected event network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 for instance with vm_state rescued and task_state unrescuing.
Dec 06 13:01:50 user nova-compute[75247]: DEBUG nova.compute.manager [req-a89033ff-2968-4e53-92b1-ed7ffacf2abd req-521040b5-42b9-4346-83e7-f76f82e6b19d service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received event network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:01:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a89033ff-2968-4e53-92b1-ed7ffacf2abd req-521040b5-42b9-4346-83e7-f76f82e6b19d service nova] Acquiring lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:01:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a89033ff-2968-4e53-92b1-ed7ffacf2abd req-521040b5-42b9-4346-83e7-f76f82e6b19d service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:01:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a89033ff-2968-4e53-92b1-ed7ffacf2abd req-521040b5-42b9-4346-83e7-f76f82e6b19d service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:01:50 user nova-compute[75247]: DEBUG nova.compute.manager [req-a89033ff-2968-4e53-92b1-ed7ffacf2abd req-521040b5-42b9-4346-83e7-f76f82e6b19d service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] No waiting events found dispatching network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:01:50 user nova-compute[75247]: WARNING nova.compute.manager [req-a89033ff-2968-4e53-92b1-ed7ffacf2abd req-521040b5-42b9-4346-83e7-f76f82e6b19d service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received unexpected event network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 for instance with vm_state rescued and task_state unrescuing.
Dec 06 13:01:50 user nova-compute[75247]: DEBUG nova.network.neutron [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Successfully created port: 8cc1d821-1f39-4762-a47f-e3497efe2010 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 13:01:51 user nova-compute[75247]: DEBUG nova.network.neutron [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Successfully updated port: 8cc1d821-1f39-4762-a47f-e3497efe2010 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 13:01:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "refresh_cache-4a2b157c-2630-4578-b970-5b64c0697ae2" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:01:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquired lock "refresh_cache-4a2b157c-2630-4578-b970-5b64c0697ae2" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:01:51 user nova-compute[75247]: DEBUG nova.network.neutron [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 13:01:51 user nova-compute[75247]: DEBUG nova.network.neutron [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 13:01:51 user nova-compute[75247]: DEBUG nova.network.neutron [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Updating instance_info_cache with network_info: [{"id": "8cc1d821-1f39-4762-a47f-e3497efe2010", "address": "fa:16:3e:1e:12:5d", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc1d821-1f", "ovs_interfaceid": "8cc1d821-1f39-4762-a47f-e3497efe2010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:01:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Releasing lock "refresh_cache-4a2b157c-2630-4578-b970-5b64c0697ae2" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:01:51 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Instance network_info: |[{"id": "8cc1d821-1f39-4762-a47f-e3497efe2010", "address": "fa:16:3e:1e:12:5d", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc1d821-1f", "ovs_interfaceid": "8cc1d821-1f39-4762-a47f-e3497efe2010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 13:01:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:52 user nova-compute[75247]: DEBUG nova.compute.manager [req-e566ac10-5126-4776-8219-98fc1f3b85f9 req-432705c5-d617-453a-a207-4183df3a47ef service nova] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Received event network-changed-8cc1d821-1f39-4762-a47f-e3497efe2010 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:01:52 user nova-compute[75247]: DEBUG nova.compute.manager [req-e566ac10-5126-4776-8219-98fc1f3b85f9 req-432705c5-d617-453a-a207-4183df3a47ef service nova] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Refreshing instance network info cache due to event network-changed-8cc1d821-1f39-4762-a47f-e3497efe2010. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:01:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e566ac10-5126-4776-8219-98fc1f3b85f9 req-432705c5-d617-453a-a207-4183df3a47ef service nova] Acquiring lock "refresh_cache-4a2b157c-2630-4578-b970-5b64c0697ae2" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:01:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e566ac10-5126-4776-8219-98fc1f3b85f9 req-432705c5-d617-453a-a207-4183df3a47ef service nova] Acquired lock "refresh_cache-4a2b157c-2630-4578-b970-5b64c0697ae2" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:01:52 user nova-compute[75247]: DEBUG nova.network.neutron [req-e566ac10-5126-4776-8219-98fc1f3b85f9 req-432705c5-d617-453a-a207-4183df3a47ef service nova] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Refreshing network info cache for port 8cc1d821-1f39-4762-a47f-e3497efe2010 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:01:52 user nova-compute[75247]: DEBUG nova.network.neutron [req-e566ac10-5126-4776-8219-98fc1f3b85f9 req-432705c5-d617-453a-a207-4183df3a47ef service nova] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Updated VIF entry in instance network info cache for port 8cc1d821-1f39-4762-a47f-e3497efe2010. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:01:52 user nova-compute[75247]: DEBUG nova.network.neutron [req-e566ac10-5126-4776-8219-98fc1f3b85f9 req-432705c5-d617-453a-a207-4183df3a47ef service nova] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Updating instance_info_cache with network_info: [{"id": "8cc1d821-1f39-4762-a47f-e3497efe2010", "address": "fa:16:3e:1e:12:5d", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc1d821-1f", "ovs_interfaceid": "8cc1d821-1f39-4762-a47f-e3497efe2010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:01:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e566ac10-5126-4776-8219-98fc1f3b85f9 req-432705c5-d617-453a-a207-4183df3a47ef service nova] Releasing lock "refresh_cache-4a2b157c-2630-4578-b970-5b64c0697ae2" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:01:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:01:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:00 user nova-compute[75247]: DEBUG os_brick.utils [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:02:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad776d45-2ff2-4329-a561-62acfb00194a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:02:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d02b5ed-11e2-4686-8966-b8e24f7b97f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:02:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17be2be-9f0a-4765-9c5a-30342959eef4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:02:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae21907-267e-445a-82ba-bba5312822ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:02:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:02:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 13:02:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:00 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:02:00 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 13:02:00 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e4d274-f89e-4e65-975c-4ddccc041e08]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:02:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 13:02:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 13:02:00 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 13:02:00 user nova-compute[75247]: DEBUG os_brick.utils [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:02:00 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Updating existing volume attachment record: f041d8c9-07a7-4f1a-872a-5c403c7ada66 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 13:02:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:17 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:02:18 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 13:02:19 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Creating image(s)
Dec 06 13:02:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Did not create local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Ensure instance console log exists: /opt/stack/data/nova/instances/4a2b157c-2630-4578-b970-5b64c0697ae2/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Start _get_guest_xml network_info=[{"id": "8cc1d821-1f39-4762-a47f-e3497efe2010", "address": "fa:16:3e:1e:12:5d", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc1d821-1f", "ovs_interfaceid": "8cc1d821-1f39-4762-a47f-e3497efe2010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'f041d8c9-07a7-4f1a-872a-5c403c7ada66', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUsMlgiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4a2b157c-2630-4578-b970-5b64c0697ae2', 'attached_at': '', 'detached_at': '', 'volume_id': '60b3638b-715c-43af-aeb4-71194281ea06', 'serial': '60b3638b-715c-43af-aeb4-71194281ea06'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 13:02:19 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:02:19 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:02:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUsMlgiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:02:19 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:02:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:02:19 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:02:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:02:19 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3d656d-6a4f-413a-ba8f-c778395ad4b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 13:02:19 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89db589-cda5-4662-afbd-e65a4bc4bddf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06] added
Dec 06 13:02:19 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a8eba7-18b2-494c-bbb9-f91972a8bf36]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfabba4c-8aa7-4120-8b7b-fac31f244554]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BUsMlgiv {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BUsMlgiv" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fd62bd-66c1-4b6f-b228-94d9c0040178]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BUsMlgiv'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9631259-be16-4cb5-b526-fe82d4e3d89f]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d2c4a3-8e89-4935-8e10-1eb8868fe8c4]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)
Dec 06 13:02:19 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)
Dec 06 13:02:19 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7d6618-e51d-45f3-a584-2a9d9f04fd78]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06, portal: 172.16.0.220,3260]
Dec 06 13:02:19 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06, portal: 172.16.0.220,3260] successful.
Dec 06 13:02:19 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:02:19 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c556d5-aca0-4473-a6c5-0004db54d33c]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:02:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:02:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e74274-00f6-4390-9c98-305b79f9a174]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:02:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)
Dec 06 13:02:20 user nova-compute[75247]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 (non-flash)
Dec 06 13:02:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:02:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)
Dec 06 13:02:20 user nova-compute[75247]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 (non-flash)
Dec 06 13:02:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:02:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:02:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 13:02:20 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 13:02:20 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 13:02:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4062e204-83c2-4256-b2b7-208dfae23294]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:02:20 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 13:02:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUsMlgiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 13:02:20 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23864616133396461', 'path': '/dev/sdb'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864616133396461', 'path': '/dev/sdb'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:01:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-121822901',display_name='tempest-TestVolumeBootPattern-server-121822901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-121822901',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9493d9b0b1024cea9a550e2a42c1e6a1',ramdisk_id='',reservation_id='r-6e3gl05j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2088852773',owner_user_name='tempest-TestVolumeBootPattern-2088852773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:01:50Z,user_data=None,user_id='016714f7502b4a8fa12ed0ce6644c5fc',uuid=4a2b157c-2630-4578-b970-5b64c0697ae2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cc1d821-1f39-4762-a47f-e3497efe2010", "address": "fa:16:3e:1e:12:5d", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc1d821-1f", "ovs_interfaceid": "8cc1d821-1f39-4762-a47f-e3497efe2010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converting VIF {"id": "8cc1d821-1f39-4762-a47f-e3497efe2010", "address": "fa:16:3e:1e:12:5d", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc1d821-1f", "ovs_interfaceid": "8cc1d821-1f39-4762-a47f-e3497efe2010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:12:5d,bridge_name='br-int',has_traffic_filtering=True,id=8cc1d821-1f39-4762-a47f-e3497efe2010,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc1d821-1f') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG nova.objects.instance [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a2b157c-2630-4578-b970-5b64c0697ae2 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] End _get_guest_xml xml=<domain type="kvm">
Dec 06 13:02:21 user nova-compute[75247]:   <uuid>4a2b157c-2630-4578-b970-5b64c0697ae2</uuid>
Dec 06 13:02:21 user nova-compute[75247]:   <name>instance-0000002a</name>
Dec 06 13:02:21 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 13:02:21 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 13:02:21 user nova-compute[75247]:   <metadata>
Dec 06 13:02:21 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 13:02:21 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 13:02:21 user nova-compute[75247]:       <nova:name>tempest-TestVolumeBootPattern-server-121822901</nova:name>
Dec 06 13:02:21 user nova-compute[75247]:       <nova:creationTime>2023-12-06 13:02:19</nova:creationTime>
Dec 06 13:02:21 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 13:02:21 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 13:02:21 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 13:02:21 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 13:02:21 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 13:02:21 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 13:02:21 user nova-compute[75247]:       </nova:flavor>
Dec 06 13:02:21 user nova-compute[75247]:       <nova:owner>
Dec 06 13:02:21 user nova-compute[75247]:         <nova:user uuid="016714f7502b4a8fa12ed0ce6644c5fc">tempest-TestVolumeBootPattern-2088852773-project-member</nova:user>
Dec 06 13:02:21 user nova-compute[75247]:         <nova:project uuid="9493d9b0b1024cea9a550e2a42c1e6a1">tempest-TestVolumeBootPattern-2088852773</nova:project>
Dec 06 13:02:21 user nova-compute[75247]:       </nova:owner>
Dec 06 13:02:21 user nova-compute[75247]:       <nova:ports>
Dec 06 13:02:21 user nova-compute[75247]:         <nova:port uuid="8cc1d821-1f39-4762-a47f-e3497efe2010">
Dec 06 13:02:21 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 06 13:02:21 user nova-compute[75247]:         </nova:port>
Dec 06 13:02:21 user nova-compute[75247]:       </nova:ports>
Dec 06 13:02:21 user nova-compute[75247]:     </nova:instance>
Dec 06 13:02:21 user nova-compute[75247]:   </metadata>
Dec 06 13:02:21 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 13:02:21 user nova-compute[75247]:     <system>
Dec 06 13:02:21 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 13:02:21 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 13:02:21 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 13:02:21 user nova-compute[75247]:       <entry name="serial">4a2b157c-2630-4578-b970-5b64c0697ae2</entry>
Dec 06 13:02:21 user nova-compute[75247]:       <entry name="uuid">4a2b157c-2630-4578-b970-5b64c0697ae2</entry>
Dec 06 13:02:21 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 13:02:21 user nova-compute[75247]:     </system>
Dec 06 13:02:21 user nova-compute[75247]:   </sysinfo>
Dec 06 13:02:21 user nova-compute[75247]:   <os>
Dec 06 13:02:21 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 13:02:21 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 13:02:21 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 13:02:21 user nova-compute[75247]:   </os>
Dec 06 13:02:21 user nova-compute[75247]:   <features>
Dec 06 13:02:21 user nova-compute[75247]:     <acpi/>
Dec 06 13:02:21 user nova-compute[75247]:     <apic/>
Dec 06 13:02:21 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 13:02:21 user nova-compute[75247]:   </features>
Dec 06 13:02:21 user nova-compute[75247]:   <clock offset="utc">
Dec 06 13:02:21 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 13:02:21 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 13:02:21 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 13:02:21 user nova-compute[75247]:   </clock>
Dec 06 13:02:21 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 13:02:21 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 13:02:21 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 13:02:21 user nova-compute[75247]:   </cpu>
Dec 06 13:02:21 user nova-compute[75247]:   <devices>
Dec 06 13:02:21 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 13:02:21 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:02:21 user nova-compute[75247]:       <source dev="/dev/sdb"/>
Dec 06 13:02:21 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 13:02:21 user nova-compute[75247]:       <serial>60b3638b-715c-43af-aeb4-71194281ea06</serial>
Dec 06 13:02:21 user nova-compute[75247]:     </disk>
Dec 06 13:02:21 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 13:02:21 user nova-compute[75247]:       <mac address="fa:16:3e:1e:12:5d"/>
Dec 06 13:02:21 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:02:21 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 13:02:21 user nova-compute[75247]:       <target dev="tap8cc1d821-1f"/>
Dec 06 13:02:21 user nova-compute[75247]:     </interface>
Dec 06 13:02:21 user nova-compute[75247]:     <serial type="pty">
Dec 06 13:02:21 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/4a2b157c-2630-4578-b970-5b64c0697ae2/console.log" append="off"/>
Dec 06 13:02:21 user nova-compute[75247]:     </serial>
Dec 06 13:02:21 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 13:02:21 user nova-compute[75247]:     <video>
Dec 06 13:02:21 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:02:21 user nova-compute[75247]:     </video>
Dec 06 13:02:21 user nova-compute[75247]:     <rng model="virtio">
Dec 06 13:02:21 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 13:02:21 user nova-compute[75247]:     </rng>
Dec 06 13:02:21 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 13:02:21 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 13:02:21 user nova-compute[75247]:       <stats period="10"/>
Dec 06 13:02:21 user nova-compute[75247]:     </memballoon>
Dec 06 13:02:21 user nova-compute[75247]:   </devices>
Dec 06 13:02:21 user nova-compute[75247]: </domain>
Dec 06 13:02:21 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:01:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-121822901',display_name='tempest-TestVolumeBootPattern-server-121822901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-121822901',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9493d9b0b1024cea9a550e2a42c1e6a1',ramdisk_id='',reservation_id='r-6e3gl05j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2088852773',owner_user_name='tempest-TestVolumeBootPattern-2088852773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:01:50Z,user_data=None,user_id='016714f7502b4a8fa12ed0ce6644c5fc',uuid=4a2b157c-2630-4578-b970-5b64c0697ae2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cc1d821-1f39-4762-a47f-e3497efe2010", "address": "fa:16:3e:1e:12:5d", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc1d821-1f", "ovs_interfaceid": "8cc1d821-1f39-4762-a47f-e3497efe2010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converting VIF {"id": "8cc1d821-1f39-4762-a47f-e3497efe2010", "address": "fa:16:3e:1e:12:5d", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc1d821-1f", "ovs_interfaceid": "8cc1d821-1f39-4762-a47f-e3497efe2010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:12:5d,bridge_name='br-int',has_traffic_filtering=True,id=8cc1d821-1f39-4762-a47f-e3497efe2010,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc1d821-1f') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG os_vif [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:12:5d,bridge_name='br-int',has_traffic_filtering=True,id=8cc1d821-1f39-4762-a47f-e3497efe2010,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc1d821-1f') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85a56839-2137-5b54-a2ae-f3f40afd2508', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8cc1d821-1f, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8cc1d821-1f, col_values=(('qos', UUID('22c6b7b0-a2cd-46f4-9bad-93d237e45358')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8cc1d821-1f, col_values=(('external_ids', {'iface-id': '8cc1d821-1f39-4762-a47f-e3497efe2010', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:12:5d', 'vm-uuid': '4a2b157c-2630-4578-b970-5b64c0697ae2'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:21 user nova-compute[75247]: INFO os_vif [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:12:5d,bridge_name='br-int',has_traffic_filtering=True,id=8cc1d821-1f39-4762-a47f-e3497efe2010,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc1d821-1f')
Dec 06 13:02:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] No VIF found with MAC fa:16:3e:1e:12:5d, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 13:02:21 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:02:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:23 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:02:23 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:02:23 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:02:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-c4e1dd39-fcc8-4071-9823-0d8cb4be13ed req-6aa58a46-b471-4779-ad7d-4be5185c3991 service nova] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Received event network-vif-plugged-8cc1d821-1f39-4762-a47f-e3497efe2010 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:02:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c4e1dd39-fcc8-4071-9823-0d8cb4be13ed req-6aa58a46-b471-4779-ad7d-4be5185c3991 service nova] Acquiring lock "4a2b157c-2630-4578-b970-5b64c0697ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:02:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c4e1dd39-fcc8-4071-9823-0d8cb4be13ed req-6aa58a46-b471-4779-ad7d-4be5185c3991 service nova] Lock "4a2b157c-2630-4578-b970-5b64c0697ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:02:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c4e1dd39-fcc8-4071-9823-0d8cb4be13ed req-6aa58a46-b471-4779-ad7d-4be5185c3991 service nova] Lock "4a2b157c-2630-4578-b970-5b64c0697ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:02:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-c4e1dd39-fcc8-4071-9823-0d8cb4be13ed req-6aa58a46-b471-4779-ad7d-4be5185c3991 service nova] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] No waiting events found dispatching network-vif-plugged-8cc1d821-1f39-4762-a47f-e3497efe2010 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:02:23 user nova-compute[75247]: WARNING nova.compute.manager [req-c4e1dd39-fcc8-4071-9823-0d8cb4be13ed req-6aa58a46-b471-4779-ad7d-4be5185c3991 service nova] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Received unexpected event network-vif-plugged-8cc1d821-1f39-4762-a47f-e3497efe2010 for instance with vm_state building and task_state spawning.
Dec 06 13:02:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:23 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:02:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:24 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 13:02:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 13:02:24 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Instance spawned successfully.
Dec 06 13:02:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 13:02:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:02:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:02:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:02:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:02:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:02:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:02:24 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:02:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:02:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:02:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:02:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:02:24 user nova-compute[75247]: INFO nova.compute.manager [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Took 5.32 seconds to spawn the instance on the hypervisor.
Dec 06 13:02:24 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 13:02:25 user nova-compute[75247]: INFO nova.compute.manager [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Took 35.79 seconds to build instance.
Dec 06 13:02:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7ce14a7a-771d-4f80-a29c-be2b461143c0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "4a2b157c-2630-4578-b970-5b64c0697ae2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.882s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:02:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:25 user nova-compute[75247]: DEBUG nova.compute.manager [req-78723cec-98e4-4227-8d73-338d67db373c req-e14ea7cb-7328-4635-9f29-a81afd4a2544 service nova] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Received event network-vif-plugged-8cc1d821-1f39-4762-a47f-e3497efe2010 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:02:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-78723cec-98e4-4227-8d73-338d67db373c req-e14ea7cb-7328-4635-9f29-a81afd4a2544 service nova] Acquiring lock "4a2b157c-2630-4578-b970-5b64c0697ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:02:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-78723cec-98e4-4227-8d73-338d67db373c req-e14ea7cb-7328-4635-9f29-a81afd4a2544 service nova] Lock "4a2b157c-2630-4578-b970-5b64c0697ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:02:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-78723cec-98e4-4227-8d73-338d67db373c req-e14ea7cb-7328-4635-9f29-a81afd4a2544 service nova] Lock "4a2b157c-2630-4578-b970-5b64c0697ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:02:25 user nova-compute[75247]: DEBUG nova.compute.manager [req-78723cec-98e4-4227-8d73-338d67db373c req-e14ea7cb-7328-4635-9f29-a81afd4a2544 service nova] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] No waiting events found dispatching network-vif-plugged-8cc1d821-1f39-4762-a47f-e3497efe2010 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:02:25 user nova-compute[75247]: WARNING nova.compute.manager [req-78723cec-98e4-4227-8d73-338d67db373c req-e14ea7cb-7328-4635-9f29-a81afd4a2544 service nova] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Received unexpected event network-vif-plugged-8cc1d821-1f39-4762-a47f-e3497efe2010 for instance with vm_state active and task_state None.
Dec 06 13:02:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:02:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:26 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:02:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd88196-5493-434b-a3ba-0146f81dacea/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd88196-5493-434b-a3ba-0146f81dacea/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd88196-5493-434b-a3ba-0146f81dacea/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:02:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd88196-5493-434b-a3ba-0146f81dacea/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:02:28 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:02:28 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:02:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=8169MB free_disk=24.979595184326172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:02:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:02:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:02:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance bc3ddb40-b05f-4170-b269-d44dec6ecdaf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:02:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 530cfb75-7aa8-4e57-b282-8f7a21401b34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:02:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance c603d6dc-804e-4c0d-be1f-40e09de74e8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:02:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 16dd787d-6abe-48f3-ac3c-fd55853b4e23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:02:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance e1f21135-43cd-4dbb-ae7a-b12dffdc5816 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:02:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 0bd88196-5493-434b-a3ba-0146f81dacea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:02:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 4a2b157c-2630-4578-b970-5b64c0697ae2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:02:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:02:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:02:28 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:02:28 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:02:29 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:02:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:02:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:30 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:02:30 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:02:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-c603d6dc-804e-4c0d-be1f-40e09de74e8a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:02:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-c603d6dc-804e-4c0d-be1f-40e09de74e8a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:02:30 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 13:02:30 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Updating instance_info_cache with network_info: [{"id": "96cf8894-1e05-412d-a5f2-6df6a6bd2f6f", "address": "fa:16:3e:6c:dd:e2", "network": {"id": "8691a7c7-5761-40a7-962e-880f95352b9a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-919731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8c750eec93d4bfb9f7d61b6445d9e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96cf8894-1e", "ovs_interfaceid": "96cf8894-1e05-412d-a5f2-6df6a6bd2f6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:02:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-c603d6dc-804e-4c0d-be1f-40e09de74e8a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:02:30 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 13:02:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:36 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:02:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:04 user nova-compute[75247]: DEBUG nova.compute.manager [req-2e1c14ae-8c04-4185-a595-f4f99b908fcf req-02338180-f02e-4c39-a275-0d98a6f2fe37 service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Received event network-changed-2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:03:04 user nova-compute[75247]: DEBUG nova.compute.manager [req-2e1c14ae-8c04-4185-a595-f4f99b908fcf req-02338180-f02e-4c39-a275-0d98a6f2fe37 service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Refreshing instance network info cache due to event network-changed-2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:03:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2e1c14ae-8c04-4185-a595-f4f99b908fcf req-02338180-f02e-4c39-a275-0d98a6f2fe37 service nova] Acquiring lock "refresh_cache-0bd88196-5493-434b-a3ba-0146f81dacea" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:03:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2e1c14ae-8c04-4185-a595-f4f99b908fcf req-02338180-f02e-4c39-a275-0d98a6f2fe37 service nova] Acquired lock "refresh_cache-0bd88196-5493-434b-a3ba-0146f81dacea" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:03:04 user nova-compute[75247]: DEBUG nova.network.neutron [req-2e1c14ae-8c04-4185-a595-f4f99b908fcf req-02338180-f02e-4c39-a275-0d98a6f2fe37 service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Refreshing network info cache for port 2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG nova.network.neutron [req-2e1c14ae-8c04-4185-a595-f4f99b908fcf req-02338180-f02e-4c39-a275-0d98a6f2fe37 service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Updated VIF entry in instance network info cache for port 2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG nova.network.neutron [req-2e1c14ae-8c04-4185-a595-f4f99b908fcf req-02338180-f02e-4c39-a275-0d98a6f2fe37 service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Updating instance_info_cache with network_info: [{"id": "2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73", "address": "fa:16:3e:6c:69:bf", "network": {"id": "053733b9-e8f4-4da1-a5fe-ee7d0704684c", "bridge": "br-int", "label": "tempest-TestStampPattern-239755854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "135f3c1de288423e8964c31ca35664c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e0cf76d-11", "ovs_interfaceid": "2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "0bd88196-5493-434b-a3ba-0146f81dacea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "0bd88196-5493-434b-a3ba-0146f81dacea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2e1c14ae-8c04-4185-a595-f4f99b908fcf req-02338180-f02e-4c39-a275-0d98a6f2fe37 service nova] Releasing lock "refresh_cache-0bd88196-5493-434b-a3ba-0146f81dacea" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG nova.objects.instance [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lazy-loading 'flavor' on Instance uuid 0bd88196-5493-434b-a3ba-0146f81dacea {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "0bd88196-5493-434b-a3ba-0146f81dacea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "0bd88196-5493-434b-a3ba-0146f81dacea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "0bd88196-5493-434b-a3ba-0146f81dacea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:03:05 user nova-compute[75247]: INFO nova.compute.manager [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Attaching volume 32ba2b08-0c2c-4e5a-964c-c25525078170 to /dev/vdb
Dec 06 13:03:05 user nova-compute[75247]: DEBUG os_brick.utils [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdc6057-e186-467a-ac86-cbdb5f81565a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[90178d89-46aa-4d47-810a-05ff8c7982f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc94078-23ef-449b-a4b5-ef7ab7771a7d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8d1b05-4528-457e-a61d-a2cfa862b609]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:03:05 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 13:03:05 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[439c7404-95ba-4877-8f24-50b80ed4ae3a]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG os_brick.utils [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:03:05 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Updating existing volume attachment record: 01ee05f7-e0b1-4142-a3fc-18c1e7ff5c28 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 13:03:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GyErvCtB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:03:16 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:03:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:03:16 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:03:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:03:16 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8bd509-4078-40b6-9536-3f51a0179e30]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 13:03:16 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a711115a-f7c7-4a02-8923-8d41ddcd21db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170] added
Dec 06 13:03:16 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6dded0-42a2-4941-b7bb-efe0cef4ec21]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[33354e37-42e8-447c-b5e5-e22384a0f1a0]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GyErvCtB {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GyErvCtB" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb23668-b100-4295-af2c-3560bc105d60]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GyErvCtB'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6143ac9-e68a-44dc-a6d9-fa0929be8c1b]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[48de3f97-bd38-4c49-913b-a19a11a0276d]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)
Dec 06 13:03:16 user nova-compute[75247]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 (non-flash)
Dec 06 13:03:16 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)
Dec 06 13:03:16 user nova-compute[75247]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 (non-flash)
Dec 06 13:03:16 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f97246-a90d-4ce7-adb7-8204a9d05343]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170, portal: 172.16.0.220,3260]
Dec 06 13:03:16 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170, portal: 172.16.0.220,3260] successful.
Dec 06 13:03:16 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ae0ab7-4b50-4e90-b6b3-128ef087ce46]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8ad495-6c9d-4386-bd20-0c71851bebfb]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)
Dec 06 13:03:16 user nova-compute[75247]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 (non-flash)
Dec 06 13:03:16 user nova-compute[75247]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 (non-flash)
Dec 06 13:03:16 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)
Dec 06 13:03:16 user nova-compute[75247]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 (non-flash)
Dec 06 13:03:16 user nova-compute[75247]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 (non-flash)
Dec 06 13:03:16 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0697ed32-a9b2-46d7-8bfa-62ca9d738c4e]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 13:03:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GyErvCtB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 13:03:17 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:03:17 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26165373963316362', 'path': '/dev/sdc'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:03:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165373963316362', 'path': '/dev/sdc'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 13:03:17 user nova-compute[75247]: DEBUG nova.objects.instance [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lazy-loading 'flavor' on Instance uuid 0bd88196-5493-434b-a3ba-0146f81dacea {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:03:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 13:03:17 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:03:17 user nova-compute[75247]:   <source dev="/dev/sdc"/>
Dec 06 13:03:17 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 13:03:17 user nova-compute[75247]:   <serial>32ba2b08-0c2c-4e5a-964c-c25525078170</serial>
Dec 06 13:03:17 user nova-compute[75247]: </disk>
Dec 06 13:03:17 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 13:03:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:03:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:03:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] No VIF found with MAC fa:16:3e:6c:69:bf, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 13:03:17 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:03:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ec053688-f104-43d7-b2ff-d85a513a0723 tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "0bd88196-5493-434b-a3ba-0146f81dacea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.690s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:03:18 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:03:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "0bd88196-5493-434b-a3ba-0146f81dacea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:03:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "0bd88196-5493-434b-a3ba-0146f81dacea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:03:19 user nova-compute[75247]: INFO nova.compute.manager [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Detaching volume 32ba2b08-0c2c-4e5a-964c-c25525078170
Dec 06 13:03:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:19 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:03:20 user nova-compute[75247]: INFO nova.virt.block_device [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Attempting to driver detach volume 32ba2b08-0c2c-4e5a-964c-c25525078170 from mountpoint /dev/vdb
Dec 06 13:03:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Attempting to detach device vdb from instance 0bd88196-5493-434b-a3ba-0146f81dacea from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 13:03:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 13:03:20 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:03:20 user nova-compute[75247]:   <source dev="/dev/sdc"/>
Dec 06 13:03:20 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 13:03:20 user nova-compute[75247]:   <serial>32ba2b08-0c2c-4e5a-964c-c25525078170</serial>
Dec 06 13:03:20 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 13:03:20 user nova-compute[75247]: </disk>
Dec 06 13:03:20 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 13:03:20 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Successfully detached device vdb from instance 0bd88196-5493-434b-a3ba-0146f81dacea from the persistent domain config.
Dec 06 13:03:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0bd88196-5493-434b-a3ba-0146f81dacea from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 13:03:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 13:03:20 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:03:20 user nova-compute[75247]:   <source dev="/dev/sdc"/>
Dec 06 13:03:20 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 13:03:20 user nova-compute[75247]:   <serial>32ba2b08-0c2c-4e5a-964c-c25525078170</serial>
Dec 06 13:03:20 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 13:03:20 user nova-compute[75247]: </disk>
Dec 06 13:03:20 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 13:03:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0bd88196-5493-434b-a3ba-0146f81dacea {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5e06b398-8ac6-44d6-b674-044efce29a7b tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Acquiring lock "c603d6dc-804e-4c0d-be1f-40e09de74e8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5e06b398-8ac6-44d6-b674-044efce29a7b tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "c603d6dc-804e-4c0d-be1f-40e09de74e8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5e06b398-8ac6-44d6-b674-044efce29a7b tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Acquiring lock "c603d6dc-804e-4c0d-be1f-40e09de74e8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5e06b398-8ac6-44d6-b674-044efce29a7b tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "c603d6dc-804e-4c0d-be1f-40e09de74e8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5e06b398-8ac6-44d6-b674-044efce29a7b tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "c603d6dc-804e-4c0d-be1f-40e09de74e8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:03:21 user nova-compute[75247]: INFO nova.compute.manager [None req-5e06b398-8ac6-44d6-b674-044efce29a7b tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Terminating instance
Dec 06 13:03:21 user nova-compute[75247]: DEBUG nova.compute.manager [None req-5e06b398-8ac6-44d6-b674-044efce29a7b tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-6c0b6977-f932-4de0-b483-8e7c1ee27e21 req-61f71498-64a4-474c-b0b5-983d47af8db5 service nova] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Received event network-vif-unplugged-96cf8894-1e05-412d-a5f2-6df6a6bd2f6f {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6c0b6977-f932-4de0-b483-8e7c1ee27e21 req-61f71498-64a4-474c-b0b5-983d47af8db5 service nova] Acquiring lock "c603d6dc-804e-4c0d-be1f-40e09de74e8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6c0b6977-f932-4de0-b483-8e7c1ee27e21 req-61f71498-64a4-474c-b0b5-983d47af8db5 service nova] Lock "c603d6dc-804e-4c0d-be1f-40e09de74e8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6c0b6977-f932-4de0-b483-8e7c1ee27e21 req-61f71498-64a4-474c-b0b5-983d47af8db5 service nova] Lock "c603d6dc-804e-4c0d-be1f-40e09de74e8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-6c0b6977-f932-4de0-b483-8e7c1ee27e21 req-61f71498-64a4-474c-b0b5-983d47af8db5 service nova] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] No waiting events found dispatching network-vif-unplugged-96cf8894-1e05-412d-a5f2-6df6a6bd2f6f {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-6c0b6977-f932-4de0-b483-8e7c1ee27e21 req-61f71498-64a4-474c-b0b5-983d47af8db5 service nova] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Received event network-vif-unplugged-96cf8894-1e05-412d-a5f2-6df6a6bd2f6f for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 13:03:21 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Instance destroyed successfully.
Dec 06 13:03:21 user nova-compute[75247]: DEBUG nova.objects.instance [None req-5e06b398-8ac6-44d6-b674-044efce29a7b tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lazy-loading 'resources' on Instance uuid c603d6dc-804e-4c0d-be1f-40e09de74e8a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-5e06b398-8ac6-44d6-b674-044efce29a7b tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:54:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1965887220',display_name='tempest-ServersNegativeTestJSON-server-1965887220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1965887220',id=35,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:54:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8c750eec93d4bfb9f7d61b6445d9e42',ramdisk_id='',reservation_id='r-gl3qj2kb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-521653173',owner_user_name='tempest-ServersNegativeTestJSON-521653173-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:54:36Z,user_data=None,user_id='9462e4a57abb48f88f022c3486304df1',uuid=c603d6dc-804e-4c0d-be1f-40e09de74e8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96cf8894-1e05-412d-a5f2-6df6a6bd2f6f", "address": "fa:16:3e:6c:dd:e2", "network": {"id": "8691a7c7-5761-40a7-962e-880f95352b9a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-919731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8c750eec93d4bfb9f7d61b6445d9e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96cf8894-1e", "ovs_interfaceid": "96cf8894-1e05-412d-a5f2-6df6a6bd2f6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-5e06b398-8ac6-44d6-b674-044efce29a7b tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Converting VIF {"id": "96cf8894-1e05-412d-a5f2-6df6a6bd2f6f", "address": "fa:16:3e:6c:dd:e2", "network": {"id": "8691a7c7-5761-40a7-962e-880f95352b9a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-919731775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8c750eec93d4bfb9f7d61b6445d9e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96cf8894-1e", "ovs_interfaceid": "96cf8894-1e05-412d-a5f2-6df6a6bd2f6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-5e06b398-8ac6-44d6-b674-044efce29a7b tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:dd:e2,bridge_name='br-int',has_traffic_filtering=True,id=96cf8894-1e05-412d-a5f2-6df6a6bd2f6f,network=Network(8691a7c7-5761-40a7-962e-880f95352b9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96cf8894-1e') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG os_vif [None req-5e06b398-8ac6-44d6-b674-044efce29a7b tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:dd:e2,bridge_name='br-int',has_traffic_filtering=True,id=96cf8894-1e05-412d-a5f2-6df6a6bd2f6f,network=Network(8691a7c7-5761-40a7-962e-880f95352b9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96cf8894-1e') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96cf8894-1e, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef14c16f-7d72-4f7b-a035-8c569182a9dd) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:21 user nova-compute[75247]: INFO os_vif [None req-5e06b398-8ac6-44d6-b674-044efce29a7b tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:dd:e2,bridge_name='br-int',has_traffic_filtering=True,id=96cf8894-1e05-412d-a5f2-6df6a6bd2f6f,network=Network(8691a7c7-5761-40a7-962e-880f95352b9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96cf8894-1e')
Dec 06 13:03:21 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-5e06b398-8ac6-44d6-b674-044efce29a7b tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Deleting instance files /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a_del
Dec 06 13:03:21 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-5e06b398-8ac6-44d6-b674-044efce29a7b tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Deletion of /opt/stack/data/nova/instances/c603d6dc-804e-4c0d-be1f-40e09de74e8a_del complete
Dec 06 13:03:22 user nova-compute[75247]: INFO nova.compute.manager [None req-5e06b398-8ac6-44d6-b674-044efce29a7b tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Took 0.69 seconds to destroy the instance on the hypervisor.
Dec 06 13:03:22 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-5e06b398-8ac6-44d6-b674-044efce29a7b tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 13:03:22 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 13:03:22 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 13:03:22 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:03:22 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Took 0.43 seconds to deallocate network for instance.
Dec 06 13:03:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-577ec099-4789-40a0-a90c-4d47dde3c24a req-fb0374d0-6ce1-4cb6-9e59-8e3813aa3666 service nova] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Received event network-vif-deleted-96cf8894-1e05-412d-a5f2-6df6a6bd2f6f {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:03:22 user nova-compute[75247]: INFO nova.compute.manager [req-577ec099-4789-40a0-a90c-4d47dde3c24a req-fb0374d0-6ce1-4cb6-9e59-8e3813aa3666 service nova] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Neutron deleted interface 96cf8894-1e05-412d-a5f2-6df6a6bd2f6f; detaching it from the instance and deleting it from the info cache
Dec 06 13:03:22 user nova-compute[75247]: DEBUG nova.network.neutron [req-577ec099-4789-40a0-a90c-4d47dde3c24a req-fb0374d0-6ce1-4cb6-9e59-8e3813aa3666 service nova] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:03:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-577ec099-4789-40a0-a90c-4d47dde3c24a req-fb0374d0-6ce1-4cb6-9e59-8e3813aa3666 service nova] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Detach interface failed, port_id=96cf8894-1e05-412d-a5f2-6df6a6bd2f6f, reason: Instance c603d6dc-804e-4c0d-be1f-40e09de74e8a could not be found. {{(pid=75247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 13:03:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5e06b398-8ac6-44d6-b674-044efce29a7b tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:03:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5e06b398-8ac6-44d6-b674-044efce29a7b tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:03:22 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-5e06b398-8ac6-44d6-b674-044efce29a7b tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:03:22 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-5e06b398-8ac6-44d6-b674-044efce29a7b tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:03:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5e06b398-8ac6-44d6-b674-044efce29a7b tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:03:22 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-5e06b398-8ac6-44d6-b674-044efce29a7b tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Deleted allocations for instance c603d6dc-804e-4c0d-be1f-40e09de74e8a
Dec 06 13:03:22 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:03:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5e06b398-8ac6-44d6-b674-044efce29a7b tempest-ServersNegativeTestJSON-521653173 tempest-ServersNegativeTestJSON-521653173-project-member] Lock "c603d6dc-804e-4c0d-be1f-40e09de74e8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.634s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:03:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-0049961c-a97f-44ab-a17e-39d706b82817 req-305168ce-ff9e-45f5-b608-72b76e652bda service nova] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Received event network-vif-plugged-96cf8894-1e05-412d-a5f2-6df6a6bd2f6f {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:03:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0049961c-a97f-44ab-a17e-39d706b82817 req-305168ce-ff9e-45f5-b608-72b76e652bda service nova] Acquiring lock "c603d6dc-804e-4c0d-be1f-40e09de74e8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:03:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0049961c-a97f-44ab-a17e-39d706b82817 req-305168ce-ff9e-45f5-b608-72b76e652bda service nova] Lock "c603d6dc-804e-4c0d-be1f-40e09de74e8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:03:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0049961c-a97f-44ab-a17e-39d706b82817 req-305168ce-ff9e-45f5-b608-72b76e652bda service nova] Lock "c603d6dc-804e-4c0d-be1f-40e09de74e8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:03:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-0049961c-a97f-44ab-a17e-39d706b82817 req-305168ce-ff9e-45f5-b608-72b76e652bda service nova] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] No waiting events found dispatching network-vif-plugged-96cf8894-1e05-412d-a5f2-6df6a6bd2f6f {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:03:23 user nova-compute[75247]: WARNING nova.compute.manager [req-0049961c-a97f-44ab-a17e-39d706b82817 req-305168ce-ff9e-45f5-b608-72b76e652bda service nova] [instance: c603d6dc-804e-4c0d-be1f-40e09de74e8a] Received unexpected event network-vif-plugged-96cf8894-1e05-412d-a5f2-6df6a6bd2f6f for instance with vm_state deleted and task_state None.
Dec 06 13:03:23 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:03:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:24 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:03:24 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:03:24 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:03:24 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:03:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:03:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:03:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:03:24 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:03:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:03:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:03:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd88196-5493-434b-a3ba-0146f81dacea/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd88196-5493-434b-a3ba-0146f81dacea/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd88196-5493-434b-a3ba-0146f81dacea/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd88196-5493-434b-a3ba-0146f81dacea/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:27 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:03:27 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:03:27 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=8273MB free_disk=25.004520416259766GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:03:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:03:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:03:27 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance bc3ddb40-b05f-4170-b269-d44dec6ecdaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:03:27 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 530cfb75-7aa8-4e57-b282-8f7a21401b34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:03:27 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 16dd787d-6abe-48f3-ac3c-fd55853b4e23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:03:27 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance e1f21135-43cd-4dbb-ae7a-b12dffdc5816 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:03:27 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 0bd88196-5493-434b-a3ba-0146f81dacea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:03:27 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 4a2b157c-2630-4578-b970-5b64c0697ae2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:03:27 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:03:27 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:03:28 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:03:28 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:03:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:03:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:03:30 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:03:30 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:03:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-16dd787d-6abe-48f3-ac3c-fd55853b4e23" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:03:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-16dd787d-6abe-48f3-ac3c-fd55853b4e23" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:03:30 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 13:03:30 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Updating instance_info_cache with network_info: [{"id": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "address": "fa:16:3e:f9:7b:5b", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8804e1-c0", "ovs_interfaceid": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:03:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-16dd787d-6abe-48f3-ac3c-fd55853b4e23" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:03:30 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 13:03:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Acquiring lock "c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:03:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Lock "c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:03:34 user nova-compute[75247]: DEBUG nova.compute.manager [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 13:03:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:03:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:03:34 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 13:03:34 user nova-compute[75247]: INFO nova.compute.claims [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Claim successful on node user
Dec 06 13:03:35 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:03:35 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:03:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:03:35 user nova-compute[75247]: DEBUG nova.compute.manager [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 13:03:35 user nova-compute[75247]: DEBUG nova.compute.manager [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 13:03:35 user nova-compute[75247]: DEBUG nova.network.neutron [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 13:03:35 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 13:03:35 user nova-compute[75247]: DEBUG nova.compute.manager [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 13:03:35 user nova-compute[75247]: DEBUG nova.policy [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7e2206177f54248b4da5b00487834a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b2a4d68f4045bfa71962e75cc6025d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 13:03:35 user nova-compute[75247]: DEBUG nova.compute.manager [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 13:03:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 13:03:35 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Creating image(s)
Dec 06 13:03:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Acquiring lock "/opt/stack/data/nova/instances/c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:03:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Lock "/opt/stack/data/nova/instances/c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:03:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Lock "/opt/stack/data/nova/instances/c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:03:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.193s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:03:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:03:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.197s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb/disk 1073741824" returned: 0 in 0.067s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:03:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:36 user nova-compute[75247]: DEBUG nova.network.neutron [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Successfully created port: 94fd19d6-0a33-411a-a022-5f48d5fcbf81 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 13:03:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.181s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:36 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 13:03:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:36 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Cannot resize image /opt/stack/data/nova/instances/c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 13:03:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 13:03:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Ensure instance console log exists: /opt/stack/data/nova/instances/c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 13:03:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:03:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:03:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:03:36 user nova-compute[75247]: DEBUG nova.network.neutron [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Successfully updated port: 94fd19d6-0a33-411a-a022-5f48d5fcbf81 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 13:03:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Acquiring lock "refresh_cache-c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:03:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Acquired lock "refresh_cache-c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:03:36 user nova-compute[75247]: DEBUG nova.network.neutron [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 13:03:36 user nova-compute[75247]: DEBUG nova.compute.manager [req-cb97df1e-d2cd-4156-b36c-2f6782cba104 req-fa20c686-53c8-46bd-983a-0301dca21225 service nova] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Received event network-changed-94fd19d6-0a33-411a-a022-5f48d5fcbf81 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:03:36 user nova-compute[75247]: DEBUG nova.compute.manager [req-cb97df1e-d2cd-4156-b36c-2f6782cba104 req-fa20c686-53c8-46bd-983a-0301dca21225 service nova] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Refreshing instance network info cache due to event network-changed-94fd19d6-0a33-411a-a022-5f48d5fcbf81. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:03:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-cb97df1e-d2cd-4156-b36c-2f6782cba104 req-fa20c686-53c8-46bd-983a-0301dca21225 service nova] Acquiring lock "refresh_cache-c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:03:36 user nova-compute[75247]: DEBUG nova.network.neutron [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.compute.manager [req-6665328d-1097-424c-b7ec-e85add4e5c21 req-2da15445-673c-4c23-8ed2-9e2ccddca74a service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received event network-changed-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.compute.manager [req-6665328d-1097-424c-b7ec-e85add4e5c21 req-2da15445-673c-4c23-8ed2-9e2ccddca74a service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Refreshing instance network info cache due to event network-changed-3a8804e1-c0a2-4f4a-941e-5fc617f45d93. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6665328d-1097-424c-b7ec-e85add4e5c21 req-2da15445-673c-4c23-8ed2-9e2ccddca74a service nova] Acquiring lock "refresh_cache-16dd787d-6abe-48f3-ac3c-fd55853b4e23" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6665328d-1097-424c-b7ec-e85add4e5c21 req-2da15445-673c-4c23-8ed2-9e2ccddca74a service nova] Acquired lock "refresh_cache-16dd787d-6abe-48f3-ac3c-fd55853b4e23" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.network.neutron [req-6665328d-1097-424c-b7ec-e85add4e5c21 req-2da15445-673c-4c23-8ed2-9e2ccddca74a service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Refreshing network info cache for port 3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.network.neutron [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Updating instance_info_cache with network_info: [{"id": "94fd19d6-0a33-411a-a022-5f48d5fcbf81", "address": "fa:16:3e:ce:80:b4", "network": {"id": "5aa2ea25-254d-408e-9f5a-8d5eb1a612d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cdd9b7fb5eaf469d885ee225099128e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fd19d6-0a", "ovs_interfaceid": "94fd19d6-0a33-411a-a022-5f48d5fcbf81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Releasing lock "refresh_cache-c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.compute.manager [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Instance network_info: |[{"id": "94fd19d6-0a33-411a-a022-5f48d5fcbf81", "address": "fa:16:3e:ce:80:b4", "network": {"id": "5aa2ea25-254d-408e-9f5a-8d5eb1a612d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cdd9b7fb5eaf469d885ee225099128e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fd19d6-0a", "ovs_interfaceid": "94fd19d6-0a33-411a-a022-5f48d5fcbf81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-cb97df1e-d2cd-4156-b36c-2f6782cba104 req-fa20c686-53c8-46bd-983a-0301dca21225 service nova] Acquired lock "refresh_cache-c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.network.neutron [req-cb97df1e-d2cd-4156-b36c-2f6782cba104 req-fa20c686-53c8-46bd-983a-0301dca21225 service nova] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Refreshing network info cache for port 94fd19d6-0a33-411a-a022-5f48d5fcbf81 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Start _get_guest_xml network_info=[{"id": "94fd19d6-0a33-411a-a022-5f48d5fcbf81", "address": "fa:16:3e:ce:80:b4", "network": {"id": "5aa2ea25-254d-408e-9f5a-8d5eb1a612d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cdd9b7fb5eaf469d885ee225099128e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fd19d6-0a", "ovs_interfaceid": "94fd19d6-0a33-411a-a022-5f48d5fcbf81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 13:03:37 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:03:37 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:03:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1187805885',display_name='tempest-VolumesNegativeTest-instance-1187805885',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1187805885',id=43,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80b2a4d68f4045bfa71962e75cc6025d',ramdisk_id='',reservation_id='r-npq4qwgh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-751249540',owner_user_name='tempest-VolumesNegativeTest-751249540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:03:35Z,user_data=None,user_id='b7e2206177f54248b4da5b00487834a7',uuid=c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94fd19d6-0a33-411a-a022-5f48d5fcbf81", "address": "fa:16:3e:ce:80:b4", "network": {"id": "5aa2ea25-254d-408e-9f5a-8d5eb1a612d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cdd9b7fb5eaf469d885ee225099128e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fd19d6-0a", "ovs_interfaceid": "94fd19d6-0a33-411a-a022-5f48d5fcbf81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Converting VIF {"id": "94fd19d6-0a33-411a-a022-5f48d5fcbf81", "address": "fa:16:3e:ce:80:b4", "network": {"id": "5aa2ea25-254d-408e-9f5a-8d5eb1a612d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cdd9b7fb5eaf469d885ee225099128e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fd19d6-0a", "ovs_interfaceid": "94fd19d6-0a33-411a-a022-5f48d5fcbf81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:80:b4,bridge_name='br-int',has_traffic_filtering=True,id=94fd19d6-0a33-411a-a022-5f48d5fcbf81,network=Network(5aa2ea25-254d-408e-9f5a-8d5eb1a612d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fd19d6-0a') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.objects.instance [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Lazy-loading 'pci_devices' on Instance uuid c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] End _get_guest_xml xml=<domain type="kvm">
Dec 06 13:03:37 user nova-compute[75247]:   <uuid>c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb</uuid>
Dec 06 13:03:37 user nova-compute[75247]:   <name>instance-0000002b</name>
Dec 06 13:03:37 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 13:03:37 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 13:03:37 user nova-compute[75247]:   <metadata>
Dec 06 13:03:37 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 13:03:37 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 13:03:37 user nova-compute[75247]:       <nova:name>tempest-VolumesNegativeTest-instance-1187805885</nova:name>
Dec 06 13:03:37 user nova-compute[75247]:       <nova:creationTime>2023-12-06 13:03:37</nova:creationTime>
Dec 06 13:03:37 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 13:03:37 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 13:03:37 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 13:03:37 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 13:03:37 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 13:03:37 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 13:03:37 user nova-compute[75247]:       </nova:flavor>
Dec 06 13:03:37 user nova-compute[75247]:       <nova:owner>
Dec 06 13:03:37 user nova-compute[75247]:         <nova:user uuid="b7e2206177f54248b4da5b00487834a7">tempest-VolumesNegativeTest-751249540-project-member</nova:user>
Dec 06 13:03:37 user nova-compute[75247]:         <nova:project uuid="80b2a4d68f4045bfa71962e75cc6025d">tempest-VolumesNegativeTest-751249540</nova:project>
Dec 06 13:03:37 user nova-compute[75247]:       </nova:owner>
Dec 06 13:03:37 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 13:03:37 user nova-compute[75247]:       <nova:ports>
Dec 06 13:03:37 user nova-compute[75247]:         <nova:port uuid="94fd19d6-0a33-411a-a022-5f48d5fcbf81">
Dec 06 13:03:37 user nova-compute[75247]:           <nova:ip type="fixed" address="192.168.233.76" ipVersion="4"/>
Dec 06 13:03:37 user nova-compute[75247]:         </nova:port>
Dec 06 13:03:37 user nova-compute[75247]:       </nova:ports>
Dec 06 13:03:37 user nova-compute[75247]:     </nova:instance>
Dec 06 13:03:37 user nova-compute[75247]:   </metadata>
Dec 06 13:03:37 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 13:03:37 user nova-compute[75247]:     <system>
Dec 06 13:03:37 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 13:03:37 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 13:03:37 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 13:03:37 user nova-compute[75247]:       <entry name="serial">c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb</entry>
Dec 06 13:03:37 user nova-compute[75247]:       <entry name="uuid">c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb</entry>
Dec 06 13:03:37 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 13:03:37 user nova-compute[75247]:     </system>
Dec 06 13:03:37 user nova-compute[75247]:   </sysinfo>
Dec 06 13:03:37 user nova-compute[75247]:   <os>
Dec 06 13:03:37 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 13:03:37 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 13:03:37 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 13:03:37 user nova-compute[75247]:   </os>
Dec 06 13:03:37 user nova-compute[75247]:   <features>
Dec 06 13:03:37 user nova-compute[75247]:     <acpi/>
Dec 06 13:03:37 user nova-compute[75247]:     <apic/>
Dec 06 13:03:37 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 13:03:37 user nova-compute[75247]:   </features>
Dec 06 13:03:37 user nova-compute[75247]:   <clock offset="utc">
Dec 06 13:03:37 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 13:03:37 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 13:03:37 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 13:03:37 user nova-compute[75247]:   </clock>
Dec 06 13:03:37 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 13:03:37 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 13:03:37 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 13:03:37 user nova-compute[75247]:   </cpu>
Dec 06 13:03:37 user nova-compute[75247]:   <devices>
Dec 06 13:03:37 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 13:03:37 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 13:03:37 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb/disk"/>
Dec 06 13:03:37 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 13:03:37 user nova-compute[75247]:     </disk>
Dec 06 13:03:37 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 13:03:37 user nova-compute[75247]:       <mac address="fa:16:3e:ce:80:b4"/>
Dec 06 13:03:37 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:03:37 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 13:03:37 user nova-compute[75247]:       <target dev="tap94fd19d6-0a"/>
Dec 06 13:03:37 user nova-compute[75247]:     </interface>
Dec 06 13:03:37 user nova-compute[75247]:     <serial type="pty">
Dec 06 13:03:37 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb/console.log" append="off"/>
Dec 06 13:03:37 user nova-compute[75247]:     </serial>
Dec 06 13:03:37 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 13:03:37 user nova-compute[75247]:     <video>
Dec 06 13:03:37 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:03:37 user nova-compute[75247]:     </video>
Dec 06 13:03:37 user nova-compute[75247]:     <rng model="virtio">
Dec 06 13:03:37 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 13:03:37 user nova-compute[75247]:     </rng>
Dec 06 13:03:37 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 13:03:37 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 13:03:37 user nova-compute[75247]:       <stats period="10"/>
Dec 06 13:03:37 user nova-compute[75247]:     </memballoon>
Dec 06 13:03:37 user nova-compute[75247]:   </devices>
Dec 06 13:03:37 user nova-compute[75247]: </domain>
Dec 06 13:03:37 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:03:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1187805885',display_name='tempest-VolumesNegativeTest-instance-1187805885',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1187805885',id=43,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80b2a4d68f4045bfa71962e75cc6025d',ramdisk_id='',reservation_id='r-npq4qwgh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-751249540',owner_user_name='tempest-VolumesNegativeTest-751249540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:03:35Z,user_data=None,user_id='b7e2206177f54248b4da5b00487834a7',uuid=c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94fd19d6-0a33-411a-a022-5f48d5fcbf81", "address": "fa:16:3e:ce:80:b4", "network": {"id": "5aa2ea25-254d-408e-9f5a-8d5eb1a612d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cdd9b7fb5eaf469d885ee225099128e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fd19d6-0a", "ovs_interfaceid": "94fd19d6-0a33-411a-a022-5f48d5fcbf81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Converting VIF {"id": "94fd19d6-0a33-411a-a022-5f48d5fcbf81", "address": "fa:16:3e:ce:80:b4", "network": {"id": "5aa2ea25-254d-408e-9f5a-8d5eb1a612d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cdd9b7fb5eaf469d885ee225099128e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fd19d6-0a", "ovs_interfaceid": "94fd19d6-0a33-411a-a022-5f48d5fcbf81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:80:b4,bridge_name='br-int',has_traffic_filtering=True,id=94fd19d6-0a33-411a-a022-5f48d5fcbf81,network=Network(5aa2ea25-254d-408e-9f5a-8d5eb1a612d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fd19d6-0a') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG os_vif [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:80:b4,bridge_name='br-int',has_traffic_filtering=True,id=94fd19d6-0a33-411a-a022-5f48d5fcbf81,network=Network(5aa2ea25-254d-408e-9f5a-8d5eb1a612d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fd19d6-0a') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fad20afb-2649-5375-bec2-a9a83739035a', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:03:37 user nova-compute[75247]: INFO nova.compute.manager [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Detaching volume 29be7905-6db7-4b52-a629-d772283ff9aa
Dec 06 13:03:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94fd19d6-0a, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94fd19d6-0a, col_values=(('qos', UUID('ca925d55-22fb-42a7-9e6d-b80cfaeb2f75')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94fd19d6-0a, col_values=(('external_ids', {'iface-id': '94fd19d6-0a33-411a-a022-5f48d5fcbf81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:80:b4', 'vm-uuid': 'c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:37 user nova-compute[75247]: INFO os_vif [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:80:b4,bridge_name='br-int',has_traffic_filtering=True,id=94fd19d6-0a33-411a-a022-5f48d5fcbf81,network=Network(5aa2ea25-254d-408e-9f5a-8d5eb1a612d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fd19d6-0a')
Dec 06 13:03:37 user nova-compute[75247]: INFO nova.virt.block_device [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Attempting to driver detach volume 29be7905-6db7-4b52-a629-d772283ff9aa from mountpoint /dev/vdb
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Attempting to detach device vdb from instance 16dd787d-6abe-48f3-ac3c-fd55853b4e23 from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 13:03:37 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:03:37 user nova-compute[75247]:   <source dev="/dev/sdd"/>
Dec 06 13:03:37 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 13:03:37 user nova-compute[75247]:   <serial>29be7905-6db7-4b52-a629-d772283ff9aa</serial>
Dec 06 13:03:37 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 13:03:37 user nova-compute[75247]: </disk>
Dec 06 13:03:37 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] No VIF found with MAC fa:16:3e:ce:80:b4, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 13:03:37 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Successfully detached device vdb from instance 16dd787d-6abe-48f3-ac3c-fd55853b4e23 from the persistent domain config.
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 16dd787d-6abe-48f3-ac3c-fd55853b4e23 from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 13:03:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 13:03:37 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:03:37 user nova-compute[75247]:   <source dev="/dev/sdd"/>
Dec 06 13:03:37 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 13:03:37 user nova-compute[75247]:   <serial>29be7905-6db7-4b52-a629-d772283ff9aa</serial>
Dec 06 13:03:37 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 13:03:37 user nova-compute[75247]: </disk>
Dec 06 13:03:37 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 13:03:38 user nova-compute[75247]: DEBUG nova.network.neutron [req-6665328d-1097-424c-b7ec-e85add4e5c21 req-2da15445-673c-4c23-8ed2-9e2ccddca74a service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Updated VIF entry in instance network info cache for port 3a8804e1-c0a2-4f4a-941e-5fc617f45d93. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:03:38 user nova-compute[75247]: DEBUG nova.network.neutron [req-6665328d-1097-424c-b7ec-e85add4e5c21 req-2da15445-673c-4c23-8ed2-9e2ccddca74a service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Updating instance_info_cache with network_info: [{"id": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "address": "fa:16:3e:f9:7b:5b", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8804e1-c0", "ovs_interfaceid": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:03:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6665328d-1097-424c-b7ec-e85add4e5c21 req-2da15445-673c-4c23-8ed2-9e2ccddca74a service nova] Releasing lock "refresh_cache-16dd787d-6abe-48f3-ac3c-fd55853b4e23" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:03:38 user nova-compute[75247]: DEBUG nova.network.neutron [req-cb97df1e-d2cd-4156-b36c-2f6782cba104 req-fa20c686-53c8-46bd-983a-0301dca21225 service nova] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Updated VIF entry in instance network info cache for port 94fd19d6-0a33-411a-a022-5f48d5fcbf81. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:03:38 user nova-compute[75247]: DEBUG nova.network.neutron [req-cb97df1e-d2cd-4156-b36c-2f6782cba104 req-fa20c686-53c8-46bd-983a-0301dca21225 service nova] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Updating instance_info_cache with network_info: [{"id": "94fd19d6-0a33-411a-a022-5f48d5fcbf81", "address": "fa:16:3e:ce:80:b4", "network": {"id": "5aa2ea25-254d-408e-9f5a-8d5eb1a612d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cdd9b7fb5eaf469d885ee225099128e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fd19d6-0a", "ovs_interfaceid": "94fd19d6-0a33-411a-a022-5f48d5fcbf81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:03:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-cb97df1e-d2cd-4156-b36c-2f6782cba104 req-fa20c686-53c8-46bd-983a-0301dca21225 service nova] Releasing lock "refresh_cache-c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:03:38 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 16dd787d-6abe-48f3-ac3c-fd55853b4e23 {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 13:03:39 user nova-compute[75247]: DEBUG nova.compute.manager [req-a7543f48-83c2-4020-ad37-19380b02bb35 req-e5538948-0b9b-423b-a2a3-6fb270c56cc0 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received event network-changed-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:03:39 user nova-compute[75247]: DEBUG nova.compute.manager [req-a7543f48-83c2-4020-ad37-19380b02bb35 req-e5538948-0b9b-423b-a2a3-6fb270c56cc0 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Refreshing instance network info cache due to event network-changed-3a8804e1-c0a2-4f4a-941e-5fc617f45d93. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:03:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a7543f48-83c2-4020-ad37-19380b02bb35 req-e5538948-0b9b-423b-a2a3-6fb270c56cc0 service nova] Acquiring lock "refresh_cache-16dd787d-6abe-48f3-ac3c-fd55853b4e23" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:03:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a7543f48-83c2-4020-ad37-19380b02bb35 req-e5538948-0b9b-423b-a2a3-6fb270c56cc0 service nova] Acquired lock "refresh_cache-16dd787d-6abe-48f3-ac3c-fd55853b4e23" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:03:39 user nova-compute[75247]: DEBUG nova.network.neutron [req-a7543f48-83c2-4020-ad37-19380b02bb35 req-e5538948-0b9b-423b-a2a3-6fb270c56cc0 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Refreshing network info cache for port 3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:03:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:39 user nova-compute[75247]: DEBUG nova.compute.manager [req-a15cda7e-de54-448f-9c28-60ff79ba01b4 req-743fd0fb-862d-429f-89c7-385bfecb9c43 service nova] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Received event network-vif-plugged-94fd19d6-0a33-411a-a022-5f48d5fcbf81 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:03:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a15cda7e-de54-448f-9c28-60ff79ba01b4 req-743fd0fb-862d-429f-89c7-385bfecb9c43 service nova] Acquiring lock "c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:03:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a15cda7e-de54-448f-9c28-60ff79ba01b4 req-743fd0fb-862d-429f-89c7-385bfecb9c43 service nova] Lock "c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:03:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a15cda7e-de54-448f-9c28-60ff79ba01b4 req-743fd0fb-862d-429f-89c7-385bfecb9c43 service nova] Lock "c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:03:39 user nova-compute[75247]: DEBUG nova.compute.manager [req-a15cda7e-de54-448f-9c28-60ff79ba01b4 req-743fd0fb-862d-429f-89c7-385bfecb9c43 service nova] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] No waiting events found dispatching network-vif-plugged-94fd19d6-0a33-411a-a022-5f48d5fcbf81 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:03:39 user nova-compute[75247]: WARNING nova.compute.manager [req-a15cda7e-de54-448f-9c28-60ff79ba01b4 req-743fd0fb-862d-429f-89c7-385bfecb9c43 service nova] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Received unexpected event network-vif-plugged-94fd19d6-0a33-411a-a022-5f48d5fcbf81 for instance with vm_state building and task_state spawning.
Dec 06 13:03:39 user nova-compute[75247]: DEBUG nova.network.neutron [req-a7543f48-83c2-4020-ad37-19380b02bb35 req-e5538948-0b9b-423b-a2a3-6fb270c56cc0 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Updated VIF entry in instance network info cache for port 3a8804e1-c0a2-4f4a-941e-5fc617f45d93. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:03:39 user nova-compute[75247]: DEBUG nova.network.neutron [req-a7543f48-83c2-4020-ad37-19380b02bb35 req-e5538948-0b9b-423b-a2a3-6fb270c56cc0 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Updating instance_info_cache with network_info: [{"id": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "address": "fa:16:3e:f9:7b:5b", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8804e1-c0", "ovs_interfaceid": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:03:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a7543f48-83c2-4020-ad37-19380b02bb35 req-e5538948-0b9b-423b-a2a3-6fb270c56cc0 service nova] Releasing lock "refresh_cache-16dd787d-6abe-48f3-ac3c-fd55853b4e23" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "4a2b157c-2630-4578-b970-5b64c0697ae2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "4a2b157c-2630-4578-b970-5b64c0697ae2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "4a2b157c-2630-4578-b970-5b64c0697ae2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "4a2b157c-2630-4578-b970-5b64c0697ae2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "4a2b157c-2630-4578-b970-5b64c0697ae2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:03:40 user nova-compute[75247]: INFO nova.compute.manager [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Terminating instance
Dec 06 13:03:40 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:40 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0bd88196-5493-434b-a3ba-0146f81dacea is timed out.
Dec 06 13:03:40 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Successfully detached device vdb from instance 0bd88196-5493-434b-a3ba-0146f81dacea from the live domain config.
Dec 06 13:03:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GyErvCtB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:03:40 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55b0903-19f5-4217-9e3a-1442a20a5826]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 13:03:40 user nova-compute[75247]: No targets found.
Dec 06 13:03:40 user nova-compute[75247]: iSNS:
Dec 06 13:03:40 user nova-compute[75247]: No targets found.
Dec 06 13:03:40 user nova-compute[75247]: STATIC:
Dec 06 13:03:40 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa
Dec 06 13:03:40 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:03:40 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:03:40 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06
Dec 06 13:03:40 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:03:40 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:03:40 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170
Dec 06 13:03:40 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:03:40 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:03:40 user nova-compute[75247]: FIRMWARE:
Dec 06 13:03:40 user nova-compute[75247]: No targets found.
Dec 06 13:03:40 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 13:03:40 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 13:03:40 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8514ee9-f709-491b-a828-7701c7219284]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb01050a-24ae-4aa5-96fd-2e0ae153f758]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)
Dec 06 13:03:40 user nova-compute[75247]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 (non-flash)
Dec 06 13:03:40 user nova-compute[75247]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 (non-flash)
Dec 06 13:03:40 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)
Dec 06 13:03:40 user nova-compute[75247]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 (non-flash)
Dec 06 13:03:40 user nova-compute[75247]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 (non-flash)
Dec 06 13:03:40 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd7304cd000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170'): ({'sdc'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Removing single pathed devices sdc {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67398c9-cbe6-4cc8-9b3b-dbae0869ced2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8b2072-412b-46dd-958a-6429fee8a0f5]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Flushing IO for device /dev/sdc {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6300ff90-7c05-4e58-b705-a2660c6b9f06]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace4b1c0-532e-4e83-8e09-173df4788c4a]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] SCSI volumes sdc have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[751cbee9-4292-4737-89c6-81f14faf6df2]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f276c071-b507-4443-88ab-ed5dfa32442a]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170, portal: 172.16.0.220,3260]
Dec 06 13:03:40 user nova-compute[75247]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170, portal: 172.16.0.220,3260] successful.
Dec 06 13:03:40 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ba2b08-0c2c-4e5a-964c-c25525078170 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdac094-7b56-41b5-b3e8-602782ca3c6c]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] <== disconnect_volume: return (300ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 13:03:40 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Instance destroyed successfully.
Dec 06 13:03:40 user nova-compute[75247]: DEBUG nova.objects.instance [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lazy-loading 'resources' on Instance uuid 4a2b157c-2630-4578-b970-5b64c0697ae2 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:01:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-121822901',display_name='tempest-TestVolumeBootPattern-server-121822901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-121822901',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T13:02:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9493d9b0b1024cea9a550e2a42c1e6a1',ramdisk_id='',reservation_id='r-6e3gl05j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2088852773',owner_user_name='tempest-TestVolumeBootPattern-2088852773-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T13:02:25Z,user_data=None,user_id='016714f7502b4a8fa12ed0ce6644c5fc',uuid=4a2b157c-2630-4578-b970-5b64c0697ae2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cc1d821-1f39-4762-a47f-e3497efe2010", "address": "fa:16:3e:1e:12:5d", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc1d821-1f", "ovs_interfaceid": "8cc1d821-1f39-4762-a47f-e3497efe2010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converting VIF {"id": "8cc1d821-1f39-4762-a47f-e3497efe2010", "address": "fa:16:3e:1e:12:5d", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc1d821-1f", "ovs_interfaceid": "8cc1d821-1f39-4762-a47f-e3497efe2010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:12:5d,bridge_name='br-int',has_traffic_filtering=True,id=8cc1d821-1f39-4762-a47f-e3497efe2010,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc1d821-1f') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_vif [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:12:5d,bridge_name='br-int',has_traffic_filtering=True,id=8cc1d821-1f39-4762-a47f-e3497efe2010,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc1d821-1f') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8cc1d821-1f, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22c6b7b0-a2cd-46f4-9bad-93d237e45358) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:03:40 user nova-compute[75247]: INFO os_vif [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:12:5d,bridge_name='br-int',has_traffic_filtering=True,id=8cc1d821-1f39-4762-a47f-e3497efe2010,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc1d821-1f')
Dec 06 13:03:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUsMlgiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:03:40 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba52899-7374-4a3c-8d9a-4221f79517c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 13:03:40 user nova-compute[75247]: No targets found.
Dec 06 13:03:40 user nova-compute[75247]: iSNS:
Dec 06 13:03:40 user nova-compute[75247]: No targets found.
Dec 06 13:03:40 user nova-compute[75247]: STATIC:
Dec 06 13:03:40 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa
Dec 06 13:03:40 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:03:40 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:03:40 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06
Dec 06 13:03:40 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:03:40 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:03:40 user nova-compute[75247]: FIRMWARE:
Dec 06 13:03:40 user nova-compute[75247]: No targets found.
Dec 06 13:03:40 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 13:03:40 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 13:03:40 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1369c4c-2b61-42e7-9bac-dea667c88c7d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7558e177-a9ad-4f93-9993-92a2b0468825]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)
Dec 06 13:03:40 user nova-compute[75247]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 (non-flash)
Dec 06 13:03:40 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)
Dec 06 13:03:40 user nova-compute[75247]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 (non-flash)
Dec 06 13:03:40 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd730568e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06'): ({'sdb'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Removing single pathed devices sdb {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[602cc771-45c8-46c7-b3c7-dee55a7179ce]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d11d084-e820-4b03-9695-2f68193030b3]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Flushing IO for device /dev/sdb {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa357ed-74b4-45f2-b06a-3ef816721e8c]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[129c5910-ed4b-479a-b4eb-5200fe9d3232]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO533f7aae-8daa39daa4a41929', '/dev/disk/by-id/scsi-23864616133396461', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_533f7aae') {{(pid=86354) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 06 13:03:41 user nova-compute[75247]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO533f7aae-8daa39daa4a41929
Dec 06 13:03:41 user nova-compute[75247]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23864616133396461
Dec 06 13:03:41 user nova-compute[75247]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_533f7aae
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3a379f-1a7d-433f-8854-f85eabef0a42]: (4, None) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.040s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc552a56-153c-4429-9209-b483ad5d2c25]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[278e2215-10de-4e79-aee7-a667f1e1ff56]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06, portal: 172.16.0.220,3260]
Dec 06 13:03:41 user nova-compute[75247]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06, portal: 172.16.0.220,3260] successful.
Dec 06 13:03:41 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b3638b-715c-43af-aeb4-71194281ea06 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09a4632-36d0-4620-b2c1-5575d91fe2e2]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] <== disconnect_volume: return (318ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 13:03:41 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Deleting instance files /opt/stack/data/nova/instances/4a2b157c-2630-4578-b970-5b64c0697ae2_del
Dec 06 13:03:41 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Deletion of /opt/stack/data/nova/instances/4a2b157c-2630-4578-b970-5b64c0697ae2_del complete
Dec 06 13:03:41 user nova-compute[75247]: DEBUG nova.compute.manager [req-90bd166c-4caf-414e-aa70-dc2b5c47a1f7 req-3ef81a7b-7840-4b28-8388-ce5c5d026edb service nova] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Received event network-vif-unplugged-8cc1d821-1f39-4762-a47f-e3497efe2010 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-90bd166c-4caf-414e-aa70-dc2b5c47a1f7 req-3ef81a7b-7840-4b28-8388-ce5c5d026edb service nova] Acquiring lock "4a2b157c-2630-4578-b970-5b64c0697ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-90bd166c-4caf-414e-aa70-dc2b5c47a1f7 req-3ef81a7b-7840-4b28-8388-ce5c5d026edb service nova] Lock "4a2b157c-2630-4578-b970-5b64c0697ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-90bd166c-4caf-414e-aa70-dc2b5c47a1f7 req-3ef81a7b-7840-4b28-8388-ce5c5d026edb service nova] Lock "4a2b157c-2630-4578-b970-5b64c0697ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG nova.compute.manager [req-90bd166c-4caf-414e-aa70-dc2b5c47a1f7 req-3ef81a7b-7840-4b28-8388-ce5c5d026edb service nova] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] No waiting events found dispatching network-vif-unplugged-8cc1d821-1f39-4762-a47f-e3497efe2010 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG nova.compute.manager [req-90bd166c-4caf-414e-aa70-dc2b5c47a1f7 req-3ef81a7b-7840-4b28-8388-ce5c5d026edb service nova] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Received event network-vif-unplugged-8cc1d821-1f39-4762-a47f-e3497efe2010 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG nova.compute.manager [req-90bd166c-4caf-414e-aa70-dc2b5c47a1f7 req-3ef81a7b-7840-4b28-8388-ce5c5d026edb service nova] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Received event network-vif-plugged-8cc1d821-1f39-4762-a47f-e3497efe2010 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-90bd166c-4caf-414e-aa70-dc2b5c47a1f7 req-3ef81a7b-7840-4b28-8388-ce5c5d026edb service nova] Acquiring lock "4a2b157c-2630-4578-b970-5b64c0697ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-90bd166c-4caf-414e-aa70-dc2b5c47a1f7 req-3ef81a7b-7840-4b28-8388-ce5c5d026edb service nova] Lock "4a2b157c-2630-4578-b970-5b64c0697ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-90bd166c-4caf-414e-aa70-dc2b5c47a1f7 req-3ef81a7b-7840-4b28-8388-ce5c5d026edb service nova] Lock "4a2b157c-2630-4578-b970-5b64c0697ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG nova.compute.manager [req-90bd166c-4caf-414e-aa70-dc2b5c47a1f7 req-3ef81a7b-7840-4b28-8388-ce5c5d026edb service nova] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] No waiting events found dispatching network-vif-plugged-8cc1d821-1f39-4762-a47f-e3497efe2010 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:03:41 user nova-compute[75247]: WARNING nova.compute.manager [req-90bd166c-4caf-414e-aa70-dc2b5c47a1f7 req-3ef81a7b-7840-4b28-8388-ce5c5d026edb service nova] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Received unexpected event network-vif-plugged-8cc1d821-1f39-4762-a47f-e3497efe2010 for instance with vm_state active and task_state deleting.
Dec 06 13:03:41 user nova-compute[75247]: INFO nova.compute.manager [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Took 1.17 seconds to destroy the instance on the hypervisor.
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG nova.compute.manager [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 13:03:41 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Instance spawned successfully.
Dec 06 13:03:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG nova.compute.manager [req-259e3da9-5034-4494-aafd-04b9bd41ed02 req-753f5d87-89fb-4e2b-84f2-ba4962a7e74c service nova] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Received event network-vif-plugged-94fd19d6-0a33-411a-a022-5f48d5fcbf81 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-259e3da9-5034-4494-aafd-04b9bd41ed02 req-753f5d87-89fb-4e2b-84f2-ba4962a7e74c service nova] Acquiring lock "c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-259e3da9-5034-4494-aafd-04b9bd41ed02 req-753f5d87-89fb-4e2b-84f2-ba4962a7e74c service nova] Lock "c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-259e3da9-5034-4494-aafd-04b9bd41ed02 req-753f5d87-89fb-4e2b-84f2-ba4962a7e74c service nova] Lock "c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG nova.compute.manager [req-259e3da9-5034-4494-aafd-04b9bd41ed02 req-753f5d87-89fb-4e2b-84f2-ba4962a7e74c service nova] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] No waiting events found dispatching network-vif-plugged-94fd19d6-0a33-411a-a022-5f48d5fcbf81 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:03:41 user nova-compute[75247]: WARNING nova.compute.manager [req-259e3da9-5034-4494-aafd-04b9bd41ed02 req-753f5d87-89fb-4e2b-84f2-ba4962a7e74c service nova] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Received unexpected event network-vif-plugged-94fd19d6-0a33-411a-a022-5f48d5fcbf81 for instance with vm_state building and task_state spawning.
Dec 06 13:03:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG nova.objects.instance [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lazy-loading 'flavor' on Instance uuid 0bd88196-5493-434b-a3ba-0146f81dacea {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:03:41 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Took 0.50 seconds to deallocate network for instance.
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e14a57a0-f996-4d36-aa03-d71df45d263b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "0bd88196-5493-434b-a3ba-0146f81dacea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.222s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG nova.compute.manager [req-2dc1a247-38f6-45da-bc9f-cb5018a8775e req-21e94af5-0124-4a41-8a3c-e9b77911699a service nova] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Received event network-vif-deleted-8cc1d821-1f39-4762-a47f-e3497efe2010 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:03:41 user nova-compute[75247]: INFO nova.compute.manager [req-2dc1a247-38f6-45da-bc9f-cb5018a8775e req-21e94af5-0124-4a41-8a3c-e9b77911699a service nova] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Neutron deleted interface 8cc1d821-1f39-4762-a47f-e3497efe2010; detaching it from the instance and deleting it from the info cache
Dec 06 13:03:41 user nova-compute[75247]: DEBUG nova.network.neutron [req-2dc1a247-38f6-45da-bc9f-cb5018a8775e req-21e94af5-0124-4a41-8a3c-e9b77911699a service nova] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:03:41 user nova-compute[75247]: DEBUG nova.compute.manager [req-2dc1a247-38f6-45da-bc9f-cb5018a8775e req-21e94af5-0124-4a41-8a3c-e9b77911699a service nova] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Detach interface failed, port_id=8cc1d821-1f39-4762-a47f-e3497efe2010, reason: Instance 4a2b157c-2630-4578-b970-5b64c0697ae2 could not be found. {{(pid=75247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 13:03:41 user nova-compute[75247]: INFO nova.compute.manager [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Took 6.44 seconds to spawn the instance on the hypervisor.
Dec 06 13:03:41 user nova-compute[75247]: DEBUG nova.compute.manager [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 13:03:41 user nova-compute[75247]: INFO nova.compute.manager [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Took 7.12 seconds to build instance.
Dec 06 13:03:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-83328302-4b9f-4dd9-a2b8-22a8969ccbba tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Lock "c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.338s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:03:42 user nova-compute[75247]: INFO nova.compute.manager [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Took 0.80 seconds to detach 1 volumes for instance.
Dec 06 13:03:42 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 4a2b157c-2630-4578-b970-5b64c0697ae2] Deleting volume: 60b3638b-715c-43af-aeb4-71194281ea06 {{(pid=75247) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 06 13:03:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:03:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:03:42 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:03:42 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:03:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:03:43 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Deleted allocations for instance 4a2b157c-2630-4578-b970-5b64c0697ae2
Dec 06 13:03:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6fbe78e6-8f37-4281-b509-e87941f1b8af tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "4a2b157c-2630-4578-b970-5b64c0697ae2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.127s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:03:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:03:58 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 16dd787d-6abe-48f3-ac3c-fd55853b4e23 is timed out.
Dec 06 13:03:58 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Successfully detached device vdb from instance 16dd787d-6abe-48f3-ac3c-fd55853b4e23 from the live domain config.
Dec 06 13:03:58 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrOiqozp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:03:58 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:03:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca22d8c9-0f0e-411f-8de8-28edd870f11b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 13:03:58 user nova-compute[75247]: No targets found.
Dec 06 13:03:58 user nova-compute[75247]: iSNS:
Dec 06 13:03:58 user nova-compute[75247]: No targets found.
Dec 06 13:03:58 user nova-compute[75247]: STATIC:
Dec 06 13:03:58 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa
Dec 06 13:03:58 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:03:58 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:03:58 user nova-compute[75247]: FIRMWARE:
Dec 06 13:03:58 user nova-compute[75247]: No targets found.
Dec 06 13:03:58 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 13:03:58 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 13:03:58 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f278d92a-f4c7-4b93-9723-7ef45799cdeb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[243d01cd-a710-472a-bd9c-d2a4a40b2957]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)
Dec 06 13:03:58 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa (non-flash)
Dec 06 13:03:58 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd7480e3880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa'): ({'sdd'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Removing single pathed devices sdd {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[854bfbf3-5460-4dea-9119-9c5b3a33afe2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[865cf469-0546-4862-b8b7-5ab7ecb9e99c]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Flushing IO for device /dev/sdd {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3396461-0ef4-4572-ba70-695f0f69caa1]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b62886a-3c59-48a8-9d39-c5bc9407ce6e]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] SCSI volumes sdd have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b525c881-7fe2-4944-9ec9-2d1b5d9ee80b]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ea1b5a-310d-4b23-a571-b110ca65dcc5]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa, portal: 172.16.0.220,3260]
Dec 06 13:03:58 user nova-compute[75247]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa, portal: 172.16.0.220,3260] successful.
Dec 06 13:03:58 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29be7905-6db7-4b52-a629-d772283ff9aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d986e0f2-d1c8-4d23-80b9-655e57d22545]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] <== disconnect_volume: return (281ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:03:58 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 13:03:59 user nova-compute[75247]: DEBUG nova.objects.instance [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'flavor' on Instance uuid 16dd787d-6abe-48f3-ac3c-fd55853b4e23 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:03:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-02dc0e26-60a0-4340-9c8f-8b627af80592 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.863s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:03:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-2fb7422d-15cc-4205-b346-16e0bcbdee73 req-084390c9-ac3a-4712-a851-8d2c49b2a0bd service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Received event network-changed-2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:04:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-2fb7422d-15cc-4205-b346-16e0bcbdee73 req-084390c9-ac3a-4712-a851-8d2c49b2a0bd service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Refreshing instance network info cache due to event network-changed-2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:04:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2fb7422d-15cc-4205-b346-16e0bcbdee73 req-084390c9-ac3a-4712-a851-8d2c49b2a0bd service nova] Acquiring lock "refresh_cache-0bd88196-5493-434b-a3ba-0146f81dacea" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:04:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2fb7422d-15cc-4205-b346-16e0bcbdee73 req-084390c9-ac3a-4712-a851-8d2c49b2a0bd service nova] Acquired lock "refresh_cache-0bd88196-5493-434b-a3ba-0146f81dacea" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:04:10 user nova-compute[75247]: DEBUG nova.network.neutron [req-2fb7422d-15cc-4205-b346-16e0bcbdee73 req-084390c9-ac3a-4712-a851-8d2c49b2a0bd service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Refreshing network info cache for port 2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:04:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d49b926d-0b71-457f-a361-3373b0fe4a1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "0bd88196-5493-434b-a3ba-0146f81dacea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:04:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d49b926d-0b71-457f-a361-3373b0fe4a1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "0bd88196-5493-434b-a3ba-0146f81dacea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:04:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d49b926d-0b71-457f-a361-3373b0fe4a1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "0bd88196-5493-434b-a3ba-0146f81dacea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:04:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d49b926d-0b71-457f-a361-3373b0fe4a1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "0bd88196-5493-434b-a3ba-0146f81dacea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:04:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d49b926d-0b71-457f-a361-3373b0fe4a1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "0bd88196-5493-434b-a3ba-0146f81dacea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:04:10 user nova-compute[75247]: INFO nova.compute.manager [None req-d49b926d-0b71-457f-a361-3373b0fe4a1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Terminating instance
Dec 06 13:04:10 user nova-compute[75247]: DEBUG nova.compute.manager [None req-d49b926d-0b71-457f-a361-3373b0fe4a1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 13:04:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-e1fcdec7-ffec-4016-a465-53b17e51a34a req-8c4cc32b-9692-4fbd-8210-9fde003e5841 service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Received event network-vif-unplugged-2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:04:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e1fcdec7-ffec-4016-a465-53b17e51a34a req-8c4cc32b-9692-4fbd-8210-9fde003e5841 service nova] Acquiring lock "0bd88196-5493-434b-a3ba-0146f81dacea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:04:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e1fcdec7-ffec-4016-a465-53b17e51a34a req-8c4cc32b-9692-4fbd-8210-9fde003e5841 service nova] Lock "0bd88196-5493-434b-a3ba-0146f81dacea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:04:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e1fcdec7-ffec-4016-a465-53b17e51a34a req-8c4cc32b-9692-4fbd-8210-9fde003e5841 service nova] Lock "0bd88196-5493-434b-a3ba-0146f81dacea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:04:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-e1fcdec7-ffec-4016-a465-53b17e51a34a req-8c4cc32b-9692-4fbd-8210-9fde003e5841 service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] No waiting events found dispatching network-vif-unplugged-2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:04:10 user nova-compute[75247]: DEBUG nova.compute.manager [req-e1fcdec7-ffec-4016-a465-53b17e51a34a req-8c4cc32b-9692-4fbd-8210-9fde003e5841 service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Received event network-vif-unplugged-2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 13:04:11 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Instance destroyed successfully.
Dec 06 13:04:11 user nova-compute[75247]: DEBUG nova.objects.instance [None req-d49b926d-0b71-457f-a361-3373b0fe4a1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lazy-loading 'resources' on Instance uuid 0bd88196-5493-434b-a3ba-0146f81dacea {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:04:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-d49b926d-0b71-457f-a361-3373b0fe4a1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1398873635',display_name='tempest-TestStampPattern-server-1398873635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1398873635',id=41,image_ref='7f0f6867-a1f0-457b-b543-4f260951a4fc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0R56ocpUVDhrbWezba5KdSt9CClipCfqGo33mBvmQ86FzrqlnssF888NmN27WHariFI9cN7fX+09ONrvhHiWT31I4taIadhAyTDm1d90LRTwaNyayfF9CNEjQpjWnVDw==',key_name='tempest-TestStampPattern-181483636',keypairs=<?>,launch_index=0,launched_at=2023-12-06T13:01:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='135f3c1de288423e8964c31ca35664c0',ramdisk_id='',reservation_id='r-efdmqely',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e1f21135-43cd-4dbb-ae7a-b12dffdc5816',image_min_disk='1',image_min_ram='0',image_owner_id='135f3c1de288423e8964c31ca35664c0',image_owner_project_name='tempest-TestStampPattern-1741400309',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1741400309-project-member',image_user_id='9ac9a9c6e8f34a828c737e8b45da7721',owner_project_name='tempest-TestStampPattern-1741400309',owner_user_name='tempest-TestStampPattern-1741400309-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T13:01:21Z,user_data=None,user_id='9ac9a9c6e8f34a828c737e8b45da7721',uuid=0bd88196-5493-434b-a3ba-0146f81dacea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73", "address": "fa:16:3e:6c:69:bf", "network": {"id": "053733b9-e8f4-4da1-a5fe-ee7d0704684c", "bridge": "br-int", "label": "tempest-TestStampPattern-239755854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "135f3c1de288423e8964c31ca35664c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e0cf76d-11", "ovs_interfaceid": "2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 13:04:11 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-d49b926d-0b71-457f-a361-3373b0fe4a1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Converting VIF {"id": "2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73", "address": "fa:16:3e:6c:69:bf", "network": {"id": "053733b9-e8f4-4da1-a5fe-ee7d0704684c", "bridge": "br-int", "label": "tempest-TestStampPattern-239755854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "135f3c1de288423e8964c31ca35664c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e0cf76d-11", "ovs_interfaceid": "2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:04:11 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-d49b926d-0b71-457f-a361-3373b0fe4a1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:69:bf,bridge_name='br-int',has_traffic_filtering=True,id=2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73,network=Network(053733b9-e8f4-4da1-a5fe-ee7d0704684c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e0cf76d-11') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:04:11 user nova-compute[75247]: DEBUG os_vif [None req-d49b926d-0b71-457f-a361-3373b0fe4a1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:69:bf,bridge_name='br-int',has_traffic_filtering=True,id=2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73,network=Network(053733b9-e8f4-4da1-a5fe-ee7d0704684c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e0cf76d-11') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 13:04:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e0cf76d-11, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:04:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:04:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=abf27970-da6d-4b24-980d-64a740375776) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:04:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:11 user nova-compute[75247]: INFO os_vif [None req-d49b926d-0b71-457f-a361-3373b0fe4a1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:69:bf,bridge_name='br-int',has_traffic_filtering=True,id=2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73,network=Network(053733b9-e8f4-4da1-a5fe-ee7d0704684c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e0cf76d-11')
Dec 06 13:04:11 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-d49b926d-0b71-457f-a361-3373b0fe4a1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Deleting instance files /opt/stack/data/nova/instances/0bd88196-5493-434b-a3ba-0146f81dacea_del
Dec 06 13:04:11 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-d49b926d-0b71-457f-a361-3373b0fe4a1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Deletion of /opt/stack/data/nova/instances/0bd88196-5493-434b-a3ba-0146f81dacea_del complete
Dec 06 13:04:11 user nova-compute[75247]: INFO nova.compute.manager [None req-d49b926d-0b71-457f-a361-3373b0fe4a1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Took 0.88 seconds to destroy the instance on the hypervisor.
Dec 06 13:04:11 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-d49b926d-0b71-457f-a361-3373b0fe4a1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 13:04:11 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 13:04:11 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 13:04:11 user nova-compute[75247]: DEBUG nova.network.neutron [req-2fb7422d-15cc-4205-b346-16e0bcbdee73 req-084390c9-ac3a-4712-a851-8d2c49b2a0bd service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Updated VIF entry in instance network info cache for port 2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:04:11 user nova-compute[75247]: DEBUG nova.network.neutron [req-2fb7422d-15cc-4205-b346-16e0bcbdee73 req-084390c9-ac3a-4712-a851-8d2c49b2a0bd service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Updating instance_info_cache with network_info: [{"id": "2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73", "address": "fa:16:3e:6c:69:bf", "network": {"id": "053733b9-e8f4-4da1-a5fe-ee7d0704684c", "bridge": "br-int", "label": "tempest-TestStampPattern-239755854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "135f3c1de288423e8964c31ca35664c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e0cf76d-11", "ovs_interfaceid": "2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:04:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2fb7422d-15cc-4205-b346-16e0bcbdee73 req-084390c9-ac3a-4712-a851-8d2c49b2a0bd service nova] Releasing lock "refresh_cache-0bd88196-5493-434b-a3ba-0146f81dacea" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:04:11 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:04:11 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Took 0.52 seconds to deallocate network for instance.
Dec 06 13:04:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d49b926d-0b71-457f-a361-3373b0fe4a1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:04:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d49b926d-0b71-457f-a361-3373b0fe4a1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:04:11 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-d49b926d-0b71-457f-a361-3373b0fe4a1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:04:11 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-d49b926d-0b71-457f-a361-3373b0fe4a1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:04:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d49b926d-0b71-457f-a361-3373b0fe4a1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:04:12 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-d49b926d-0b71-457f-a361-3373b0fe4a1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Deleted allocations for instance 0bd88196-5493-434b-a3ba-0146f81dacea
Dec 06 13:04:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d49b926d-0b71-457f-a361-3373b0fe4a1b tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "0bd88196-5493-434b-a3ba-0146f81dacea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.812s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:04:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-2e0edb27-8b23-4932-a056-47b035f13e4b req-f13aac59-e37e-412b-b671-0c04a448baa1 service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Received event network-vif-plugged-2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:04:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2e0edb27-8b23-4932-a056-47b035f13e4b req-f13aac59-e37e-412b-b671-0c04a448baa1 service nova] Acquiring lock "0bd88196-5493-434b-a3ba-0146f81dacea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:04:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2e0edb27-8b23-4932-a056-47b035f13e4b req-f13aac59-e37e-412b-b671-0c04a448baa1 service nova] Lock "0bd88196-5493-434b-a3ba-0146f81dacea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:04:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2e0edb27-8b23-4932-a056-47b035f13e4b req-f13aac59-e37e-412b-b671-0c04a448baa1 service nova] Lock "0bd88196-5493-434b-a3ba-0146f81dacea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:04:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-2e0edb27-8b23-4932-a056-47b035f13e4b req-f13aac59-e37e-412b-b671-0c04a448baa1 service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] No waiting events found dispatching network-vif-plugged-2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:04:13 user nova-compute[75247]: WARNING nova.compute.manager [req-2e0edb27-8b23-4932-a056-47b035f13e4b req-f13aac59-e37e-412b-b671-0c04a448baa1 service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Received unexpected event network-vif-plugged-2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73 for instance with vm_state deleted and task_state None.
Dec 06 13:04:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-2e0edb27-8b23-4932-a056-47b035f13e4b req-f13aac59-e37e-412b-b671-0c04a448baa1 service nova] [instance: 0bd88196-5493-434b-a3ba-0146f81dacea] Received event network-vif-deleted-2e0cf76d-110c-4fa3-b4b6-c6356fe7cb73 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:04:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:18 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:04:19 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:04:19 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:04:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:04:23 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:04:24 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:04:24 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:04:24 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:04:25 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:04:25 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:04:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:26 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:04:26 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:04:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-e1f21135-43cd-4dbb-ae7a-b12dffdc5816" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:04:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-e1f21135-43cd-4dbb-ae7a-b12dffdc5816" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:04:27 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 13:04:27 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Updating instance_info_cache with network_info: [{"id": "58e08de5-6c1a-48bc-aa1a-242ec3b175a1", "address": "fa:16:3e:d6:b6:ce", "network": {"id": "053733b9-e8f4-4da1-a5fe-ee7d0704684c", "bridge": "br-int", "label": "tempest-TestStampPattern-239755854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "135f3c1de288423e8964c31ca35664c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e08de5-6c", "ovs_interfaceid": "58e08de5-6c1a-48bc-aa1a-242ec3b175a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:04:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-e1f21135-43cd-4dbb-ae7a-b12dffdc5816" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:04:27 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 13:04:27 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:04:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:04:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:04:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:04:27 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:04:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:04:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:04:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:04:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:04:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6a659d25-d762-47fe-9546-ee407110a748 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6a659d25-d762-47fe-9546-ee407110a748 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6a659d25-d762-47fe-9546-ee407110a748 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6a659d25-d762-47fe-9546-ee407110a748 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6a659d25-d762-47fe-9546-ee407110a748 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:04:28 user nova-compute[75247]: INFO nova.compute.manager [None req-6a659d25-d762-47fe-9546-ee407110a748 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Terminating instance
Dec 06 13:04:28 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6a659d25-d762-47fe-9546-ee407110a748 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-fc0c56f7-1f01-4eed-9f2d-05508b73bc91 req-985670c8-2e27-4ecb-b1af-d55e3f1dad7e service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received event network-vif-unplugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fc0c56f7-1f01-4eed-9f2d-05508b73bc91 req-985670c8-2e27-4ecb-b1af-d55e3f1dad7e service nova] Acquiring lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fc0c56f7-1f01-4eed-9f2d-05508b73bc91 req-985670c8-2e27-4ecb-b1af-d55e3f1dad7e service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fc0c56f7-1f01-4eed-9f2d-05508b73bc91 req-985670c8-2e27-4ecb-b1af-d55e3f1dad7e service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-fc0c56f7-1f01-4eed-9f2d-05508b73bc91 req-985670c8-2e27-4ecb-b1af-d55e3f1dad7e service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] No waiting events found dispatching network-vif-unplugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-fc0c56f7-1f01-4eed-9f2d-05508b73bc91 req-985670c8-2e27-4ecb-b1af-d55e3f1dad7e service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received event network-vif-unplugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:04:28 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Instance destroyed successfully.
Dec 06 13:04:28 user nova-compute[75247]: DEBUG nova.objects.instance [None req-6a659d25-d762-47fe-9546-ee407110a748 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'resources' on Instance uuid 16dd787d-6abe-48f3-ac3c-fd55853b4e23 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-6a659d25-d762-47fe-9546-ee407110a748 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-149152184',display_name='tempest-ServerRescueNegativeTestJSON-server-149152184',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-149152184',id=39,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3vBCyE6q5nI66WXDqfmPgjhRHEH8SIKzGzERVNDwjRqS88kAZzFoeCZqEn8fKloo/IDS4Ul1cGss1JK9h0KmMVz4QwDFTCNUHkpu02hNM01o6i8wM7G4pctSEySvLrUg==',key_name='tempest-keypair-1978844049',keypairs=<?>,launch_index=0,launched_at=2023-12-06T13:00:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b253fd3ef3284dd885d3a0efc1ec07d7',ramdisk_id='',reservation_id='r-pl392su4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-295230580',owner_user_name='tempest-ServerRescueNegativeTestJSON-295230580-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T13:01:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='deac43cb03b440ff9de75801065ec9af',uuid=16dd787d-6abe-48f3-ac3c-fd55853b4e23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "address": "fa:16:3e:f9:7b:5b", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8804e1-c0", "ovs_interfaceid": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-6a659d25-d762-47fe-9546-ee407110a748 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Converting VIF {"id": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "address": "fa:16:3e:f9:7b:5b", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8804e1-c0", "ovs_interfaceid": "3a8804e1-c0a2-4f4a-941e-5fc617f45d93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-6a659d25-d762-47fe-9546-ee407110a748 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:7b:5b,bridge_name='br-int',has_traffic_filtering=True,id=3a8804e1-c0a2-4f4a-941e-5fc617f45d93,network=Network(579972e2-9933-47d9-b56b-f64b5650d611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8804e1-c0') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG os_vif [None req-6a659d25-d762-47fe-9546-ee407110a748 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:7b:5b,bridge_name='br-int',has_traffic_filtering=True,id=3a8804e1-c0a2-4f4a-941e-5fc617f45d93,network=Network(579972e2-9933-47d9-b56b-f64b5650d611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8804e1-c0') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a8804e1-c0, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc8c7661-67ef-4080-95d7-160123f0a275) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:28 user nova-compute[75247]: INFO os_vif [None req-6a659d25-d762-47fe-9546-ee407110a748 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:7b:5b,bridge_name='br-int',has_traffic_filtering=True,id=3a8804e1-c0a2-4f4a-941e-5fc617f45d93,network=Network(579972e2-9933-47d9-b56b-f64b5650d611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8804e1-c0')
Dec 06 13:04:28 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6a659d25-d762-47fe-9546-ee407110a748 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Deleting instance files /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23_del
Dec 06 13:04:28 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6a659d25-d762-47fe-9546-ee407110a748 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Deletion of /opt/stack/data/nova/instances/16dd787d-6abe-48f3-ac3c-fd55853b4e23_del complete
Dec 06 13:04:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:04:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:04:29 user nova-compute[75247]: INFO nova.compute.manager [None req-6a659d25-d762-47fe-9546-ee407110a748 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Took 0.97 seconds to destroy the instance on the hypervisor.
Dec 06 13:04:29 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-6a659d25-d762-47fe-9546-ee407110a748 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 13:04:29 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 13:04:29 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 13:04:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:04:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:04:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:04:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:04:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:04:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:04:29 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:04:29 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Took 0.65 seconds to deallocate network for instance.
Dec 06 13:04:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:04:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:04:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6a659d25-d762-47fe-9546-ee407110a748 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:04:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6a659d25-d762-47fe-9546-ee407110a748 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:04:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:04:30 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-6a659d25-d762-47fe-9546-ee407110a748 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:04:30 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:04:30 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:04:30 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=8445MB free_disk=24.95922088623047GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:04:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:04:30 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-6a659d25-d762-47fe-9546-ee407110a748 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:04:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6a659d25-d762-47fe-9546-ee407110a748 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.601s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:04:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.051s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:04:30 user nova-compute[75247]: DEBUG nova.compute.manager [req-7894e876-391c-4d47-9bbd-9cbdf52e2561 req-3df69b4c-390f-4e02-aec6-99834411bb02 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received event network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:04:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7894e876-391c-4d47-9bbd-9cbdf52e2561 req-3df69b4c-390f-4e02-aec6-99834411bb02 service nova] Acquiring lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:04:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7894e876-391c-4d47-9bbd-9cbdf52e2561 req-3df69b4c-390f-4e02-aec6-99834411bb02 service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:04:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7894e876-391c-4d47-9bbd-9cbdf52e2561 req-3df69b4c-390f-4e02-aec6-99834411bb02 service nova] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:04:30 user nova-compute[75247]: DEBUG nova.compute.manager [req-7894e876-391c-4d47-9bbd-9cbdf52e2561 req-3df69b4c-390f-4e02-aec6-99834411bb02 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] No waiting events found dispatching network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:04:30 user nova-compute[75247]: WARNING nova.compute.manager [req-7894e876-391c-4d47-9bbd-9cbdf52e2561 req-3df69b4c-390f-4e02-aec6-99834411bb02 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received unexpected event network-vif-plugged-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 for instance with vm_state deleted and task_state None.
Dec 06 13:04:30 user nova-compute[75247]: DEBUG nova.compute.manager [req-7894e876-391c-4d47-9bbd-9cbdf52e2561 req-3df69b4c-390f-4e02-aec6-99834411bb02 service nova] [instance: 16dd787d-6abe-48f3-ac3c-fd55853b4e23] Received event network-vif-deleted-3a8804e1-c0a2-4f4a-941e-5fc617f45d93 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:04:30 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-6a659d25-d762-47fe-9546-ee407110a748 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Deleted allocations for instance 16dd787d-6abe-48f3-ac3c-fd55853b4e23
Dec 06 13:04:30 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance bc3ddb40-b05f-4170-b269-d44dec6ecdaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:04:30 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 530cfb75-7aa8-4e57-b282-8f7a21401b34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:04:30 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance e1f21135-43cd-4dbb-ae7a-b12dffdc5816 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:04:30 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:04:30 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:04:30 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:04:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6a659d25-d762-47fe-9546-ee407110a748 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "16dd787d-6abe-48f3-ac3c-fd55853b4e23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.469s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:04:30 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:04:30 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:04:30 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:04:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:04:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:04:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "3e98845f-ad13-4240-beca-c3f70ef26f9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:04:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "3e98845f-ad13-4240-beca-c3f70ef26f9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:04:53 user nova-compute[75247]: DEBUG nova.compute.manager [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 13:04:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:04:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:04:53 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 13:04:53 user nova-compute[75247]: INFO nova.compute.claims [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Claim successful on node user
Dec 06 13:04:53 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:04:53 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:04:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.316s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:04:53 user nova-compute[75247]: DEBUG nova.compute.manager [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 13:04:53 user nova-compute[75247]: DEBUG nova.compute.manager [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 13:04:53 user nova-compute[75247]: DEBUG nova.network.neutron [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 13:04:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:04:53 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 13:04:53 user nova-compute[75247]: DEBUG nova.compute.manager [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 13:04:54 user nova-compute[75247]: INFO nova.virt.block_device [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Booting with volume 31187157-2599-406c-9191-7d392af73d13 at /dev/vda
Dec 06 13:04:54 user nova-compute[75247]: DEBUG nova.policy [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '016714f7502b4a8fa12ed0ce6644c5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9493d9b0b1024cea9a550e2a42c1e6a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 13:04:54 user nova-compute[75247]: DEBUG os_brick.utils [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:04:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:04:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:04:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9e76fe-35d5-4d7d-937f-6d1b7f979801]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:04:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:04:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:04:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb73f74d-9655-40b0-bc26-592f2fb6d0b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:04:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:04:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:04:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76d7176-fe4b-4dde-abdd-ca38f2da2327]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:04:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c5a638-3078-461e-8a8f-f10b5224955b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:04:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:04:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:04:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 13:04:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:04:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:04:54 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 13:04:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6babb480-b51b-4d78-ab1c-9f10fb4b01eb]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:04:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 13:04:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 13:04:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 13:04:54 user nova-compute[75247]: DEBUG os_brick.utils [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:04:54 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Updating existing volume attachment record: 157d5eb4-740b-4393-a4c0-1ca4a7853bad {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 13:04:54 user nova-compute[75247]: DEBUG nova.network.neutron [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Successfully created port: 8c291771-553f-41be-9bc1-e97d6dfb1cdd {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 13:04:55 user nova-compute[75247]: DEBUG nova.network.neutron [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Successfully updated port: 8c291771-553f-41be-9bc1-e97d6dfb1cdd {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 13:04:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "refresh_cache-3e98845f-ad13-4240-beca-c3f70ef26f9e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:04:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquired lock "refresh_cache-3e98845f-ad13-4240-beca-c3f70ef26f9e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:04:55 user nova-compute[75247]: DEBUG nova.network.neutron [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 13:04:55 user nova-compute[75247]: DEBUG nova.compute.manager [req-44fc8b2d-5db7-4c71-a2a7-b0f1fdb8b0f9 req-14977fa5-1f2b-4da9-b994-68f87e035c17 service nova] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Received event network-changed-8c291771-553f-41be-9bc1-e97d6dfb1cdd {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:04:55 user nova-compute[75247]: DEBUG nova.compute.manager [req-44fc8b2d-5db7-4c71-a2a7-b0f1fdb8b0f9 req-14977fa5-1f2b-4da9-b994-68f87e035c17 service nova] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Refreshing instance network info cache due to event network-changed-8c291771-553f-41be-9bc1-e97d6dfb1cdd. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:04:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-44fc8b2d-5db7-4c71-a2a7-b0f1fdb8b0f9 req-14977fa5-1f2b-4da9-b994-68f87e035c17 service nova] Acquiring lock "refresh_cache-3e98845f-ad13-4240-beca-c3f70ef26f9e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:04:55 user nova-compute[75247]: DEBUG nova.network.neutron [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 13:04:56 user nova-compute[75247]: DEBUG nova.network.neutron [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Updating instance_info_cache with network_info: [{"id": "8c291771-553f-41be-9bc1-e97d6dfb1cdd", "address": "fa:16:3e:e7:fd:e8", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c291771-55", "ovs_interfaceid": "8c291771-553f-41be-9bc1-e97d6dfb1cdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:04:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Releasing lock "refresh_cache-3e98845f-ad13-4240-beca-c3f70ef26f9e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:04:56 user nova-compute[75247]: DEBUG nova.compute.manager [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Instance network_info: |[{"id": "8c291771-553f-41be-9bc1-e97d6dfb1cdd", "address": "fa:16:3e:e7:fd:e8", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c291771-55", "ovs_interfaceid": "8c291771-553f-41be-9bc1-e97d6dfb1cdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 13:04:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-44fc8b2d-5db7-4c71-a2a7-b0f1fdb8b0f9 req-14977fa5-1f2b-4da9-b994-68f87e035c17 service nova] Acquired lock "refresh_cache-3e98845f-ad13-4240-beca-c3f70ef26f9e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:04:56 user nova-compute[75247]: DEBUG nova.network.neutron [req-44fc8b2d-5db7-4c71-a2a7-b0f1fdb8b0f9 req-14977fa5-1f2b-4da9-b994-68f87e035c17 service nova] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Refreshing network info cache for port 8c291771-553f-41be-9bc1-e97d6dfb1cdd {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:04:56 user nova-compute[75247]: DEBUG nova.network.neutron [req-44fc8b2d-5db7-4c71-a2a7-b0f1fdb8b0f9 req-14977fa5-1f2b-4da9-b994-68f87e035c17 service nova] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Updated VIF entry in instance network info cache for port 8c291771-553f-41be-9bc1-e97d6dfb1cdd. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:04:56 user nova-compute[75247]: DEBUG nova.network.neutron [req-44fc8b2d-5db7-4c71-a2a7-b0f1fdb8b0f9 req-14977fa5-1f2b-4da9-b994-68f87e035c17 service nova] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Updating instance_info_cache with network_info: [{"id": "8c291771-553f-41be-9bc1-e97d6dfb1cdd", "address": "fa:16:3e:e7:fd:e8", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c291771-55", "ovs_interfaceid": "8c291771-553f-41be-9bc1-e97d6dfb1cdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:04:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-44fc8b2d-5db7-4c71-a2a7-b0f1fdb8b0f9 req-14977fa5-1f2b-4da9-b994-68f87e035c17 service nova] Releasing lock "refresh_cache-3e98845f-ad13-4240-beca-c3f70ef26f9e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:04:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:05:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG nova.compute.manager [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 13:05:09 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Creating image(s)
Dec 06 13:05:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Did not create local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Ensure instance console log exists: /opt/stack/data/nova/instances/3e98845f-ad13-4240-beca-c3f70ef26f9e/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Start _get_guest_xml network_info=[{"id": "8c291771-553f-41be-9bc1-e97d6dfb1cdd", "address": "fa:16:3e:e7:fd:e8", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c291771-55", "ovs_interfaceid": "8c291771-553f-41be-9bc1-e97d6dfb1cdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '157d5eb4-740b-4393-a4c0-1ca4a7853bad', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JWUSDjtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3e98845f-ad13-4240-beca-c3f70ef26f9e', 'attached_at': '', 'detached_at': '', 'volume_id': '31187157-2599-406c-9191-7d392af73d13', 'serial': '31187157-2599-406c-9191-7d392af73d13'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 13:05:09 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:05:09 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:05:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JWUSDjtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:05:09 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:05:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:05:09 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:05:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:05:09 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 13:05:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03c0b70-ab79-4b95-a607-315625fc2976]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 13:05:09 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85357be-5a51-4bbc-9dc0-97dbc02efb94]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13] added
Dec 06 13:05:09 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[612387a3-223a-448d-9604-d57a8086296f]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc304caf-27f0-4998-b3eb-b1b940da3ab3]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JWUSDjtk {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JWUSDjtk" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0de3c65-7aa6-48dc-bfe4-c809b95ccc96]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JWUSDjtk'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8255b7d-b6cd-4bb2-b51c-ad32827fabe0]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bd0b8c-a001-4d14-a9df-bc33b888e907]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 13:05:09 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:05:09 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 13:05:09 user nova-compute[75247]:  {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:05:09 user nova-compute[75247]: WARNING os_brick.initiator.connectors.iscsi [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 13:05:09 user nova-compute[75247]: 
Dec 06 13:05:09 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:05:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:05:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d9f863-19aa-4491-88ff-c35d49665f51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:05:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13, portal: 172.16.0.220,3260]
Dec 06 13:05:10 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13, portal: 172.16.0.220,3260] successful.
Dec 06 13:05:10 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:05:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:05:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:05:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ad2502-8763-4e10-a9d2-d5ca08931ca2]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:05:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:05:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:05:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:05:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e8b3b7-4760-4877-b6ff-069cc5b986d8]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:05:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)
Dec 06 13:05:10 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:05:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)
Dec 06 13:05:10 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:05:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:05:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 13:05:10 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 13:05:10 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 13:05:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:05:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:05:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0818e7a-a19f-41f8-9a73-092c9b5d34cb]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:05:10 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 13:05:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JWUSDjtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG nova.compute.manager [req-0b89457d-18a4-473c-8ae9-f8222ff55c4f req-4a17efc8-34a7-4075-8c05-3a2e0c45bbaf service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Received event network-changed-58e08de5-6c1a-48bc-aa1a-242ec3b175a1 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG nova.compute.manager [req-0b89457d-18a4-473c-8ae9-f8222ff55c4f req-4a17efc8-34a7-4075-8c05-3a2e0c45bbaf service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Refreshing instance network info cache due to event network-changed-58e08de5-6c1a-48bc-aa1a-242ec3b175a1. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0b89457d-18a4-473c-8ae9-f8222ff55c4f req-4a17efc8-34a7-4075-8c05-3a2e0c45bbaf service nova] Acquiring lock "refresh_cache-e1f21135-43cd-4dbb-ae7a-b12dffdc5816" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0b89457d-18a4-473c-8ae9-f8222ff55c4f req-4a17efc8-34a7-4075-8c05-3a2e0c45bbaf service nova] Acquired lock "refresh_cache-e1f21135-43cd-4dbb-ae7a-b12dffdc5816" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG nova.network.neutron [req-0b89457d-18a4-473c-8ae9-f8222ff55c4f req-4a17efc8-34a7-4075-8c05-3a2e0c45bbaf service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Refreshing network info cache for port 58e08de5-6c1a-48bc-aa1a-242ec3b175a1 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23762386163616265', 'path': '/dev/sdb'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762386163616265', 'path': '/dev/sdb'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1217504595',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1217504595',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1217504595',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh+q+Ox5cRYT5ltlkGHYBtVLEWxrPr/2Htp0V8bZ1bDXBYy5rviIrzn/KCAt+0UuwwLA0e/SMMQErRsAHTzEaMTIZGclgEOcv4nlZb+0X5w0dNYavm72A6yG02KzO3GSw==',key_name='tempest-keypair-1608251655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9493d9b0b1024cea9a550e2a42c1e6a1',ramdisk_id='',reservation_id='r-0n3x9pgm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2088852773',owner_user_name='tempest-TestVolumeBootPattern-2088852773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:04:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016714f7502b4a8fa12ed0ce6644c5fc',uuid=3e98845f-ad13-4240-beca-c3f70ef26f9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c291771-553f-41be-9bc1-e97d6dfb1cdd", "address": "fa:16:3e:e7:fd:e8", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c291771-55", "ovs_interfaceid": "8c291771-553f-41be-9bc1-e97d6dfb1cdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converting VIF {"id": "8c291771-553f-41be-9bc1-e97d6dfb1cdd", "address": "fa:16:3e:e7:fd:e8", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c291771-55", "ovs_interfaceid": "8c291771-553f-41be-9bc1-e97d6dfb1cdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:fd:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c291771-553f-41be-9bc1-e97d6dfb1cdd,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c291771-55') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG nova.objects.instance [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e98845f-ad13-4240-beca-c3f70ef26f9e {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] End _get_guest_xml xml=<domain type="kvm">
Dec 06 13:05:11 user nova-compute[75247]:   <uuid>3e98845f-ad13-4240-beca-c3f70ef26f9e</uuid>
Dec 06 13:05:11 user nova-compute[75247]:   <name>instance-0000002c</name>
Dec 06 13:05:11 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 13:05:11 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 13:05:11 user nova-compute[75247]:   <metadata>
Dec 06 13:05:11 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 13:05:11 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 13:05:11 user nova-compute[75247]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1217504595</nova:name>
Dec 06 13:05:11 user nova-compute[75247]:       <nova:creationTime>2023-12-06 13:05:09</nova:creationTime>
Dec 06 13:05:11 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 13:05:11 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 13:05:11 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 13:05:11 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 13:05:11 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 13:05:11 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 13:05:11 user nova-compute[75247]:       </nova:flavor>
Dec 06 13:05:11 user nova-compute[75247]:       <nova:owner>
Dec 06 13:05:11 user nova-compute[75247]:         <nova:user uuid="016714f7502b4a8fa12ed0ce6644c5fc">tempest-TestVolumeBootPattern-2088852773-project-member</nova:user>
Dec 06 13:05:11 user nova-compute[75247]:         <nova:project uuid="9493d9b0b1024cea9a550e2a42c1e6a1">tempest-TestVolumeBootPattern-2088852773</nova:project>
Dec 06 13:05:11 user nova-compute[75247]:       </nova:owner>
Dec 06 13:05:11 user nova-compute[75247]:       <nova:ports>
Dec 06 13:05:11 user nova-compute[75247]:         <nova:port uuid="8c291771-553f-41be-9bc1-e97d6dfb1cdd">
Dec 06 13:05:11 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 13:05:11 user nova-compute[75247]:         </nova:port>
Dec 06 13:05:11 user nova-compute[75247]:       </nova:ports>
Dec 06 13:05:11 user nova-compute[75247]:     </nova:instance>
Dec 06 13:05:11 user nova-compute[75247]:   </metadata>
Dec 06 13:05:11 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 13:05:11 user nova-compute[75247]:     <system>
Dec 06 13:05:11 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 13:05:11 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 13:05:11 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 13:05:11 user nova-compute[75247]:       <entry name="serial">3e98845f-ad13-4240-beca-c3f70ef26f9e</entry>
Dec 06 13:05:11 user nova-compute[75247]:       <entry name="uuid">3e98845f-ad13-4240-beca-c3f70ef26f9e</entry>
Dec 06 13:05:11 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 13:05:11 user nova-compute[75247]:     </system>
Dec 06 13:05:11 user nova-compute[75247]:   </sysinfo>
Dec 06 13:05:11 user nova-compute[75247]:   <os>
Dec 06 13:05:11 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 13:05:11 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 13:05:11 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 13:05:11 user nova-compute[75247]:   </os>
Dec 06 13:05:11 user nova-compute[75247]:   <features>
Dec 06 13:05:11 user nova-compute[75247]:     <acpi/>
Dec 06 13:05:11 user nova-compute[75247]:     <apic/>
Dec 06 13:05:11 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 13:05:11 user nova-compute[75247]:   </features>
Dec 06 13:05:11 user nova-compute[75247]:   <clock offset="utc">
Dec 06 13:05:11 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 13:05:11 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 13:05:11 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 13:05:11 user nova-compute[75247]:   </clock>
Dec 06 13:05:11 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 13:05:11 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 13:05:11 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 13:05:11 user nova-compute[75247]:   </cpu>
Dec 06 13:05:11 user nova-compute[75247]:   <devices>
Dec 06 13:05:11 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 13:05:11 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:05:11 user nova-compute[75247]:       <source dev="/dev/sdb"/>
Dec 06 13:05:11 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 13:05:11 user nova-compute[75247]:       <serial>31187157-2599-406c-9191-7d392af73d13</serial>
Dec 06 13:05:11 user nova-compute[75247]:     </disk>
Dec 06 13:05:11 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 13:05:11 user nova-compute[75247]:       <mac address="fa:16:3e:e7:fd:e8"/>
Dec 06 13:05:11 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:05:11 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 13:05:11 user nova-compute[75247]:       <target dev="tap8c291771-55"/>
Dec 06 13:05:11 user nova-compute[75247]:     </interface>
Dec 06 13:05:11 user nova-compute[75247]:     <serial type="pty">
Dec 06 13:05:11 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/3e98845f-ad13-4240-beca-c3f70ef26f9e/console.log" append="off"/>
Dec 06 13:05:11 user nova-compute[75247]:     </serial>
Dec 06 13:05:11 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 13:05:11 user nova-compute[75247]:     <video>
Dec 06 13:05:11 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:05:11 user nova-compute[75247]:     </video>
Dec 06 13:05:11 user nova-compute[75247]:     <rng model="virtio">
Dec 06 13:05:11 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 13:05:11 user nova-compute[75247]:     </rng>
Dec 06 13:05:11 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 13:05:11 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 13:05:11 user nova-compute[75247]:       <stats period="10"/>
Dec 06 13:05:11 user nova-compute[75247]:     </memballoon>
Dec 06 13:05:11 user nova-compute[75247]:   </devices>
Dec 06 13:05:11 user nova-compute[75247]: </domain>
Dec 06 13:05:11 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1217504595',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1217504595',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1217504595',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh+q+Ox5cRYT5ltlkGHYBtVLEWxrPr/2Htp0V8bZ1bDXBYy5rviIrzn/KCAt+0UuwwLA0e/SMMQErRsAHTzEaMTIZGclgEOcv4nlZb+0X5w0dNYavm72A6yG02KzO3GSw==',key_name='tempest-keypair-1608251655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9493d9b0b1024cea9a550e2a42c1e6a1',ramdisk_id='',reservation_id='r-0n3x9pgm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2088852773',owner_user_name='tempest-TestVolumeBootPattern-2088852773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:04:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016714f7502b4a8fa12ed0ce6644c5fc',uuid=3e98845f-ad13-4240-beca-c3f70ef26f9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c291771-553f-41be-9bc1-e97d6dfb1cdd", "address": "fa:16:3e:e7:fd:e8", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c291771-55", "ovs_interfaceid": "8c291771-553f-41be-9bc1-e97d6dfb1cdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converting VIF {"id": "8c291771-553f-41be-9bc1-e97d6dfb1cdd", "address": "fa:16:3e:e7:fd:e8", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c291771-55", "ovs_interfaceid": "8c291771-553f-41be-9bc1-e97d6dfb1cdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:fd:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c291771-553f-41be-9bc1-e97d6dfb1cdd,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c291771-55') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG os_vif [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:fd:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c291771-553f-41be-9bc1-e97d6dfb1cdd,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c291771-55') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e36c6ca3-8455-583a-a959-375b794b398d', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c291771-55, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c291771-55, col_values=(('qos', UUID('fc3d69b7-711d-4504-87ca-8afc0551cd00')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c291771-55, col_values=(('external_ids', {'iface-id': '8c291771-553f-41be-9bc1-e97d6dfb1cdd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:fd:e8', 'vm-uuid': '3e98845f-ad13-4240-beca-c3f70ef26f9e'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:11 user nova-compute[75247]: INFO os_vif [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:fd:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c291771-553f-41be-9bc1-e97d6dfb1cdd,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c291771-55')
Dec 06 13:05:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e30f51f9-f92d-4c81-a8e0-a8dbdc40f6fe tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e30f51f9-f92d-4c81-a8e0-a8dbdc40f6fe tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e30f51f9-f92d-4c81-a8e0-a8dbdc40f6fe tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e30f51f9-f92d-4c81-a8e0-a8dbdc40f6fe tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e30f51f9-f92d-4c81-a8e0-a8dbdc40f6fe tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:05:11 user nova-compute[75247]: INFO nova.compute.manager [None req-e30f51f9-f92d-4c81-a8e0-a8dbdc40f6fe tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Terminating instance
Dec 06 13:05:11 user nova-compute[75247]: DEBUG nova.compute.manager [None req-e30f51f9-f92d-4c81-a8e0-a8dbdc40f6fe tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] No VIF found with MAC fa:16:3e:e7:fd:e8, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG nova.compute.manager [req-b582dd5e-2ac1-4318-a758-b191c88cdf69 req-a6365f1c-5199-4dc6-a815-521b6c459427 service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Received event network-vif-unplugged-58e08de5-6c1a-48bc-aa1a-242ec3b175a1 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b582dd5e-2ac1-4318-a758-b191c88cdf69 req-a6365f1c-5199-4dc6-a815-521b6c459427 service nova] Acquiring lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b582dd5e-2ac1-4318-a758-b191c88cdf69 req-a6365f1c-5199-4dc6-a815-521b6c459427 service nova] Lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b582dd5e-2ac1-4318-a758-b191c88cdf69 req-a6365f1c-5199-4dc6-a815-521b6c459427 service nova] Lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG nova.compute.manager [req-b582dd5e-2ac1-4318-a758-b191c88cdf69 req-a6365f1c-5199-4dc6-a815-521b6c459427 service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] No waiting events found dispatching network-vif-unplugged-58e08de5-6c1a-48bc-aa1a-242ec3b175a1 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG nova.compute.manager [req-b582dd5e-2ac1-4318-a758-b191c88cdf69 req-a6365f1c-5199-4dc6-a815-521b6c459427 service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Received event network-vif-unplugged-58e08de5-6c1a-48bc-aa1a-242ec3b175a1 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG nova.network.neutron [req-0b89457d-18a4-473c-8ae9-f8222ff55c4f req-4a17efc8-34a7-4075-8c05-3a2e0c45bbaf service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Updated VIF entry in instance network info cache for port 58e08de5-6c1a-48bc-aa1a-242ec3b175a1. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG nova.network.neutron [req-0b89457d-18a4-473c-8ae9-f8222ff55c4f req-4a17efc8-34a7-4075-8c05-3a2e0c45bbaf service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Updating instance_info_cache with network_info: [{"id": "58e08de5-6c1a-48bc-aa1a-242ec3b175a1", "address": "fa:16:3e:d6:b6:ce", "network": {"id": "053733b9-e8f4-4da1-a5fe-ee7d0704684c", "bridge": "br-int", "label": "tempest-TestStampPattern-239755854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "135f3c1de288423e8964c31ca35664c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e08de5-6c", "ovs_interfaceid": "58e08de5-6c1a-48bc-aa1a-242ec3b175a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:05:11 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0b89457d-18a4-473c-8ae9-f8222ff55c4f req-4a17efc8-34a7-4075-8c05-3a2e0c45bbaf service nova] Releasing lock "refresh_cache-e1f21135-43cd-4dbb-ae7a-b12dffdc5816" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:05:12 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Instance destroyed successfully.
Dec 06 13:05:12 user nova-compute[75247]: DEBUG nova.objects.instance [None req-e30f51f9-f92d-4c81-a8e0-a8dbdc40f6fe tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lazy-loading 'resources' on Instance uuid e1f21135-43cd-4dbb-ae7a-b12dffdc5816 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:05:12 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-e30f51f9-f92d-4c81-a8e0-a8dbdc40f6fe tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:57:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-305885949',display_name='tempest-TestStampPattern-server-305885949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-305885949',id=40,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0R56ocpUVDhrbWezba5KdSt9CClipCfqGo33mBvmQ86FzrqlnssF888NmN27WHariFI9cN7fX+09ONrvhHiWT31I4taIadhAyTDm1d90LRTwaNyayfF9CNEjQpjWnVDw==',key_name='tempest-TestStampPattern-181483636',keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:58:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='135f3c1de288423e8964c31ca35664c0',ramdisk_id='',reservation_id='r-nl00ebex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1741400309',owner_user_name='tempest-TestStampPattern-1741400309-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T13:01:10Z,user_data=None,user_id='9ac9a9c6e8f34a828c737e8b45da7721',uuid=e1f21135-43cd-4dbb-ae7a-b12dffdc5816,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58e08de5-6c1a-48bc-aa1a-242ec3b175a1", "address": "fa:16:3e:d6:b6:ce", "network": {"id": "053733b9-e8f4-4da1-a5fe-ee7d0704684c", "bridge": "br-int", "label": "tempest-TestStampPattern-239755854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "135f3c1de288423e8964c31ca35664c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e08de5-6c", "ovs_interfaceid": "58e08de5-6c1a-48bc-aa1a-242ec3b175a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 13:05:12 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e30f51f9-f92d-4c81-a8e0-a8dbdc40f6fe tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Converting VIF {"id": "58e08de5-6c1a-48bc-aa1a-242ec3b175a1", "address": "fa:16:3e:d6:b6:ce", "network": {"id": "053733b9-e8f4-4da1-a5fe-ee7d0704684c", "bridge": "br-int", "label": "tempest-TestStampPattern-239755854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "135f3c1de288423e8964c31ca35664c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e08de5-6c", "ovs_interfaceid": "58e08de5-6c1a-48bc-aa1a-242ec3b175a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:05:12 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-e30f51f9-f92d-4c81-a8e0-a8dbdc40f6fe tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:b6:ce,bridge_name='br-int',has_traffic_filtering=True,id=58e08de5-6c1a-48bc-aa1a-242ec3b175a1,network=Network(053733b9-e8f4-4da1-a5fe-ee7d0704684c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e08de5-6c') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:05:12 user nova-compute[75247]: DEBUG os_vif [None req-e30f51f9-f92d-4c81-a8e0-a8dbdc40f6fe tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:b6:ce,bridge_name='br-int',has_traffic_filtering=True,id=58e08de5-6c1a-48bc-aa1a-242ec3b175a1,network=Network(053733b9-e8f4-4da1-a5fe-ee7d0704684c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e08de5-6c') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 13:05:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58e08de5-6c, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:05:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:05:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51c6a0b0-fa8e-40ff-9e9e-457252033d30) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:05:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:05:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:12 user nova-compute[75247]: INFO os_vif [None req-e30f51f9-f92d-4c81-a8e0-a8dbdc40f6fe tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:b6:ce,bridge_name='br-int',has_traffic_filtering=True,id=58e08de5-6c1a-48bc-aa1a-242ec3b175a1,network=Network(053733b9-e8f4-4da1-a5fe-ee7d0704684c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e08de5-6c')
Dec 06 13:05:12 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-e30f51f9-f92d-4c81-a8e0-a8dbdc40f6fe tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Deleting instance files /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816_del
Dec 06 13:05:12 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-e30f51f9-f92d-4c81-a8e0-a8dbdc40f6fe tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Deletion of /opt/stack/data/nova/instances/e1f21135-43cd-4dbb-ae7a-b12dffdc5816_del complete
Dec 06 13:05:12 user nova-compute[75247]: INFO nova.compute.manager [None req-e30f51f9-f92d-4c81-a8e0-a8dbdc40f6fe tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Took 1.44 seconds to destroy the instance on the hypervisor.
Dec 06 13:05:12 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-e30f51f9-f92d-4c81-a8e0-a8dbdc40f6fe tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 13:05:12 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 13:05:12 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 13:05:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-2fca787f-26c3-4716-bfe6-955d91857a3f req-ceeeb8b3-f701-4006-a70f-4d68c6741d40 service nova] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Received event network-vif-plugged-8c291771-553f-41be-9bc1-e97d6dfb1cdd {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:05:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2fca787f-26c3-4716-bfe6-955d91857a3f req-ceeeb8b3-f701-4006-a70f-4d68c6741d40 service nova] Acquiring lock "3e98845f-ad13-4240-beca-c3f70ef26f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:05:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2fca787f-26c3-4716-bfe6-955d91857a3f req-ceeeb8b3-f701-4006-a70f-4d68c6741d40 service nova] Lock "3e98845f-ad13-4240-beca-c3f70ef26f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:05:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2fca787f-26c3-4716-bfe6-955d91857a3f req-ceeeb8b3-f701-4006-a70f-4d68c6741d40 service nova] Lock "3e98845f-ad13-4240-beca-c3f70ef26f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:05:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-2fca787f-26c3-4716-bfe6-955d91857a3f req-ceeeb8b3-f701-4006-a70f-4d68c6741d40 service nova] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] No waiting events found dispatching network-vif-plugged-8c291771-553f-41be-9bc1-e97d6dfb1cdd {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:05:13 user nova-compute[75247]: WARNING nova.compute.manager [req-2fca787f-26c3-4716-bfe6-955d91857a3f req-ceeeb8b3-f701-4006-a70f-4d68c6741d40 service nova] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Received unexpected event network-vif-plugged-8c291771-553f-41be-9bc1-e97d6dfb1cdd for instance with vm_state building and task_state spawning.
Dec 06 13:05:13 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:05:13 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Took 0.58 seconds to deallocate network for instance.
Dec 06 13:05:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-6ea49fb0-2d33-4059-b46a-f652c53c9673 req-5935294e-6140-4444-9008-b08541a2dbd7 service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Received event network-vif-deleted-58e08de5-6c1a-48bc-aa1a-242ec3b175a1 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:05:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e30f51f9-f92d-4c81-a8e0-a8dbdc40f6fe tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:05:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e30f51f9-f92d-4c81-a8e0-a8dbdc40f6fe tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:05:13 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-e30f51f9-f92d-4c81-a8e0-a8dbdc40f6fe tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:05:13 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-e30f51f9-f92d-4c81-a8e0-a8dbdc40f6fe tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:05:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e30f51f9-f92d-4c81-a8e0-a8dbdc40f6fe tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:05:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:13 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-e30f51f9-f92d-4c81-a8e0-a8dbdc40f6fe tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Deleted allocations for instance e1f21135-43cd-4dbb-ae7a-b12dffdc5816
Dec 06 13:05:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-ec9d8f71-8c61-4caf-93ad-cccdbda32da0 req-432dac9c-6ee2-46a8-9251-77029e256f6d service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Received event network-vif-plugged-58e08de5-6c1a-48bc-aa1a-242ec3b175a1 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:05:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ec9d8f71-8c61-4caf-93ad-cccdbda32da0 req-432dac9c-6ee2-46a8-9251-77029e256f6d service nova] Acquiring lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:05:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ec9d8f71-8c61-4caf-93ad-cccdbda32da0 req-432dac9c-6ee2-46a8-9251-77029e256f6d service nova] Lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:05:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ec9d8f71-8c61-4caf-93ad-cccdbda32da0 req-432dac9c-6ee2-46a8-9251-77029e256f6d service nova] Lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:05:13 user nova-compute[75247]: DEBUG nova.compute.manager [req-ec9d8f71-8c61-4caf-93ad-cccdbda32da0 req-432dac9c-6ee2-46a8-9251-77029e256f6d service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] No waiting events found dispatching network-vif-plugged-58e08de5-6c1a-48bc-aa1a-242ec3b175a1 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:05:13 user nova-compute[75247]: WARNING nova.compute.manager [req-ec9d8f71-8c61-4caf-93ad-cccdbda32da0 req-432dac9c-6ee2-46a8-9251-77029e256f6d service nova] [instance: e1f21135-43cd-4dbb-ae7a-b12dffdc5816] Received unexpected event network-vif-plugged-58e08de5-6c1a-48bc-aa1a-242ec3b175a1 for instance with vm_state deleted and task_state None.
Dec 06 13:05:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-e30f51f9-f92d-4c81-a8e0-a8dbdc40f6fe tempest-TestStampPattern-1741400309 tempest-TestStampPattern-1741400309-project-member] Lock "e1f21135-43cd-4dbb-ae7a-b12dffdc5816" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.493s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:05:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:15 user nova-compute[75247]: DEBUG nova.compute.manager [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 13:05:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 13:05:15 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Instance spawned successfully.
Dec 06 13:05:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 13:05:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:05:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:05:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:05:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:05:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:05:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:05:15 user nova-compute[75247]: DEBUG nova.compute.manager [req-7d0d2b26-de25-4667-8254-00d83b83dd22 req-b56c71d5-d672-47d6-9529-ab1d38dd79b4 service nova] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Received event network-vif-plugged-8c291771-553f-41be-9bc1-e97d6dfb1cdd {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:05:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7d0d2b26-de25-4667-8254-00d83b83dd22 req-b56c71d5-d672-47d6-9529-ab1d38dd79b4 service nova] Acquiring lock "3e98845f-ad13-4240-beca-c3f70ef26f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:05:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7d0d2b26-de25-4667-8254-00d83b83dd22 req-b56c71d5-d672-47d6-9529-ab1d38dd79b4 service nova] Lock "3e98845f-ad13-4240-beca-c3f70ef26f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:05:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-7d0d2b26-de25-4667-8254-00d83b83dd22 req-b56c71d5-d672-47d6-9529-ab1d38dd79b4 service nova] Lock "3e98845f-ad13-4240-beca-c3f70ef26f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:05:15 user nova-compute[75247]: DEBUG nova.compute.manager [req-7d0d2b26-de25-4667-8254-00d83b83dd22 req-b56c71d5-d672-47d6-9529-ab1d38dd79b4 service nova] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] No waiting events found dispatching network-vif-plugged-8c291771-553f-41be-9bc1-e97d6dfb1cdd {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:05:15 user nova-compute[75247]: WARNING nova.compute.manager [req-7d0d2b26-de25-4667-8254-00d83b83dd22 req-b56c71d5-d672-47d6-9529-ab1d38dd79b4 service nova] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Received unexpected event network-vif-plugged-8c291771-553f-41be-9bc1-e97d6dfb1cdd for instance with vm_state building and task_state spawning.
Dec 06 13:05:15 user nova-compute[75247]: INFO nova.compute.manager [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Took 5.46 seconds to spawn the instance on the hypervisor.
Dec 06 13:05:15 user nova-compute[75247]: DEBUG nova.compute.manager [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 13:05:15 user nova-compute[75247]: INFO nova.compute.manager [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Took 21.82 seconds to build instance.
Dec 06 13:05:15 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bb07ac23-8cb9-4de8-bf0d-b067a6741352 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "3e98845f-ad13-4240-beca-c3f70ef26f9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.912s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:05:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:22 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:05:22 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:05:22 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:05:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d0868e2b-bcdd-4807-91ab-eb22384ad2f8 tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Acquiring lock "c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:05:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d0868e2b-bcdd-4807-91ab-eb22384ad2f8 tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Lock "c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:05:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d0868e2b-bcdd-4807-91ab-eb22384ad2f8 tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Acquiring lock "c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:05:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d0868e2b-bcdd-4807-91ab-eb22384ad2f8 tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Lock "c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:05:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d0868e2b-bcdd-4807-91ab-eb22384ad2f8 tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Lock "c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:05:24 user nova-compute[75247]: INFO nova.compute.manager [None req-d0868e2b-bcdd-4807-91ab-eb22384ad2f8 tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Terminating instance
Dec 06 13:05:24 user nova-compute[75247]: DEBUG nova.compute.manager [None req-d0868e2b-bcdd-4807-91ab-eb22384ad2f8 tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 13:05:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:24 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:05:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:25 user nova-compute[75247]: DEBUG nova.compute.manager [req-20995292-5f27-417d-8969-f955c4c399d4 req-8caed088-298b-405a-afb7-615fe34deda2 service nova] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Received event network-vif-unplugged-94fd19d6-0a33-411a-a022-5f48d5fcbf81 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:05:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-20995292-5f27-417d-8969-f955c4c399d4 req-8caed088-298b-405a-afb7-615fe34deda2 service nova] Acquiring lock "c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:05:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-20995292-5f27-417d-8969-f955c4c399d4 req-8caed088-298b-405a-afb7-615fe34deda2 service nova] Lock "c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:05:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-20995292-5f27-417d-8969-f955c4c399d4 req-8caed088-298b-405a-afb7-615fe34deda2 service nova] Lock "c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:05:25 user nova-compute[75247]: DEBUG nova.compute.manager [req-20995292-5f27-417d-8969-f955c4c399d4 req-8caed088-298b-405a-afb7-615fe34deda2 service nova] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] No waiting events found dispatching network-vif-unplugged-94fd19d6-0a33-411a-a022-5f48d5fcbf81 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:05:25 user nova-compute[75247]: DEBUG nova.compute.manager [req-20995292-5f27-417d-8969-f955c4c399d4 req-8caed088-298b-405a-afb7-615fe34deda2 service nova] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Received event network-vif-unplugged-94fd19d6-0a33-411a-a022-5f48d5fcbf81 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 13:05:25 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Instance destroyed successfully.
Dec 06 13:05:25 user nova-compute[75247]: DEBUG nova.objects.instance [None req-d0868e2b-bcdd-4807-91ab-eb22384ad2f8 tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Lazy-loading 'resources' on Instance uuid c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:05:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-d0868e2b-bcdd-4807-91ab-eb22384ad2f8 tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:03:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1187805885',display_name='tempest-VolumesNegativeTest-instance-1187805885',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1187805885',id=43,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T13:03:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80b2a4d68f4045bfa71962e75cc6025d',ramdisk_id='',reservation_id='r-npq4qwgh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-751249540',owner_user_name='tempest-VolumesNegativeTest-751249540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T13:03:42Z,user_data=None,user_id='b7e2206177f54248b4da5b00487834a7',uuid=c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94fd19d6-0a33-411a-a022-5f48d5fcbf81", "address": "fa:16:3e:ce:80:b4", "network": {"id": "5aa2ea25-254d-408e-9f5a-8d5eb1a612d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cdd9b7fb5eaf469d885ee225099128e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fd19d6-0a", "ovs_interfaceid": "94fd19d6-0a33-411a-a022-5f48d5fcbf81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 13:05:25 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-d0868e2b-bcdd-4807-91ab-eb22384ad2f8 tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Converting VIF {"id": "94fd19d6-0a33-411a-a022-5f48d5fcbf81", "address": "fa:16:3e:ce:80:b4", "network": {"id": "5aa2ea25-254d-408e-9f5a-8d5eb1a612d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cdd9b7fb5eaf469d885ee225099128e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fd19d6-0a", "ovs_interfaceid": "94fd19d6-0a33-411a-a022-5f48d5fcbf81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:05:25 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-d0868e2b-bcdd-4807-91ab-eb22384ad2f8 tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:80:b4,bridge_name='br-int',has_traffic_filtering=True,id=94fd19d6-0a33-411a-a022-5f48d5fcbf81,network=Network(5aa2ea25-254d-408e-9f5a-8d5eb1a612d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fd19d6-0a') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:05:25 user nova-compute[75247]: DEBUG os_vif [None req-d0868e2b-bcdd-4807-91ab-eb22384ad2f8 tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:80:b4,bridge_name='br-int',has_traffic_filtering=True,id=94fd19d6-0a33-411a-a022-5f48d5fcbf81,network=Network(5aa2ea25-254d-408e-9f5a-8d5eb1a612d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fd19d6-0a') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 13:05:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94fd19d6-0a, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:05:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:05:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca925d55-22fb-42a7-9e6d-b80cfaeb2f75) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:05:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:05:25 user nova-compute[75247]: INFO os_vif [None req-d0868e2b-bcdd-4807-91ab-eb22384ad2f8 tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:80:b4,bridge_name='br-int',has_traffic_filtering=True,id=94fd19d6-0a33-411a-a022-5f48d5fcbf81,network=Network(5aa2ea25-254d-408e-9f5a-8d5eb1a612d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fd19d6-0a')
Dec 06 13:05:25 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-d0868e2b-bcdd-4807-91ab-eb22384ad2f8 tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Deleting instance files /opt/stack/data/nova/instances/c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb_del
Dec 06 13:05:25 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-d0868e2b-bcdd-4807-91ab-eb22384ad2f8 tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Deletion of /opt/stack/data/nova/instances/c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb_del complete
Dec 06 13:05:25 user nova-compute[75247]: INFO nova.compute.manager [None req-d0868e2b-bcdd-4807-91ab-eb22384ad2f8 tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Took 0.85 seconds to destroy the instance on the hypervisor.
Dec 06 13:05:25 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-d0868e2b-bcdd-4807-91ab-eb22384ad2f8 tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 13:05:25 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 13:05:25 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 13:05:25 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:05:26 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:05:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-c3d975b5-0a79-4195-b7dc-4598c3b050e6 req-eaa37b93-bbdb-49ba-bff2-a6e3cdf0b2b2 service nova] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Received event network-vif-deleted-94fd19d6-0a33-411a-a022-5f48d5fcbf81 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:05:26 user nova-compute[75247]: INFO nova.compute.manager [req-c3d975b5-0a79-4195-b7dc-4598c3b050e6 req-eaa37b93-bbdb-49ba-bff2-a6e3cdf0b2b2 service nova] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Neutron deleted interface 94fd19d6-0a33-411a-a022-5f48d5fcbf81; detaching it from the instance and deleting it from the info cache
Dec 06 13:05:26 user nova-compute[75247]: DEBUG nova.network.neutron [req-c3d975b5-0a79-4195-b7dc-4598c3b050e6 req-eaa37b93-bbdb-49ba-bff2-a6e3cdf0b2b2 service nova] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:05:26 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Took 0.65 seconds to deallocate network for instance.
Dec 06 13:05:26 user nova-compute[75247]: DEBUG nova.compute.manager [req-c3d975b5-0a79-4195-b7dc-4598c3b050e6 req-eaa37b93-bbdb-49ba-bff2-a6e3cdf0b2b2 service nova] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Detach interface failed, port_id=94fd19d6-0a33-411a-a022-5f48d5fcbf81, reason: Instance c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb could not be found. {{(pid=75247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 13:05:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d0868e2b-bcdd-4807-91ab-eb22384ad2f8 tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:05:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d0868e2b-bcdd-4807-91ab-eb22384ad2f8 tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:05:26 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-d0868e2b-bcdd-4807-91ab-eb22384ad2f8 tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:05:26 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-d0868e2b-bcdd-4807-91ab-eb22384ad2f8 tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:05:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d0868e2b-bcdd-4807-91ab-eb22384ad2f8 tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:05:26 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-d0868e2b-bcdd-4807-91ab-eb22384ad2f8 tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Deleted allocations for instance c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb
Dec 06 13:05:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d0868e2b-bcdd-4807-91ab-eb22384ad2f8 tempest-VolumesNegativeTest-751249540 tempest-VolumesNegativeTest-751249540-project-member] Lock "c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.940s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:05:26 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:05:26 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:05:26 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 13:05:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-bc3ddb40-b05f-4170-b269-d44dec6ecdaf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:05:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-bc3ddb40-b05f-4170-b269-d44dec6ecdaf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:05:27 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 13:05:27 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lazy-loading 'info_cache' on Instance uuid bc3ddb40-b05f-4170-b269-d44dec6ecdaf {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:05:27 user nova-compute[75247]: DEBUG nova.compute.manager [req-8d34efdb-5d04-4eb1-8929-0fa76880fa1c req-42e659d5-84ed-47aa-a5d9-d3d1e8a38be9 service nova] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Received event network-vif-plugged-94fd19d6-0a33-411a-a022-5f48d5fcbf81 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:05:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-8d34efdb-5d04-4eb1-8929-0fa76880fa1c req-42e659d5-84ed-47aa-a5d9-d3d1e8a38be9 service nova] Acquiring lock "c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:05:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-8d34efdb-5d04-4eb1-8929-0fa76880fa1c req-42e659d5-84ed-47aa-a5d9-d3d1e8a38be9 service nova] Lock "c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:05:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-8d34efdb-5d04-4eb1-8929-0fa76880fa1c req-42e659d5-84ed-47aa-a5d9-d3d1e8a38be9 service nova] Lock "c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:05:27 user nova-compute[75247]: DEBUG nova.compute.manager [req-8d34efdb-5d04-4eb1-8929-0fa76880fa1c req-42e659d5-84ed-47aa-a5d9-d3d1e8a38be9 service nova] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] No waiting events found dispatching network-vif-plugged-94fd19d6-0a33-411a-a022-5f48d5fcbf81 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:05:27 user nova-compute[75247]: WARNING nova.compute.manager [req-8d34efdb-5d04-4eb1-8929-0fa76880fa1c req-42e659d5-84ed-47aa-a5d9-d3d1e8a38be9 service nova] [instance: c897fd93-d2a8-4e1b-b0ff-7cd7f00942fb] Received unexpected event network-vif-plugged-94fd19d6-0a33-411a-a022-5f48d5fcbf81 for instance with vm_state deleted and task_state None.
Dec 06 13:05:27 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Updating instance_info_cache with network_info: [{"id": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "address": "fa:16:3e:d5:71:f5", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e66d0f0-cc", "ovs_interfaceid": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:05:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-bc3ddb40-b05f-4170-b269-d44dec6ecdaf" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:05:27 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 13:05:27 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:05:27 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:05:27 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:05:27 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:05:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:05:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:05:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:05:27 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:05:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:05:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:05:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:05:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:05:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:05:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:05:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:05:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:05:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:05:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:05:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:05:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:05:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:05:29 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:05:29 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:05:29 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=8560MB free_disk=25.128334045410156GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:05:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:05:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:05:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:29 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance bc3ddb40-b05f-4170-b269-d44dec6ecdaf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:05:29 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 530cfb75-7aa8-4e57-b282-8f7a21401b34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:05:29 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 3e98845f-ad13-4240-beca-c3f70ef26f9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:05:29 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:05:29 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:05:29 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:05:29 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:05:29 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:05:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:05:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-76934e0a-3ad6-43d0-8809-197fcfe6742b tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "530cfb75-7aa8-4e57-b282-8f7a21401b34" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:05:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-76934e0a-3ad6-43d0-8809-197fcfe6742b tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "530cfb75-7aa8-4e57-b282-8f7a21401b34" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:05:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-76934e0a-3ad6-43d0-8809-197fcfe6742b tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:05:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-76934e0a-3ad6-43d0-8809-197fcfe6742b tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:05:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-76934e0a-3ad6-43d0-8809-197fcfe6742b tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:05:30 user nova-compute[75247]: INFO nova.compute.manager [None req-76934e0a-3ad6-43d0-8809-197fcfe6742b tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Terminating instance
Dec 06 13:05:30 user nova-compute[75247]: DEBUG nova.compute.manager [None req-76934e0a-3ad6-43d0-8809-197fcfe6742b tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 13:05:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:30 user nova-compute[75247]: DEBUG nova.compute.manager [req-63ad95f1-8c48-49fa-85fa-59a83592d6fe req-3cbb69b9-7b91-40fd-a6ce-18aa80868419 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Received event network-vif-unplugged-d924dd21-056e-413d-8fc1-493933e7e7e6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:05:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-63ad95f1-8c48-49fa-85fa-59a83592d6fe req-3cbb69b9-7b91-40fd-a6ce-18aa80868419 service nova] Acquiring lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:05:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-63ad95f1-8c48-49fa-85fa-59a83592d6fe req-3cbb69b9-7b91-40fd-a6ce-18aa80868419 service nova] Lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:05:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-63ad95f1-8c48-49fa-85fa-59a83592d6fe req-3cbb69b9-7b91-40fd-a6ce-18aa80868419 service nova] Lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:05:30 user nova-compute[75247]: DEBUG nova.compute.manager [req-63ad95f1-8c48-49fa-85fa-59a83592d6fe req-3cbb69b9-7b91-40fd-a6ce-18aa80868419 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] No waiting events found dispatching network-vif-unplugged-d924dd21-056e-413d-8fc1-493933e7e7e6 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:05:30 user nova-compute[75247]: DEBUG nova.compute.manager [req-63ad95f1-8c48-49fa-85fa-59a83592d6fe req-3cbb69b9-7b91-40fd-a6ce-18aa80868419 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Received event network-vif-unplugged-d924dd21-056e-413d-8fc1-493933e7e7e6 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 13:05:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:31 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Instance destroyed successfully.
Dec 06 13:05:31 user nova-compute[75247]: DEBUG nova.objects.instance [None req-76934e0a-3ad6-43d0-8809-197fcfe6742b tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'resources' on Instance uuid 530cfb75-7aa8-4e57-b282-8f7a21401b34 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:05:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-76934e0a-3ad6-43d0-8809-197fcfe6742b tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:49:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1228817559',display_name='tempest-ServerRescueNegativeTestJSON-server-1228817559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1228817559',id=26,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:51:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b253fd3ef3284dd885d3a0efc1ec07d7',ramdisk_id='',reservation_id='r-7yrk1w0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-295230580',owner_user_name='tempest-ServerRescueNegativeTestJSON-295230580-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:51:13Z,user_data=None,user_id='deac43cb03b440ff9de75801065ec9af',uuid=530cfb75-7aa8-4e57-b282-8f7a21401b34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "d924dd21-056e-413d-8fc1-493933e7e7e6", "address": "fa:16:3e:76:c7:97", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd924dd21-05", "ovs_interfaceid": "d924dd21-056e-413d-8fc1-493933e7e7e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 13:05:31 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-76934e0a-3ad6-43d0-8809-197fcfe6742b tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Converting VIF {"id": "d924dd21-056e-413d-8fc1-493933e7e7e6", "address": "fa:16:3e:76:c7:97", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd924dd21-05", "ovs_interfaceid": "d924dd21-056e-413d-8fc1-493933e7e7e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:05:31 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-76934e0a-3ad6-43d0-8809-197fcfe6742b tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:c7:97,bridge_name='br-int',has_traffic_filtering=True,id=d924dd21-056e-413d-8fc1-493933e7e7e6,network=Network(579972e2-9933-47d9-b56b-f64b5650d611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd924dd21-05') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:05:31 user nova-compute[75247]: DEBUG os_vif [None req-76934e0a-3ad6-43d0-8809-197fcfe6742b tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:c7:97,bridge_name='br-int',has_traffic_filtering=True,id=d924dd21-056e-413d-8fc1-493933e7e7e6,network=Network(579972e2-9933-47d9-b56b-f64b5650d611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd924dd21-05') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 13:05:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd924dd21-05, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:05:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:05:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e60529d2-b1fd-470a-bddc-832e84f419c7) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:05:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:05:31 user nova-compute[75247]: INFO os_vif [None req-76934e0a-3ad6-43d0-8809-197fcfe6742b tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:c7:97,bridge_name='br-int',has_traffic_filtering=True,id=d924dd21-056e-413d-8fc1-493933e7e7e6,network=Network(579972e2-9933-47d9-b56b-f64b5650d611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd924dd21-05')
Dec 06 13:05:31 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-76934e0a-3ad6-43d0-8809-197fcfe6742b tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Deleting instance files /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34_del
Dec 06 13:05:31 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-76934e0a-3ad6-43d0-8809-197fcfe6742b tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Deletion of /opt/stack/data/nova/instances/530cfb75-7aa8-4e57-b282-8f7a21401b34_del complete
Dec 06 13:05:31 user nova-compute[75247]: INFO nova.compute.manager [None req-76934e0a-3ad6-43d0-8809-197fcfe6742b tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Took 0.91 seconds to destroy the instance on the hypervisor.
Dec 06 13:05:31 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-76934e0a-3ad6-43d0-8809-197fcfe6742b tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 13:05:31 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 13:05:31 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 13:05:31 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:05:31 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Took 0.41 seconds to deallocate network for instance.
Dec 06 13:05:31 user nova-compute[75247]: DEBUG nova.compute.manager [req-f649d7d7-f7b3-4b7a-abc4-78f7f4ed4554 req-54e31b2a-0d89-4d9a-8b07-136904534f83 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Received event network-vif-deleted-d924dd21-056e-413d-8fc1-493933e7e7e6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:05:31 user nova-compute[75247]: INFO nova.compute.manager [req-f649d7d7-f7b3-4b7a-abc4-78f7f4ed4554 req-54e31b2a-0d89-4d9a-8b07-136904534f83 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Neutron deleted interface d924dd21-056e-413d-8fc1-493933e7e7e6; detaching it from the instance and deleting it from the info cache
Dec 06 13:05:31 user nova-compute[75247]: DEBUG nova.network.neutron [req-f649d7d7-f7b3-4b7a-abc4-78f7f4ed4554 req-54e31b2a-0d89-4d9a-8b07-136904534f83 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:05:31 user nova-compute[75247]: DEBUG nova.compute.manager [req-f649d7d7-f7b3-4b7a-abc4-78f7f4ed4554 req-54e31b2a-0d89-4d9a-8b07-136904534f83 service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Detach interface failed, port_id=d924dd21-056e-413d-8fc1-493933e7e7e6, reason: Instance 530cfb75-7aa8-4e57-b282-8f7a21401b34 could not be found. {{(pid=75247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 13:05:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-76934e0a-3ad6-43d0-8809-197fcfe6742b tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:05:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-76934e0a-3ad6-43d0-8809-197fcfe6742b tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:05:31 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-76934e0a-3ad6-43d0-8809-197fcfe6742b tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:05:32 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-76934e0a-3ad6-43d0-8809-197fcfe6742b tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:05:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-76934e0a-3ad6-43d0-8809-197fcfe6742b tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:05:32 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-76934e0a-3ad6-43d0-8809-197fcfe6742b tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Deleted allocations for instance 530cfb75-7aa8-4e57-b282-8f7a21401b34
Dec 06 13:05:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-76934e0a-3ad6-43d0-8809-197fcfe6742b tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "530cfb75-7aa8-4e57-b282-8f7a21401b34" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.821s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:05:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-797206f6-e1a0-46dc-b775-d67606697537 req-efa9d07d-06c5-4b07-8765-8f998243405a service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Received event network-vif-plugged-d924dd21-056e-413d-8fc1-493933e7e7e6 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:05:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-797206f6-e1a0-46dc-b775-d67606697537 req-efa9d07d-06c5-4b07-8765-8f998243405a service nova] Acquiring lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:05:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-797206f6-e1a0-46dc-b775-d67606697537 req-efa9d07d-06c5-4b07-8765-8f998243405a service nova] Lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:05:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-797206f6-e1a0-46dc-b775-d67606697537 req-efa9d07d-06c5-4b07-8765-8f998243405a service nova] Lock "530cfb75-7aa8-4e57-b282-8f7a21401b34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:05:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-797206f6-e1a0-46dc-b775-d67606697537 req-efa9d07d-06c5-4b07-8765-8f998243405a service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] No waiting events found dispatching network-vif-plugged-d924dd21-056e-413d-8fc1-493933e7e7e6 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:05:32 user nova-compute[75247]: WARNING nova.compute.manager [req-797206f6-e1a0-46dc-b775-d67606697537 req-efa9d07d-06c5-4b07-8765-8f998243405a service nova] [instance: 530cfb75-7aa8-4e57-b282-8f7a21401b34] Received unexpected event network-vif-plugged-d924dd21-056e-413d-8fc1-493933e7e7e6 for instance with vm_state deleted and task_state None.
Dec 06 13:05:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:36 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:05:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:05:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:06:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8866c080-f4aa-4208-ba0e-f40517e48fc0 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:06:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8866c080-f4aa-4208-ba0e-f40517e48fc0 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:06:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8866c080-f4aa-4208-ba0e-f40517e48fc0 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:06:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8866c080-f4aa-4208-ba0e-f40517e48fc0 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:06:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8866c080-f4aa-4208-ba0e-f40517e48fc0 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:06:20 user nova-compute[75247]: INFO nova.compute.manager [None req-8866c080-f4aa-4208-ba0e-f40517e48fc0 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Terminating instance
Dec 06 13:06:20 user nova-compute[75247]: DEBUG nova.compute.manager [None req-8866c080-f4aa-4208-ba0e-f40517e48fc0 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 13:06:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-78a9929c-83f4-4dd6-84e0-2211fe37632e req-e6ddeb26-1cfb-43c6-ad0b-e264a667a71f service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received event network-vif-unplugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:06:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-78a9929c-83f4-4dd6-84e0-2211fe37632e req-e6ddeb26-1cfb-43c6-ad0b-e264a667a71f service nova] Acquiring lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:06:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-78a9929c-83f4-4dd6-84e0-2211fe37632e req-e6ddeb26-1cfb-43c6-ad0b-e264a667a71f service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:06:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-78a9929c-83f4-4dd6-84e0-2211fe37632e req-e6ddeb26-1cfb-43c6-ad0b-e264a667a71f service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:06:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-78a9929c-83f4-4dd6-84e0-2211fe37632e req-e6ddeb26-1cfb-43c6-ad0b-e264a667a71f service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] No waiting events found dispatching network-vif-unplugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:06:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-78a9929c-83f4-4dd6-84e0-2211fe37632e req-e6ddeb26-1cfb-43c6-ad0b-e264a667a71f service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received event network-vif-unplugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 13:06:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:21 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Instance destroyed successfully.
Dec 06 13:06:21 user nova-compute[75247]: DEBUG nova.objects.instance [None req-8866c080-f4aa-4208-ba0e-f40517e48fc0 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lazy-loading 'resources' on Instance uuid bc3ddb40-b05f-4170-b269-d44dec6ecdaf {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:06:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-8866c080-f4aa-4208-ba0e-f40517e48fc0 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T12:49:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-404265289',display_name='tempest-ServerRescueNegativeTestJSON-server-404265289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-404265289',id=25,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T12:54:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b253fd3ef3284dd885d3a0efc1ec07d7',ramdisk_id='',reservation_id='r-66f8wdqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-295230580',owner_user_name='tempest-ServerRescueNegativeTestJSON-295230580-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T12:55:58Z,user_data=None,user_id='deac43cb03b440ff9de75801065ec9af',uuid=bc3ddb40-b05f-4170-b269-d44dec6ecdaf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "address": "fa:16:3e:d5:71:f5", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e66d0f0-cc", "ovs_interfaceid": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 13:06:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-8866c080-f4aa-4208-ba0e-f40517e48fc0 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Converting VIF {"id": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "address": "fa:16:3e:d5:71:f5", "network": {"id": "579972e2-9933-47d9-b56b-f64b5650d611", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425129289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b253fd3ef3284dd885d3a0efc1ec07d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e66d0f0-cc", "ovs_interfaceid": "4e66d0f0-cc12-4e3a-8626-59f8a73862e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:06:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-8866c080-f4aa-4208-ba0e-f40517e48fc0 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:71:f5,bridge_name='br-int',has_traffic_filtering=True,id=4e66d0f0-cc12-4e3a-8626-59f8a73862e8,network=Network(579972e2-9933-47d9-b56b-f64b5650d611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e66d0f0-cc') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:06:21 user nova-compute[75247]: DEBUG os_vif [None req-8866c080-f4aa-4208-ba0e-f40517e48fc0 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:71:f5,bridge_name='br-int',has_traffic_filtering=True,id=4e66d0f0-cc12-4e3a-8626-59f8a73862e8,network=Network(579972e2-9933-47d9-b56b-f64b5650d611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e66d0f0-cc') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 13:06:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e66d0f0-cc, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:06:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:06:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0911b218-b5d6-4281-a022-c41d5c64d2e4) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:06:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:06:21 user nova-compute[75247]: INFO os_vif [None req-8866c080-f4aa-4208-ba0e-f40517e48fc0 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:71:f5,bridge_name='br-int',has_traffic_filtering=True,id=4e66d0f0-cc12-4e3a-8626-59f8a73862e8,network=Network(579972e2-9933-47d9-b56b-f64b5650d611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e66d0f0-cc')
Dec 06 13:06:21 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-8866c080-f4aa-4208-ba0e-f40517e48fc0 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Deleting instance files /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf_del
Dec 06 13:06:21 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-8866c080-f4aa-4208-ba0e-f40517e48fc0 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Deletion of /opt/stack/data/nova/instances/bc3ddb40-b05f-4170-b269-d44dec6ecdaf_del complete
Dec 06 13:06:21 user nova-compute[75247]: INFO nova.compute.manager [None req-8866c080-f4aa-4208-ba0e-f40517e48fc0 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Took 0.92 seconds to destroy the instance on the hypervisor.
Dec 06 13:06:21 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-8866c080-f4aa-4208-ba0e-f40517e48fc0 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 13:06:21 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 13:06:21 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 13:06:22 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:06:22 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Took 0.57 seconds to deallocate network for instance.
Dec 06 13:06:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8866c080-f4aa-4208-ba0e-f40517e48fc0 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:06:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8866c080-f4aa-4208-ba0e-f40517e48fc0 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:06:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-45180042-d0f8-48f4-b76d-2293d29177f4 req-091838fb-1ed9-41ee-856f-d42dfd4efd7c service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received event network-vif-deleted-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:06:22 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-8866c080-f4aa-4208-ba0e-f40517e48fc0 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:06:22 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-8866c080-f4aa-4208-ba0e-f40517e48fc0 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:06:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8866c080-f4aa-4208-ba0e-f40517e48fc0 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:06:22 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-8866c080-f4aa-4208-ba0e-f40517e48fc0 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Deleted allocations for instance bc3ddb40-b05f-4170-b269-d44dec6ecdaf
Dec 06 13:06:22 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:06:22 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:06:22 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:06:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8866c080-f4aa-4208-ba0e-f40517e48fc0 tempest-ServerRescueNegativeTestJSON-295230580 tempest-ServerRescueNegativeTestJSON-295230580-project-member] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.101s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:06:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-e498d178-b230-42d4-883e-c54652005813 req-16fb7ba7-cfa8-4282-814e-979313e1fb99 service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received event network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:06:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e498d178-b230-42d4-883e-c54652005813 req-16fb7ba7-cfa8-4282-814e-979313e1fb99 service nova] Acquiring lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:06:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e498d178-b230-42d4-883e-c54652005813 req-16fb7ba7-cfa8-4282-814e-979313e1fb99 service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:06:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e498d178-b230-42d4-883e-c54652005813 req-16fb7ba7-cfa8-4282-814e-979313e1fb99 service nova] Lock "bc3ddb40-b05f-4170-b269-d44dec6ecdaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:06:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-e498d178-b230-42d4-883e-c54652005813 req-16fb7ba7-cfa8-4282-814e-979313e1fb99 service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] No waiting events found dispatching network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:06:23 user nova-compute[75247]: WARNING nova.compute.manager [req-e498d178-b230-42d4-883e-c54652005813 req-16fb7ba7-cfa8-4282-814e-979313e1fb99 service nova] [instance: bc3ddb40-b05f-4170-b269-d44dec6ecdaf] Received unexpected event network-vif-plugged-4e66d0f0-cc12-4e3a-8626-59f8a73862e8 for instance with vm_state deleted and task_state None.
Dec 06 13:06:24 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:06:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:26 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:06:27 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:06:27 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:06:27 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75247) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 13:06:28 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:06:28 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:06:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-3e98845f-ad13-4240-beca-c3f70ef26f9e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:06:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-3e98845f-ad13-4240-beca-c3f70ef26f9e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:06:29 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 13:06:29 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Updating instance_info_cache with network_info: [{"id": "8c291771-553f-41be-9bc1-e97d6dfb1cdd", "address": "fa:16:3e:e7:fd:e8", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c291771-55", "ovs_interfaceid": "8c291771-553f-41be-9bc1-e97d6dfb1cdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:06:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-3e98845f-ad13-4240-beca-c3f70ef26f9e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:06:29 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 13:06:29 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:06:29 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:06:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:06:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:06:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:06:29 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:06:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:06:30 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:06:30 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:06:30 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=8884MB free_disk=25.173717498779297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:06:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:06:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:06:30 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 3e98845f-ad13-4240-beca-c3f70ef26f9e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:06:30 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:06:30 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:06:30 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Refreshing inventories for resource provider d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 13:06:30 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Updating ProviderTree inventory for provider d326b140-3450-4409-964c-9eafc6cc025d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 13:06:30 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Updating inventory in ProviderTree for provider d326b140-3450-4409-964c-9eafc6cc025d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 13:06:30 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Refreshing aggregate associations for resource provider d326b140-3450-4409-964c-9eafc6cc025d, aggregates: None {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 13:06:30 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Refreshing trait associations for resource provider d326b140-3450-4409-964c-9eafc6cc025d, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 13:06:30 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:06:30 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:06:30 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:06:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:06:30 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:06:30 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:06:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:34 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:06:34 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Cleaning up deleted instances {{(pid=75247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 13:06:34 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] There are 0 instances to clean {{(pid=75247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 13:06:36 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:36 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:38 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:06:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Acquiring lock "8c836066-63ff-47ea-b3c7-f183abb5077a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:06:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:06:42 user nova-compute[75247]: DEBUG nova.compute.manager [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 13:06:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:06:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:06:42 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 13:06:42 user nova-compute[75247]: INFO nova.compute.claims [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Claim successful on node user
Dec 06 13:06:42 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:06:42 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:06:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.227s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:06:42 user nova-compute[75247]: DEBUG nova.compute.manager [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 13:06:42 user nova-compute[75247]: DEBUG nova.compute.manager [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 13:06:42 user nova-compute[75247]: DEBUG nova.network.neutron [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 13:06:42 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 13:06:42 user nova-compute[75247]: DEBUG nova.compute.manager [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 13:06:42 user nova-compute[75247]: DEBUG nova.policy [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d51e2fb05d647d68600ea4e2ca62219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266ddf79993c49c1825cd394ce5310ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 13:06:42 user nova-compute[75247]: DEBUG nova.compute.manager [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 13:06:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 13:06:42 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Creating image(s)
Dec 06 13:06:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:06:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "/opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:06:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "/opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:06:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:06:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.227s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:06:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:06:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:06:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:06:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.177s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:06:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:06:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/disk 1073741824" returned: 0 in 0.049s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:06:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:06:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:06:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.179s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:06:43 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 13:06:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:06:43 user nova-compute[75247]: DEBUG nova.network.neutron [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Successfully created port: 449c3ded-5da6-4274-83bc-0014aed78ec4 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 13:06:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:06:43 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Cannot resize image /opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 13:06:43 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 13:06:43 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Ensure instance console log exists: /opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 13:06:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:06:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:06:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.network.neutron [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Successfully updated port: 449c3ded-5da6-4274-83bc-0014aed78ec4 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Acquiring lock "refresh_cache-8c836066-63ff-47ea-b3c7-f183abb5077a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Acquired lock "refresh_cache-8c836066-63ff-47ea-b3c7-f183abb5077a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.network.neutron [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.compute.manager [req-f5b6928b-c68d-4c73-b059-57fe7089def2 req-e75316cb-2a09-431d-bb88-a4e8791d7859 service nova] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Received event network-changed-449c3ded-5da6-4274-83bc-0014aed78ec4 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.compute.manager [req-f5b6928b-c68d-4c73-b059-57fe7089def2 req-e75316cb-2a09-431d-bb88-a4e8791d7859 service nova] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Refreshing instance network info cache due to event network-changed-449c3ded-5da6-4274-83bc-0014aed78ec4. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f5b6928b-c68d-4c73-b059-57fe7089def2 req-e75316cb-2a09-431d-bb88-a4e8791d7859 service nova] Acquiring lock "refresh_cache-8c836066-63ff-47ea-b3c7-f183abb5077a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.network.neutron [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.compute.manager [req-ee6ae058-fa75-4f1a-9e26-d0b5d93839a5 req-bf59d154-686d-4673-9e24-581d63a7495a service nova] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Received event network-changed-8c291771-553f-41be-9bc1-e97d6dfb1cdd {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.compute.manager [req-ee6ae058-fa75-4f1a-9e26-d0b5d93839a5 req-bf59d154-686d-4673-9e24-581d63a7495a service nova] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Refreshing instance network info cache due to event network-changed-8c291771-553f-41be-9bc1-e97d6dfb1cdd. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ee6ae058-fa75-4f1a-9e26-d0b5d93839a5 req-bf59d154-686d-4673-9e24-581d63a7495a service nova] Acquiring lock "refresh_cache-3e98845f-ad13-4240-beca-c3f70ef26f9e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ee6ae058-fa75-4f1a-9e26-d0b5d93839a5 req-bf59d154-686d-4673-9e24-581d63a7495a service nova] Acquired lock "refresh_cache-3e98845f-ad13-4240-beca-c3f70ef26f9e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.network.neutron [req-ee6ae058-fa75-4f1a-9e26-d0b5d93839a5 req-bf59d154-686d-4673-9e24-581d63a7495a service nova] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Refreshing network info cache for port 8c291771-553f-41be-9bc1-e97d6dfb1cdd {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.network.neutron [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Updating instance_info_cache with network_info: [{"id": "449c3ded-5da6-4274-83bc-0014aed78ec4", "address": "fa:16:3e:14:84:f0", "network": {"id": "21c71f39-1c81-456d-87df-d9b84a3f3f82", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-472433950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "266ddf79993c49c1825cd394ce5310ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449c3ded-5d", "ovs_interfaceid": "449c3ded-5da6-4274-83bc-0014aed78ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Releasing lock "refresh_cache-8c836066-63ff-47ea-b3c7-f183abb5077a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.compute.manager [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Instance network_info: |[{"id": "449c3ded-5da6-4274-83bc-0014aed78ec4", "address": "fa:16:3e:14:84:f0", "network": {"id": "21c71f39-1c81-456d-87df-d9b84a3f3f82", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-472433950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "266ddf79993c49c1825cd394ce5310ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449c3ded-5d", "ovs_interfaceid": "449c3ded-5da6-4274-83bc-0014aed78ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f5b6928b-c68d-4c73-b059-57fe7089def2 req-e75316cb-2a09-431d-bb88-a4e8791d7859 service nova] Acquired lock "refresh_cache-8c836066-63ff-47ea-b3c7-f183abb5077a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.network.neutron [req-f5b6928b-c68d-4c73-b059-57fe7089def2 req-e75316cb-2a09-431d-bb88-a4e8791d7859 service nova] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Refreshing network info cache for port 449c3ded-5da6-4274-83bc-0014aed78ec4 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Start _get_guest_xml network_info=[{"id": "449c3ded-5da6-4274-83bc-0014aed78ec4", "address": "fa:16:3e:14:84:f0", "network": {"id": "21c71f39-1c81-456d-87df-d9b84a3f3f82", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-472433950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "266ddf79993c49c1825cd394ce5310ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449c3ded-5d", "ovs_interfaceid": "449c3ded-5da6-4274-83bc-0014aed78ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 13:06:44 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:06:44 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1695266635',display_name='tempest-TestServerVolumeAttachmentScenario-server-1695266635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1695266635',id=45,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0XoA/ftEd/JRhdiFnGYLnrYCGTPwweWd64soxWNnNgu41JLBpImwGz5vp4Yfw8b7ub3uFMRfnI9bvP/OMW0Vd2ILlQ9vmyeIL/I/CSk4G1fhgTYGgFBmnKmI9t0XRafw==',key_name='tempest-keypair-1217201418',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='266ddf79993c49c1825cd394ce5310ba',ramdisk_id='',reservation_id='r-3uzg7t34',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-362976929',owner_user_name='tempest-TestServerVolumeAttachmentScenario-362976929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d51e2fb05d647d68600ea4e2ca62219',uuid=8c836066-63ff-47ea-b3c7-f183abb5077a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "449c3ded-5da6-4274-83bc-0014aed78ec4", "address": "fa:16:3e:14:84:f0", "network": {"id": "21c71f39-1c81-456d-87df-d9b84a3f3f82", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-472433950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "266ddf79993c49c1825cd394ce5310ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449c3ded-5d", "ovs_interfaceid": "449c3ded-5da6-4274-83bc-0014aed78ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Converting VIF {"id": "449c3ded-5da6-4274-83bc-0014aed78ec4", "address": "fa:16:3e:14:84:f0", "network": {"id": "21c71f39-1c81-456d-87df-d9b84a3f3f82", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-472433950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "266ddf79993c49c1825cd394ce5310ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449c3ded-5d", "ovs_interfaceid": "449c3ded-5da6-4274-83bc-0014aed78ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:84:f0,bridge_name='br-int',has_traffic_filtering=True,id=449c3ded-5da6-4274-83bc-0014aed78ec4,network=Network(21c71f39-1c81-456d-87df-d9b84a3f3f82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap449c3ded-5d') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.objects.instance [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c836066-63ff-47ea-b3c7-f183abb5077a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] End _get_guest_xml xml=<domain type="kvm">
Dec 06 13:06:44 user nova-compute[75247]:   <uuid>8c836066-63ff-47ea-b3c7-f183abb5077a</uuid>
Dec 06 13:06:44 user nova-compute[75247]:   <name>instance-0000002d</name>
Dec 06 13:06:44 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 13:06:44 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 13:06:44 user nova-compute[75247]:   <metadata>
Dec 06 13:06:44 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 13:06:44 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 13:06:44 user nova-compute[75247]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1695266635</nova:name>
Dec 06 13:06:44 user nova-compute[75247]:       <nova:creationTime>2023-12-06 13:06:44</nova:creationTime>
Dec 06 13:06:44 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 13:06:44 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 13:06:44 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 13:06:44 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 13:06:44 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 13:06:44 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 13:06:44 user nova-compute[75247]:       </nova:flavor>
Dec 06 13:06:44 user nova-compute[75247]:       <nova:owner>
Dec 06 13:06:44 user nova-compute[75247]:         <nova:user uuid="6d51e2fb05d647d68600ea4e2ca62219">tempest-TestServerVolumeAttachmentScenario-362976929-project-member</nova:user>
Dec 06 13:06:44 user nova-compute[75247]:         <nova:project uuid="266ddf79993c49c1825cd394ce5310ba">tempest-TestServerVolumeAttachmentScenario-362976929</nova:project>
Dec 06 13:06:44 user nova-compute[75247]:       </nova:owner>
Dec 06 13:06:44 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 13:06:44 user nova-compute[75247]:       <nova:ports>
Dec 06 13:06:44 user nova-compute[75247]:         <nova:port uuid="449c3ded-5da6-4274-83bc-0014aed78ec4">
Dec 06 13:06:44 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 13:06:44 user nova-compute[75247]:         </nova:port>
Dec 06 13:06:44 user nova-compute[75247]:       </nova:ports>
Dec 06 13:06:44 user nova-compute[75247]:     </nova:instance>
Dec 06 13:06:44 user nova-compute[75247]:   </metadata>
Dec 06 13:06:44 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 13:06:44 user nova-compute[75247]:     <system>
Dec 06 13:06:44 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 13:06:44 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 13:06:44 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 13:06:44 user nova-compute[75247]:       <entry name="serial">8c836066-63ff-47ea-b3c7-f183abb5077a</entry>
Dec 06 13:06:44 user nova-compute[75247]:       <entry name="uuid">8c836066-63ff-47ea-b3c7-f183abb5077a</entry>
Dec 06 13:06:44 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 13:06:44 user nova-compute[75247]:     </system>
Dec 06 13:06:44 user nova-compute[75247]:   </sysinfo>
Dec 06 13:06:44 user nova-compute[75247]:   <os>
Dec 06 13:06:44 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 13:06:44 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 13:06:44 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 13:06:44 user nova-compute[75247]:   </os>
Dec 06 13:06:44 user nova-compute[75247]:   <features>
Dec 06 13:06:44 user nova-compute[75247]:     <acpi/>
Dec 06 13:06:44 user nova-compute[75247]:     <apic/>
Dec 06 13:06:44 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 13:06:44 user nova-compute[75247]:   </features>
Dec 06 13:06:44 user nova-compute[75247]:   <clock offset="utc">
Dec 06 13:06:44 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 13:06:44 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 13:06:44 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 13:06:44 user nova-compute[75247]:   </clock>
Dec 06 13:06:44 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 13:06:44 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 13:06:44 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 13:06:44 user nova-compute[75247]:   </cpu>
Dec 06 13:06:44 user nova-compute[75247]:   <devices>
Dec 06 13:06:44 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 13:06:44 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 13:06:44 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/disk"/>
Dec 06 13:06:44 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 13:06:44 user nova-compute[75247]:     </disk>
Dec 06 13:06:44 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 13:06:44 user nova-compute[75247]:       <mac address="fa:16:3e:14:84:f0"/>
Dec 06 13:06:44 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:06:44 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 13:06:44 user nova-compute[75247]:       <target dev="tap449c3ded-5d"/>
Dec 06 13:06:44 user nova-compute[75247]:     </interface>
Dec 06 13:06:44 user nova-compute[75247]:     <serial type="pty">
Dec 06 13:06:44 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/console.log" append="off"/>
Dec 06 13:06:44 user nova-compute[75247]:     </serial>
Dec 06 13:06:44 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 13:06:44 user nova-compute[75247]:     <video>
Dec 06 13:06:44 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:06:44 user nova-compute[75247]:     </video>
Dec 06 13:06:44 user nova-compute[75247]:     <rng model="virtio">
Dec 06 13:06:44 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 13:06:44 user nova-compute[75247]:     </rng>
Dec 06 13:06:44 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 13:06:44 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 13:06:44 user nova-compute[75247]:       <stats period="10"/>
Dec 06 13:06:44 user nova-compute[75247]:     </memballoon>
Dec 06 13:06:44 user nova-compute[75247]:   </devices>
Dec 06 13:06:44 user nova-compute[75247]: </domain>
Dec 06 13:06:44 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1695266635',display_name='tempest-TestServerVolumeAttachmentScenario-server-1695266635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1695266635',id=45,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0XoA/ftEd/JRhdiFnGYLnrYCGTPwweWd64soxWNnNgu41JLBpImwGz5vp4Yfw8b7ub3uFMRfnI9bvP/OMW0Vd2ILlQ9vmyeIL/I/CSk4G1fhgTYGgFBmnKmI9t0XRafw==',key_name='tempest-keypair-1217201418',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='266ddf79993c49c1825cd394ce5310ba',ramdisk_id='',reservation_id='r-3uzg7t34',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-362976929',owner_user_name='tempest-TestServerVolumeAttachmentScenario-362976929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d51e2fb05d647d68600ea4e2ca62219',uuid=8c836066-63ff-47ea-b3c7-f183abb5077a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "449c3ded-5da6-4274-83bc-0014aed78ec4", "address": "fa:16:3e:14:84:f0", "network": {"id": "21c71f39-1c81-456d-87df-d9b84a3f3f82", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-472433950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "266ddf79993c49c1825cd394ce5310ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449c3ded-5d", "ovs_interfaceid": "449c3ded-5da6-4274-83bc-0014aed78ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Converting VIF {"id": "449c3ded-5da6-4274-83bc-0014aed78ec4", "address": "fa:16:3e:14:84:f0", "network": {"id": "21c71f39-1c81-456d-87df-d9b84a3f3f82", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-472433950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "266ddf79993c49c1825cd394ce5310ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449c3ded-5d", "ovs_interfaceid": "449c3ded-5da6-4274-83bc-0014aed78ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:84:f0,bridge_name='br-int',has_traffic_filtering=True,id=449c3ded-5da6-4274-83bc-0014aed78ec4,network=Network(21c71f39-1c81-456d-87df-d9b84a3f3f82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap449c3ded-5d') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG os_vif [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:84:f0,bridge_name='br-int',has_traffic_filtering=True,id=449c3ded-5da6-4274-83bc-0014aed78ec4,network=Network(21c71f39-1c81-456d-87df-d9b84a3f3f82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap449c3ded-5d') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a01a7eb-ca31-5fb3-a407-a8d4126ea8fe', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap449c3ded-5d, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap449c3ded-5d, col_values=(('qos', UUID('843e9016-c36d-4e93-86b4-ce64de996c45')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap449c3ded-5d, col_values=(('external_ids', {'iface-id': '449c3ded-5da6-4274-83bc-0014aed78ec4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:84:f0', 'vm-uuid': '8c836066-63ff-47ea-b3c7-f183abb5077a'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:44 user nova-compute[75247]: INFO os_vif [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:84:f0,bridge_name='br-int',has_traffic_filtering=True,id=449c3ded-5da6-4274-83bc-0014aed78ec4,network=Network(21c71f39-1c81-456d-87df-d9b84a3f3f82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap449c3ded-5d')
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] No VIF found with MAC fa:16:3e:14:84:f0, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 13:06:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:45 user nova-compute[75247]: DEBUG nova.network.neutron [req-ee6ae058-fa75-4f1a-9e26-d0b5d93839a5 req-bf59d154-686d-4673-9e24-581d63a7495a service nova] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Updated VIF entry in instance network info cache for port 8c291771-553f-41be-9bc1-e97d6dfb1cdd. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:06:45 user nova-compute[75247]: DEBUG nova.network.neutron [req-ee6ae058-fa75-4f1a-9e26-d0b5d93839a5 req-bf59d154-686d-4673-9e24-581d63a7495a service nova] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Updating instance_info_cache with network_info: [{"id": "8c291771-553f-41be-9bc1-e97d6dfb1cdd", "address": "fa:16:3e:e7:fd:e8", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c291771-55", "ovs_interfaceid": "8c291771-553f-41be-9bc1-e97d6dfb1cdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:06:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ee6ae058-fa75-4f1a-9e26-d0b5d93839a5 req-bf59d154-686d-4673-9e24-581d63a7495a service nova] Releasing lock "refresh_cache-3e98845f-ad13-4240-beca-c3f70ef26f9e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:06:45 user nova-compute[75247]: DEBUG nova.network.neutron [req-f5b6928b-c68d-4c73-b059-57fe7089def2 req-e75316cb-2a09-431d-bb88-a4e8791d7859 service nova] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Updated VIF entry in instance network info cache for port 449c3ded-5da6-4274-83bc-0014aed78ec4. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:06:45 user nova-compute[75247]: DEBUG nova.network.neutron [req-f5b6928b-c68d-4c73-b059-57fe7089def2 req-e75316cb-2a09-431d-bb88-a4e8791d7859 service nova] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Updating instance_info_cache with network_info: [{"id": "449c3ded-5da6-4274-83bc-0014aed78ec4", "address": "fa:16:3e:14:84:f0", "network": {"id": "21c71f39-1c81-456d-87df-d9b84a3f3f82", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-472433950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "266ddf79993c49c1825cd394ce5310ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449c3ded-5d", "ovs_interfaceid": "449c3ded-5da6-4274-83bc-0014aed78ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:06:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f5b6928b-c68d-4c73-b059-57fe7089def2 req-e75316cb-2a09-431d-bb88-a4e8791d7859 service nova] Releasing lock "refresh_cache-8c836066-63ff-47ea-b3c7-f183abb5077a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:06:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:46 user nova-compute[75247]: DEBUG nova.compute.manager [req-b15912f6-5a36-4be9-8921-a88abb384cf4 req-1a3b8636-cf23-4441-854c-1174cbf4a05c service nova] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Received event network-vif-plugged-449c3ded-5da6-4274-83bc-0014aed78ec4 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:06:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b15912f6-5a36-4be9-8921-a88abb384cf4 req-1a3b8636-cf23-4441-854c-1174cbf4a05c service nova] Acquiring lock "8c836066-63ff-47ea-b3c7-f183abb5077a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:06:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b15912f6-5a36-4be9-8921-a88abb384cf4 req-1a3b8636-cf23-4441-854c-1174cbf4a05c service nova] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:06:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b15912f6-5a36-4be9-8921-a88abb384cf4 req-1a3b8636-cf23-4441-854c-1174cbf4a05c service nova] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:06:46 user nova-compute[75247]: DEBUG nova.compute.manager [req-b15912f6-5a36-4be9-8921-a88abb384cf4 req-1a3b8636-cf23-4441-854c-1174cbf4a05c service nova] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] No waiting events found dispatching network-vif-plugged-449c3ded-5da6-4274-83bc-0014aed78ec4 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:06:46 user nova-compute[75247]: WARNING nova.compute.manager [req-b15912f6-5a36-4be9-8921-a88abb384cf4 req-1a3b8636-cf23-4441-854c-1174cbf4a05c service nova] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Received unexpected event network-vif-plugged-449c3ded-5da6-4274-83bc-0014aed78ec4 for instance with vm_state building and task_state spawning.
Dec 06 13:06:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:48 user nova-compute[75247]: DEBUG nova.compute.manager [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 13:06:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 13:06:48 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Instance spawned successfully.
Dec 06 13:06:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 13:06:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:06:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:06:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:06:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:06:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:06:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:06:48 user nova-compute[75247]: DEBUG nova.compute.manager [req-2380ebdb-cab4-4b5c-949b-b36789b0ac0f req-73150cd1-e763-4204-909c-5a789a6ff68d service nova] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Received event network-vif-plugged-449c3ded-5da6-4274-83bc-0014aed78ec4 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:06:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2380ebdb-cab4-4b5c-949b-b36789b0ac0f req-73150cd1-e763-4204-909c-5a789a6ff68d service nova] Acquiring lock "8c836066-63ff-47ea-b3c7-f183abb5077a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:06:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2380ebdb-cab4-4b5c-949b-b36789b0ac0f req-73150cd1-e763-4204-909c-5a789a6ff68d service nova] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:06:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2380ebdb-cab4-4b5c-949b-b36789b0ac0f req-73150cd1-e763-4204-909c-5a789a6ff68d service nova] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:06:48 user nova-compute[75247]: DEBUG nova.compute.manager [req-2380ebdb-cab4-4b5c-949b-b36789b0ac0f req-73150cd1-e763-4204-909c-5a789a6ff68d service nova] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] No waiting events found dispatching network-vif-plugged-449c3ded-5da6-4274-83bc-0014aed78ec4 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:06:48 user nova-compute[75247]: WARNING nova.compute.manager [req-2380ebdb-cab4-4b5c-949b-b36789b0ac0f req-73150cd1-e763-4204-909c-5a789a6ff68d service nova] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Received unexpected event network-vif-plugged-449c3ded-5da6-4274-83bc-0014aed78ec4 for instance with vm_state building and task_state spawning.
Dec 06 13:06:48 user nova-compute[75247]: INFO nova.compute.manager [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Took 5.82 seconds to spawn the instance on the hypervisor.
Dec 06 13:06:48 user nova-compute[75247]: DEBUG nova.compute.manager [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 13:06:48 user nova-compute[75247]: INFO nova.compute.manager [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Took 6.37 seconds to build instance.
Dec 06 13:06:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-eeea0c26-8729-4ee7-a3e1-17eb11be4d48 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.477s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:06:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:51 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:06:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "43522b23-79ba-457d-8a83-0c38b5dadf50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:06:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "43522b23-79ba-457d-8a83-0c38b5dadf50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:06:53 user nova-compute[75247]: DEBUG nova.compute.manager [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 13:06:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:06:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:06:53 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 13:06:53 user nova-compute[75247]: INFO nova.compute.claims [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Claim successful on node user
Dec 06 13:06:53 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:06:53 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:06:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.274s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:06:53 user nova-compute[75247]: DEBUG nova.compute.manager [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 13:06:53 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 13:06:53 user nova-compute[75247]: DEBUG nova.compute.manager [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 13:06:53 user nova-compute[75247]: DEBUG nova.network.neutron [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 13:06:53 user nova-compute[75247]: DEBUG nova.compute.manager [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 13:06:53 user nova-compute[75247]: INFO nova.virt.block_device [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Booting with volume snapshot d355f97a-7756-4316-b070-11d3af421051 at /dev/vda
Dec 06 13:06:53 user nova-compute[75247]: DEBUG nova.policy [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '016714f7502b4a8fa12ed0ce6644c5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9493d9b0b1024cea9a550e2a42c1e6a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 13:06:54 user nova-compute[75247]: DEBUG nova.network.neutron [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Successfully created port: 49d75e7e-b46c-4355-b93d-70c0abfdfacf {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 13:06:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:55 user nova-compute[75247]: DEBUG nova.network.neutron [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Successfully updated port: 49d75e7e-b46c-4355-b93d-70c0abfdfacf {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 13:06:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "refresh_cache-43522b23-79ba-457d-8a83-0c38b5dadf50" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:06:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquired lock "refresh_cache-43522b23-79ba-457d-8a83-0c38b5dadf50" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:06:55 user nova-compute[75247]: DEBUG nova.network.neutron [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 13:06:55 user nova-compute[75247]: DEBUG nova.compute.manager [req-d999ab85-6941-43a4-ac05-e663594a11d8 req-19417a39-1400-4102-8906-1e2aa02af726 service nova] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Received event network-changed-49d75e7e-b46c-4355-b93d-70c0abfdfacf {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:06:55 user nova-compute[75247]: DEBUG nova.compute.manager [req-d999ab85-6941-43a4-ac05-e663594a11d8 req-19417a39-1400-4102-8906-1e2aa02af726 service nova] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Refreshing instance network info cache due to event network-changed-49d75e7e-b46c-4355-b93d-70c0abfdfacf. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:06:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d999ab85-6941-43a4-ac05-e663594a11d8 req-19417a39-1400-4102-8906-1e2aa02af726 service nova] Acquiring lock "refresh_cache-43522b23-79ba-457d-8a83-0c38b5dadf50" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:06:55 user nova-compute[75247]: DEBUG nova.network.neutron [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 13:06:55 user nova-compute[75247]: DEBUG nova.network.neutron [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Updating instance_info_cache with network_info: [{"id": "49d75e7e-b46c-4355-b93d-70c0abfdfacf", "address": "fa:16:3e:a0:50:03", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49d75e7e-b4", "ovs_interfaceid": "49d75e7e-b46c-4355-b93d-70c0abfdfacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:06:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Releasing lock "refresh_cache-43522b23-79ba-457d-8a83-0c38b5dadf50" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:06:55 user nova-compute[75247]: DEBUG nova.compute.manager [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Instance network_info: |[{"id": "49d75e7e-b46c-4355-b93d-70c0abfdfacf", "address": "fa:16:3e:a0:50:03", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49d75e7e-b4", "ovs_interfaceid": "49d75e7e-b46c-4355-b93d-70c0abfdfacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 13:06:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d999ab85-6941-43a4-ac05-e663594a11d8 req-19417a39-1400-4102-8906-1e2aa02af726 service nova] Acquired lock "refresh_cache-43522b23-79ba-457d-8a83-0c38b5dadf50" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:06:55 user nova-compute[75247]: DEBUG nova.network.neutron [req-d999ab85-6941-43a4-ac05-e663594a11d8 req-19417a39-1400-4102-8906-1e2aa02af726 service nova] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Refreshing network info cache for port 49d75e7e-b46c-4355-b93d-70c0abfdfacf {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:06:55 user nova-compute[75247]: DEBUG nova.network.neutron [req-d999ab85-6941-43a4-ac05-e663594a11d8 req-19417a39-1400-4102-8906-1e2aa02af726 service nova] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Updated VIF entry in instance network info cache for port 49d75e7e-b46c-4355-b93d-70c0abfdfacf. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:06:55 user nova-compute[75247]: DEBUG nova.network.neutron [req-d999ab85-6941-43a4-ac05-e663594a11d8 req-19417a39-1400-4102-8906-1e2aa02af726 service nova] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Updating instance_info_cache with network_info: [{"id": "49d75e7e-b46c-4355-b93d-70c0abfdfacf", "address": "fa:16:3e:a0:50:03", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49d75e7e-b4", "ovs_interfaceid": "49d75e7e-b46c-4355-b93d-70c0abfdfacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:06:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d999ab85-6941-43a4-ac05-e663594a11d8 req-19417a39-1400-4102-8906-1e2aa02af726 service nova] Releasing lock "refresh_cache-43522b23-79ba-457d-8a83-0c38b5dadf50" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:06:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:06:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:04 user nova-compute[75247]: DEBUG os_brick.utils [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:07:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:07:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:07:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0072d960-d138-4dd9-9c2f-4737d0c07cee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:07:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:07:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:07:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51640f9-e38d-49ea-87e7-bb61e925d065]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:07:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:07:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:07:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[86116583-be23-4b84-8c5c-bce630e7c741]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:07:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cac3646-cf97-4b5e-adec-c069b9699d0d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:07:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:07:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:07:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 13:07:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:07:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:07:04 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 13:07:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea065e8-672a-4085-9b88-abc8e69eae25]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:07:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 13:07:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 13:07:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 13:07:04 user nova-compute[75247]: DEBUG os_brick.utils [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:07:04 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Updating existing volume attachment record: b7ea64d8-8e51-4851-bc9e-1b78fdb302d4 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 13:07:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:08 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:07:08 user nova-compute[75247]: WARNING nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] While synchronizing instance power states, found 3 instances in the database and 2 instances on the hypervisor.
Dec 06 13:07:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid 3e98845f-ad13-4240-beca-c3f70ef26f9e {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 13:07:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid 8c836066-63ff-47ea-b3c7-f183abb5077a {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 13:07:08 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid 43522b23-79ba-457d-8a83-0c38b5dadf50 {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 13:07:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "3e98845f-ad13-4240-beca-c3f70ef26f9e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:07:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "3e98845f-ad13-4240-beca-c3f70ef26f9e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:07:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "8c836066-63ff-47ea-b3c7-f183abb5077a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:07:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:07:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "43522b23-79ba-457d-8a83-0c38b5dadf50" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:07:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "3e98845f-ad13-4240-beca-c3f70ef26f9e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:07:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:07:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG nova.compute.manager [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 13:07:16 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Creating image(s)
Dec 06 13:07:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Did not create local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Ensure instance console log exists: /opt/stack/data/nova/instances/43522b23-79ba-457d-8a83-0c38b5dadf50/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Start _get_guest_xml network_info=[{"id": "49d75e7e-b46c-4355-b93d-70c0abfdfacf", "address": "fa:16:3e:a0:50:03", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49d75e7e-b4", "ovs_interfaceid": "49d75e7e-b46c-4355-b93d-70c0abfdfacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-12-06T13:06:46Z,direct_url=<?>,disk_format='qcow2',id=7ed8c0b1-6988-4054-9f3b-4ee44526e6b3,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-608040405',owner='9493d9b0b1024cea9a550e2a42c1e6a1',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-12-06T13:06:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'b7ea64d8-8e51-4851-bc9e-1b78fdb302d4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SGoPXusi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '43522b23-79ba-457d-8a83-0c38b5dadf50', 'attached_at': '', 'detached_at': '', 'volume_id': '564fe2b3-7387-4f97-9a5b-6b002f8edbfa', 'serial': '564fe2b3-7387-4f97-9a5b-6b002f8edbfa'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 13:07:16 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:07:16 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:07:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-12-06T13:06:46Z,direct_url=<?>,disk_format='qcow2',id=7ed8c0b1-6988-4054-9f3b-4ee44526e6b3,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-608040405',owner='9493d9b0b1024cea9a550e2a42c1e6a1',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-12-06T13:06:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SGoPXusi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:07:16 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:07:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:07:16 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:07:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:07:16 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca4d113-0ad9-4bcd-ae4d-853bbb91ac22]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 13:07:16 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[651ee585-5845-4d1e-9202-958e2505a60d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa] added
Dec 06 13:07:16 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[beea7e81-9d7e-44c0-9f7b-f16d6822a58a]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8602001-8c71-494d-a071-8a77e633b31c]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SGoPXusi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SGoPXusi" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e181034-e9b2-482b-bf87-7edbacb83d22]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SGoPXusi'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ad789e-edce-4691-a871-ce4b5d23eeb2]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39c48b8-e1fd-44e1-b94c-15830d9a573d]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)
Dec 06 13:07:16 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)
Dec 06 13:07:16 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2275784-e96d-4b92-a2d5-9cd13f2c9b3c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa, portal: 172.16.0.220,3260]
Dec 06 13:07:16 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa, portal: 172.16.0.220,3260] successful.
Dec 06 13:07:16 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc387067-2c96-4ec0-8e2d-5e62951aabb4]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[01620904-71b8-449d-b35b-44461001b740]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)
Dec 06 13:07:16 user nova-compute[75247]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa (non-flash)
Dec 06 13:07:16 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)
Dec 06 13:07:16 user nova-compute[75247]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa (non-flash)
Dec 06 13:07:16 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbefdd1a-c10e-4559-bb14-a4c4b901036a]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 13:07:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SGoPXusi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26561323537653739', 'path': '/dev/sdc'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561323537653739', 'path': '/dev/sdc'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-127916433',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-127916433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-127916433',id=46,image_ref='7ed8c0b1-6988-4054-9f3b-4ee44526e6b3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDvxJ/7BqGOEUAj9pK1GDRuBMzkXwEcx7R9lVH/VUHNRJOZ/W5jdwC+P3kVAVWA/0RRorYTqx4sjwIG9kkQTRq2M5/HT7cmZPYTgRJvboHEPbcf7IKQm0OEH35xKBtGhg==',key_name='tempest-keypair-986723898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9493d9b0b1024cea9a550e2a42c1e6a1',ramdisk_id='',reservation_id='r-x4yl1j0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2088852773',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2088852773-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2088852773',owner_user_name='tempest-TestVolumeBootPattern-2088852773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016714f7502b4a8fa12ed0ce6644c5fc',uuid=43522b23-79ba-457d-8a83-0c38b5dadf50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49d75e7e-b46c-4355-b93d-70c0abfdfacf", "address": "fa:16:3e:a0:50:03", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49d75e7e-b4", "ovs_interfaceid": "49d75e7e-b46c-4355-b93d-70c0abfdfacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converting VIF {"id": "49d75e7e-b46c-4355-b93d-70c0abfdfacf", "address": "fa:16:3e:a0:50:03", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49d75e7e-b4", "ovs_interfaceid": "49d75e7e-b46c-4355-b93d-70c0abfdfacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:50:03,bridge_name='br-int',has_traffic_filtering=True,id=49d75e7e-b46c-4355-b93d-70c0abfdfacf,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49d75e7e-b4') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG nova.objects.instance [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lazy-loading 'pci_devices' on Instance uuid 43522b23-79ba-457d-8a83-0c38b5dadf50 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] End _get_guest_xml xml=<domain type="kvm">
Dec 06 13:07:17 user nova-compute[75247]:   <uuid>43522b23-79ba-457d-8a83-0c38b5dadf50</uuid>
Dec 06 13:07:17 user nova-compute[75247]:   <name>instance-0000002e</name>
Dec 06 13:07:17 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 13:07:17 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 13:07:17 user nova-compute[75247]:   <metadata>
Dec 06 13:07:17 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 13:07:17 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 13:07:17 user nova-compute[75247]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-127916433</nova:name>
Dec 06 13:07:17 user nova-compute[75247]:       <nova:creationTime>2023-12-06 13:07:16</nova:creationTime>
Dec 06 13:07:17 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 13:07:17 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 13:07:17 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 13:07:17 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 13:07:17 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 13:07:17 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 13:07:17 user nova-compute[75247]:       </nova:flavor>
Dec 06 13:07:17 user nova-compute[75247]:       <nova:owner>
Dec 06 13:07:17 user nova-compute[75247]:         <nova:user uuid="016714f7502b4a8fa12ed0ce6644c5fc">tempest-TestVolumeBootPattern-2088852773-project-member</nova:user>
Dec 06 13:07:17 user nova-compute[75247]:         <nova:project uuid="9493d9b0b1024cea9a550e2a42c1e6a1">tempest-TestVolumeBootPattern-2088852773</nova:project>
Dec 06 13:07:17 user nova-compute[75247]:       </nova:owner>
Dec 06 13:07:17 user nova-compute[75247]:       <nova:root type="image" uuid="7ed8c0b1-6988-4054-9f3b-4ee44526e6b3"/>
Dec 06 13:07:17 user nova-compute[75247]:       <nova:ports>
Dec 06 13:07:17 user nova-compute[75247]:         <nova:port uuid="49d75e7e-b46c-4355-b93d-70c0abfdfacf">
Dec 06 13:07:17 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 06 13:07:17 user nova-compute[75247]:         </nova:port>
Dec 06 13:07:17 user nova-compute[75247]:       </nova:ports>
Dec 06 13:07:17 user nova-compute[75247]:     </nova:instance>
Dec 06 13:07:17 user nova-compute[75247]:   </metadata>
Dec 06 13:07:17 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 13:07:17 user nova-compute[75247]:     <system>
Dec 06 13:07:17 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 13:07:17 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 13:07:17 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 13:07:17 user nova-compute[75247]:       <entry name="serial">43522b23-79ba-457d-8a83-0c38b5dadf50</entry>
Dec 06 13:07:17 user nova-compute[75247]:       <entry name="uuid">43522b23-79ba-457d-8a83-0c38b5dadf50</entry>
Dec 06 13:07:17 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 13:07:17 user nova-compute[75247]:     </system>
Dec 06 13:07:17 user nova-compute[75247]:   </sysinfo>
Dec 06 13:07:17 user nova-compute[75247]:   <os>
Dec 06 13:07:17 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 13:07:17 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 13:07:17 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 13:07:17 user nova-compute[75247]:   </os>
Dec 06 13:07:17 user nova-compute[75247]:   <features>
Dec 06 13:07:17 user nova-compute[75247]:     <acpi/>
Dec 06 13:07:17 user nova-compute[75247]:     <apic/>
Dec 06 13:07:17 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 13:07:17 user nova-compute[75247]:   </features>
Dec 06 13:07:17 user nova-compute[75247]:   <clock offset="utc">
Dec 06 13:07:17 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 13:07:17 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 13:07:17 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 13:07:17 user nova-compute[75247]:   </clock>
Dec 06 13:07:17 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 13:07:17 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 13:07:17 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 13:07:17 user nova-compute[75247]:   </cpu>
Dec 06 13:07:17 user nova-compute[75247]:   <devices>
Dec 06 13:07:17 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 13:07:17 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:07:17 user nova-compute[75247]:       <source dev="/dev/sdc"/>
Dec 06 13:07:17 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 13:07:17 user nova-compute[75247]:       <serial>564fe2b3-7387-4f97-9a5b-6b002f8edbfa</serial>
Dec 06 13:07:17 user nova-compute[75247]:     </disk>
Dec 06 13:07:17 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 13:07:17 user nova-compute[75247]:       <mac address="fa:16:3e:a0:50:03"/>
Dec 06 13:07:17 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:07:17 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 13:07:17 user nova-compute[75247]:       <target dev="tap49d75e7e-b4"/>
Dec 06 13:07:17 user nova-compute[75247]:     </interface>
Dec 06 13:07:17 user nova-compute[75247]:     <serial type="pty">
Dec 06 13:07:17 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/43522b23-79ba-457d-8a83-0c38b5dadf50/console.log" append="off"/>
Dec 06 13:07:17 user nova-compute[75247]:     </serial>
Dec 06 13:07:17 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 13:07:17 user nova-compute[75247]:     <video>
Dec 06 13:07:17 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:07:17 user nova-compute[75247]:     </video>
Dec 06 13:07:17 user nova-compute[75247]:     <rng model="virtio">
Dec 06 13:07:17 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 13:07:17 user nova-compute[75247]:     </rng>
Dec 06 13:07:17 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 13:07:17 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 13:07:17 user nova-compute[75247]:       <stats period="10"/>
Dec 06 13:07:17 user nova-compute[75247]:     </memballoon>
Dec 06 13:07:17 user nova-compute[75247]:   </devices>
Dec 06 13:07:17 user nova-compute[75247]: </domain>
Dec 06 13:07:17 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-127916433',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-127916433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-127916433',id=46,image_ref='7ed8c0b1-6988-4054-9f3b-4ee44526e6b3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDvxJ/7BqGOEUAj9pK1GDRuBMzkXwEcx7R9lVH/VUHNRJOZ/W5jdwC+P3kVAVWA/0RRorYTqx4sjwIG9kkQTRq2M5/HT7cmZPYTgRJvboHEPbcf7IKQm0OEH35xKBtGhg==',key_name='tempest-keypair-986723898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9493d9b0b1024cea9a550e2a42c1e6a1',ramdisk_id='',reservation_id='r-x4yl1j0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2088852773',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2088852773-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2088852773',owner_user_name='tempest-TestVolumeBootPattern-2088852773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016714f7502b4a8fa12ed0ce6644c5fc',uuid=43522b23-79ba-457d-8a83-0c38b5dadf50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49d75e7e-b46c-4355-b93d-70c0abfdfacf", "address": "fa:16:3e:a0:50:03", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49d75e7e-b4", "ovs_interfaceid": "49d75e7e-b46c-4355-b93d-70c0abfdfacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converting VIF {"id": "49d75e7e-b46c-4355-b93d-70c0abfdfacf", "address": "fa:16:3e:a0:50:03", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49d75e7e-b4", "ovs_interfaceid": "49d75e7e-b46c-4355-b93d-70c0abfdfacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:50:03,bridge_name='br-int',has_traffic_filtering=True,id=49d75e7e-b46c-4355-b93d-70c0abfdfacf,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49d75e7e-b4') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG os_vif [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:50:03,bridge_name='br-int',has_traffic_filtering=True,id=49d75e7e-b46c-4355-b93d-70c0abfdfacf,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49d75e7e-b4') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd20307a-64d6-5c9b-88b1-b1d996f49d02', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49d75e7e-b4, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49d75e7e-b4, col_values=(('qos', UUID('c916a480-6585-47e3-a678-71b61a8492aa')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49d75e7e-b4, col_values=(('external_ids', {'iface-id': '49d75e7e-b46c-4355-b93d-70c0abfdfacf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:50:03', 'vm-uuid': '43522b23-79ba-457d-8a83-0c38b5dadf50'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:17 user nova-compute[75247]: INFO os_vif [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:50:03,bridge_name='br-int',has_traffic_filtering=True,id=49d75e7e-b46c-4355-b93d-70c0abfdfacf,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49d75e7e-b4')
Dec 06 13:07:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:07:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] No VIF found with MAC fa:16:3e:a0:50:03, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 13:07:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:19 user nova-compute[75247]: DEBUG nova.compute.manager [req-3103a329-7db1-4dbb-a82f-77bc01494e0e req-b32cf313-af9b-4484-b932-ed3d77ffee2f service nova] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Received event network-vif-plugged-49d75e7e-b46c-4355-b93d-70c0abfdfacf {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:07:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3103a329-7db1-4dbb-a82f-77bc01494e0e req-b32cf313-af9b-4484-b932-ed3d77ffee2f service nova] Acquiring lock "43522b23-79ba-457d-8a83-0c38b5dadf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:07:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3103a329-7db1-4dbb-a82f-77bc01494e0e req-b32cf313-af9b-4484-b932-ed3d77ffee2f service nova] Lock "43522b23-79ba-457d-8a83-0c38b5dadf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:07:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3103a329-7db1-4dbb-a82f-77bc01494e0e req-b32cf313-af9b-4484-b932-ed3d77ffee2f service nova] Lock "43522b23-79ba-457d-8a83-0c38b5dadf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:07:19 user nova-compute[75247]: DEBUG nova.compute.manager [req-3103a329-7db1-4dbb-a82f-77bc01494e0e req-b32cf313-af9b-4484-b932-ed3d77ffee2f service nova] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] No waiting events found dispatching network-vif-plugged-49d75e7e-b46c-4355-b93d-70c0abfdfacf {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:07:19 user nova-compute[75247]: WARNING nova.compute.manager [req-3103a329-7db1-4dbb-a82f-77bc01494e0e req-b32cf313-af9b-4484-b932-ed3d77ffee2f service nova] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Received unexpected event network-vif-plugged-49d75e7e-b46c-4355-b93d-70c0abfdfacf for instance with vm_state building and task_state spawning.
Dec 06 13:07:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:20 user nova-compute[75247]: DEBUG nova.compute.manager [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 13:07:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 13:07:20 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Instance spawned successfully.
Dec 06 13:07:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 13:07:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:07:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:07:21 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:07:21 user nova-compute[75247]: INFO nova.compute.manager [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Took 4.94 seconds to spawn the instance on the hypervisor.
Dec 06 13:07:21 user nova-compute[75247]: DEBUG nova.compute.manager [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 13:07:21 user nova-compute[75247]: INFO nova.compute.manager [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Took 27.90 seconds to build instance.
Dec 06 13:07:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-a86ac2aa-d83b-4c95-bd96-5fea8428cd7c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "43522b23-79ba-457d-8a83-0c38b5dadf50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.012s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:07:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "43522b23-79ba-457d-8a83-0c38b5dadf50" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 12.685s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:07:21 user nova-compute[75247]: INFO nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Dec 06 13:07:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "43522b23-79ba-457d-8a83-0c38b5dadf50" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:07:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-19bbed0c-7c8f-4fa6-972e-fc83dd59c5e4 req-3d7920af-2b88-4923-b4bb-5bcfee2db05c service nova] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Received event network-vif-plugged-49d75e7e-b46c-4355-b93d-70c0abfdfacf {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:07:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-19bbed0c-7c8f-4fa6-972e-fc83dd59c5e4 req-3d7920af-2b88-4923-b4bb-5bcfee2db05c service nova] Acquiring lock "43522b23-79ba-457d-8a83-0c38b5dadf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:07:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-19bbed0c-7c8f-4fa6-972e-fc83dd59c5e4 req-3d7920af-2b88-4923-b4bb-5bcfee2db05c service nova] Lock "43522b23-79ba-457d-8a83-0c38b5dadf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:07:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-19bbed0c-7c8f-4fa6-972e-fc83dd59c5e4 req-3d7920af-2b88-4923-b4bb-5bcfee2db05c service nova] Lock "43522b23-79ba-457d-8a83-0c38b5dadf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:07:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-19bbed0c-7c8f-4fa6-972e-fc83dd59c5e4 req-3d7920af-2b88-4923-b4bb-5bcfee2db05c service nova] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] No waiting events found dispatching network-vif-plugged-49d75e7e-b46c-4355-b93d-70c0abfdfacf {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:07:21 user nova-compute[75247]: WARNING nova.compute.manager [req-19bbed0c-7c8f-4fa6-972e-fc83dd59c5e4 req-3d7920af-2b88-4923-b4bb-5bcfee2db05c service nova] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Received unexpected event network-vif-plugged-49d75e7e-b46c-4355-b93d-70c0abfdfacf for instance with vm_state active and task_state None.
Dec 06 13:07:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:22 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:07:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:24 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:07:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "2b633bf8-609f-4d56-86f6-b96218435aa6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:07:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:07:25 user nova-compute[75247]: DEBUG nova.compute.manager [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 13:07:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:07:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:07:25 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 13:07:25 user nova-compute[75247]: INFO nova.compute.claims [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Claim successful on node user
Dec 06 13:07:25 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:07:25 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:07:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:07:25 user nova-compute[75247]: DEBUG nova.compute.manager [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 13:07:25 user nova-compute[75247]: DEBUG nova.compute.manager [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 13:07:25 user nova-compute[75247]: DEBUG nova.network.neutron [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 13:07:25 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 13:07:25 user nova-compute[75247]: DEBUG nova.compute.manager [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 13:07:25 user nova-compute[75247]: DEBUG nova.policy [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6e50e8cc91ca4ff88ebfa0b2888699d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f58adbd4d004a44b37a0e0922da5aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 13:07:26 user nova-compute[75247]: DEBUG nova.compute.manager [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 13:07:26 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 13:07:26 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Creating image(s)
Dec 06 13:07:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:07:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "/opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:07:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "/opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:07:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:07:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.206s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:07:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:07:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:07:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:07:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.194s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:07:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:07:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk 1073741824" returned: 0 in 0.056s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:07:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:07:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:07:26 user nova-compute[75247]: DEBUG nova.network.neutron [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Successfully created port: 36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 13:07:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.206s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:07:26 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 13:07:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:07:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:07:27 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Cannot resize image /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 13:07:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 13:07:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Ensure instance console log exists: /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 13:07:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:07:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:07:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:07:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:27 user nova-compute[75247]: DEBUG nova.network.neutron [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Successfully updated port: 36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 13:07:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:07:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquired lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:07:27 user nova-compute[75247]: DEBUG nova.network.neutron [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 13:07:27 user nova-compute[75247]: DEBUG nova.compute.manager [req-2e638914-2c79-4325-aa7c-27deda739434 req-ca07c658-3e68-43f1-bf1a-9f71ba5f2dfc service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Received event network-changed-36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:07:27 user nova-compute[75247]: DEBUG nova.compute.manager [req-2e638914-2c79-4325-aa7c-27deda739434 req-ca07c658-3e68-43f1-bf1a-9f71ba5f2dfc service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Refreshing instance network info cache due to event network-changed-36c5fc9a-1100-48de-80da-1188909df5e5. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:07:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2e638914-2c79-4325-aa7c-27deda739434 req-ca07c658-3e68-43f1-bf1a-9f71ba5f2dfc service nova] Acquiring lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:07:27 user nova-compute[75247]: DEBUG nova.network.neutron [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 13:07:27 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:07:27 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.network.neutron [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Updating instance_info_cache with network_info: [{"id": "36c5fc9a-1100-48de-80da-1188909df5e5", "address": "fa:16:3e:91:16:cf", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c5fc9a-11", "ovs_interfaceid": "36c5fc9a-1100-48de-80da-1188909df5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Releasing lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.compute.manager [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Instance network_info: |[{"id": "36c5fc9a-1100-48de-80da-1188909df5e5", "address": "fa:16:3e:91:16:cf", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c5fc9a-11", "ovs_interfaceid": "36c5fc9a-1100-48de-80da-1188909df5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2e638914-2c79-4325-aa7c-27deda739434 req-ca07c658-3e68-43f1-bf1a-9f71ba5f2dfc service nova] Acquired lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.network.neutron [req-2e638914-2c79-4325-aa7c-27deda739434 req-ca07c658-3e68-43f1-bf1a-9f71ba5f2dfc service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Refreshing network info cache for port 36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Start _get_guest_xml network_info=[{"id": "36c5fc9a-1100-48de-80da-1188909df5e5", "address": "fa:16:3e:91:16:cf", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c5fc9a-11", "ovs_interfaceid": "36c5fc9a-1100-48de-80da-1188909df5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 13:07:28 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:07:28 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:07:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1297482927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1297482927',id=47,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyfR84sYYIKmhk4Xel3+j5rZsBbDKhCIiuYagt2qk40+BPHAmsKSDMcOj86qj+sr16q3+XUviT2i8cP6TUSl4JNHIGJV60uIaSE11sWyCXuwMNXrH6f02pqMjSsty00Ug==',key_name='tempest-keypair-1683071845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f58adbd4d004a44b37a0e0922da5aa3',ramdisk_id='',reservation_id='r-lcgwlr3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2058750591',owner_user_name='tempest-AttachVolumeShelveTestJSON-2058750591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:07:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e50e8cc91ca4ff88ebfa0b2888699d5',uuid=2b633bf8-609f-4d56-86f6-b96218435aa6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36c5fc9a-1100-48de-80da-1188909df5e5", "address": "fa:16:3e:91:16:cf", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c5fc9a-11", "ovs_interfaceid": "36c5fc9a-1100-48de-80da-1188909df5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Converting VIF {"id": "36c5fc9a-1100-48de-80da-1188909df5e5", "address": "fa:16:3e:91:16:cf", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c5fc9a-11", "ovs_interfaceid": "36c5fc9a-1100-48de-80da-1188909df5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:16:cf,bridge_name='br-int',has_traffic_filtering=True,id=36c5fc9a-1100-48de-80da-1188909df5e5,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c5fc9a-11') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.objects.instance [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b633bf8-609f-4d56-86f6-b96218435aa6 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] End _get_guest_xml xml=<domain type="kvm">
Dec 06 13:07:28 user nova-compute[75247]:   <uuid>2b633bf8-609f-4d56-86f6-b96218435aa6</uuid>
Dec 06 13:07:28 user nova-compute[75247]:   <name>instance-0000002f</name>
Dec 06 13:07:28 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 13:07:28 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 13:07:28 user nova-compute[75247]:   <metadata>
Dec 06 13:07:28 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 13:07:28 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 13:07:28 user nova-compute[75247]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1297482927</nova:name>
Dec 06 13:07:28 user nova-compute[75247]:       <nova:creationTime>2023-12-06 13:07:28</nova:creationTime>
Dec 06 13:07:28 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 13:07:28 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 13:07:28 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 13:07:28 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 13:07:28 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 13:07:28 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 13:07:28 user nova-compute[75247]:       </nova:flavor>
Dec 06 13:07:28 user nova-compute[75247]:       <nova:owner>
Dec 06 13:07:28 user nova-compute[75247]:         <nova:user uuid="6e50e8cc91ca4ff88ebfa0b2888699d5">tempest-AttachVolumeShelveTestJSON-2058750591-project-member</nova:user>
Dec 06 13:07:28 user nova-compute[75247]:         <nova:project uuid="9f58adbd4d004a44b37a0e0922da5aa3">tempest-AttachVolumeShelveTestJSON-2058750591</nova:project>
Dec 06 13:07:28 user nova-compute[75247]:       </nova:owner>
Dec 06 13:07:28 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 13:07:28 user nova-compute[75247]:       <nova:ports>
Dec 06 13:07:28 user nova-compute[75247]:         <nova:port uuid="36c5fc9a-1100-48de-80da-1188909df5e5">
Dec 06 13:07:28 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 06 13:07:28 user nova-compute[75247]:         </nova:port>
Dec 06 13:07:28 user nova-compute[75247]:       </nova:ports>
Dec 06 13:07:28 user nova-compute[75247]:     </nova:instance>
Dec 06 13:07:28 user nova-compute[75247]:   </metadata>
Dec 06 13:07:28 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 13:07:28 user nova-compute[75247]:     <system>
Dec 06 13:07:28 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 13:07:28 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 13:07:28 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 13:07:28 user nova-compute[75247]:       <entry name="serial">2b633bf8-609f-4d56-86f6-b96218435aa6</entry>
Dec 06 13:07:28 user nova-compute[75247]:       <entry name="uuid">2b633bf8-609f-4d56-86f6-b96218435aa6</entry>
Dec 06 13:07:28 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 13:07:28 user nova-compute[75247]:     </system>
Dec 06 13:07:28 user nova-compute[75247]:   </sysinfo>
Dec 06 13:07:28 user nova-compute[75247]:   <os>
Dec 06 13:07:28 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 13:07:28 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 13:07:28 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 13:07:28 user nova-compute[75247]:   </os>
Dec 06 13:07:28 user nova-compute[75247]:   <features>
Dec 06 13:07:28 user nova-compute[75247]:     <acpi/>
Dec 06 13:07:28 user nova-compute[75247]:     <apic/>
Dec 06 13:07:28 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 13:07:28 user nova-compute[75247]:   </features>
Dec 06 13:07:28 user nova-compute[75247]:   <clock offset="utc">
Dec 06 13:07:28 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 13:07:28 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 13:07:28 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 13:07:28 user nova-compute[75247]:   </clock>
Dec 06 13:07:28 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 13:07:28 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 13:07:28 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 13:07:28 user nova-compute[75247]:   </cpu>
Dec 06 13:07:28 user nova-compute[75247]:   <devices>
Dec 06 13:07:28 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 13:07:28 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 13:07:28 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk"/>
Dec 06 13:07:28 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 13:07:28 user nova-compute[75247]:     </disk>
Dec 06 13:07:28 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 13:07:28 user nova-compute[75247]:       <mac address="fa:16:3e:91:16:cf"/>
Dec 06 13:07:28 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:07:28 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 13:07:28 user nova-compute[75247]:       <target dev="tap36c5fc9a-11"/>
Dec 06 13:07:28 user nova-compute[75247]:     </interface>
Dec 06 13:07:28 user nova-compute[75247]:     <serial type="pty">
Dec 06 13:07:28 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/console.log" append="off"/>
Dec 06 13:07:28 user nova-compute[75247]:     </serial>
Dec 06 13:07:28 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 13:07:28 user nova-compute[75247]:     <video>
Dec 06 13:07:28 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:07:28 user nova-compute[75247]:     </video>
Dec 06 13:07:28 user nova-compute[75247]:     <rng model="virtio">
Dec 06 13:07:28 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 13:07:28 user nova-compute[75247]:     </rng>
Dec 06 13:07:28 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 13:07:28 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 13:07:28 user nova-compute[75247]:       <stats period="10"/>
Dec 06 13:07:28 user nova-compute[75247]:     </memballoon>
Dec 06 13:07:28 user nova-compute[75247]:   </devices>
Dec 06 13:07:28 user nova-compute[75247]: </domain>
Dec 06 13:07:28 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:07:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1297482927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1297482927',id=47,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyfR84sYYIKmhk4Xel3+j5rZsBbDKhCIiuYagt2qk40+BPHAmsKSDMcOj86qj+sr16q3+XUviT2i8cP6TUSl4JNHIGJV60uIaSE11sWyCXuwMNXrH6f02pqMjSsty00Ug==',key_name='tempest-keypair-1683071845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f58adbd4d004a44b37a0e0922da5aa3',ramdisk_id='',reservation_id='r-lcgwlr3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2058750591',owner_user_name='tempest-AttachVolumeShelveTestJSON-2058750591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:07:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e50e8cc91ca4ff88ebfa0b2888699d5',uuid=2b633bf8-609f-4d56-86f6-b96218435aa6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36c5fc9a-1100-48de-80da-1188909df5e5", "address": "fa:16:3e:91:16:cf", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c5fc9a-11", "ovs_interfaceid": "36c5fc9a-1100-48de-80da-1188909df5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Converting VIF {"id": "36c5fc9a-1100-48de-80da-1188909df5e5", "address": "fa:16:3e:91:16:cf", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c5fc9a-11", "ovs_interfaceid": "36c5fc9a-1100-48de-80da-1188909df5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:16:cf,bridge_name='br-int',has_traffic_filtering=True,id=36c5fc9a-1100-48de-80da-1188909df5e5,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c5fc9a-11') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG os_vif [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:16:cf,bridge_name='br-int',has_traffic_filtering=True,id=36c5fc9a-1100-48de-80da-1188909df5e5,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c5fc9a-11') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4af5a21-e4d6-56fe-afaf-a9a9120bade8', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36c5fc9a-11, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36c5fc9a-11, col_values=(('qos', UUID('29a64c10-01bd-493e-9e49-14f0d26c3a2f')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36c5fc9a-11, col_values=(('external_ids', {'iface-id': '36c5fc9a-1100-48de-80da-1188909df5e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:16:cf', 'vm-uuid': '2b633bf8-609f-4d56-86f6-b96218435aa6'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:28 user nova-compute[75247]: INFO os_vif [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:16:cf,bridge_name='br-int',has_traffic_filtering=True,id=36c5fc9a-1100-48de-80da-1188909df5e5,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c5fc9a-11')
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] No VIF found with MAC fa:16:3e:91:16:cf, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.network.neutron [req-2e638914-2c79-4325-aa7c-27deda739434 req-ca07c658-3e68-43f1-bf1a-9f71ba5f2dfc service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Updated VIF entry in instance network info cache for port 36c5fc9a-1100-48de-80da-1188909df5e5. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.network.neutron [req-2e638914-2c79-4325-aa7c-27deda739434 req-ca07c658-3e68-43f1-bf1a-9f71ba5f2dfc service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Updating instance_info_cache with network_info: [{"id": "36c5fc9a-1100-48de-80da-1188909df5e5", "address": "fa:16:3e:91:16:cf", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c5fc9a-11", "ovs_interfaceid": "36c5fc9a-1100-48de-80da-1188909df5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2e638914-2c79-4325-aa7c-27deda739434 req-ca07c658-3e68-43f1-bf1a-9f71ba5f2dfc service nova] Releasing lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:07:28 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:07:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:29 user nova-compute[75247]: DEBUG nova.compute.manager [req-12a82211-7578-4c30-b834-cd296a5ae288 req-dffbf76d-f2ba-488f-993a-97953553b5ea service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Received event network-vif-plugged-36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:07:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-12a82211-7578-4c30-b834-cd296a5ae288 req-dffbf76d-f2ba-488f-993a-97953553b5ea service nova] Acquiring lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:07:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-12a82211-7578-4c30-b834-cd296a5ae288 req-dffbf76d-f2ba-488f-993a-97953553b5ea service nova] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:07:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-12a82211-7578-4c30-b834-cd296a5ae288 req-dffbf76d-f2ba-488f-993a-97953553b5ea service nova] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:07:29 user nova-compute[75247]: DEBUG nova.compute.manager [req-12a82211-7578-4c30-b834-cd296a5ae288 req-dffbf76d-f2ba-488f-993a-97953553b5ea service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] No waiting events found dispatching network-vif-plugged-36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:07:29 user nova-compute[75247]: WARNING nova.compute.manager [req-12a82211-7578-4c30-b834-cd296a5ae288 req-dffbf76d-f2ba-488f-993a-97953553b5ea service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Received unexpected event network-vif-plugged-36c5fc9a-1100-48de-80da-1188909df5e5 for instance with vm_state building and task_state spawning.
Dec 06 13:07:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:31 user nova-compute[75247]: DEBUG nova.compute.manager [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 13:07:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 13:07:31 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Instance spawned successfully.
Dec 06 13:07:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 13:07:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:07:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:07:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:07:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:07:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:07:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:07:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:07:32 user nova-compute[75247]: INFO nova.compute.manager [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Took 6.04 seconds to spawn the instance on the hypervisor.
Dec 06 13:07:32 user nova-compute[75247]: DEBUG nova.compute.manager [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 13:07:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-8f4cce1a-1389-4c2d-b835-132cb6d7d2d6 req-99d565e6-d8e8-4d7c-beda-b87dc845b9fd service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Received event network-vif-plugged-36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:07:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-8f4cce1a-1389-4c2d-b835-132cb6d7d2d6 req-99d565e6-d8e8-4d7c-beda-b87dc845b9fd service nova] Acquiring lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:07:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-8f4cce1a-1389-4c2d-b835-132cb6d7d2d6 req-99d565e6-d8e8-4d7c-beda-b87dc845b9fd service nova] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:07:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-8f4cce1a-1389-4c2d-b835-132cb6d7d2d6 req-99d565e6-d8e8-4d7c-beda-b87dc845b9fd service nova] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:07:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-8f4cce1a-1389-4c2d-b835-132cb6d7d2d6 req-99d565e6-d8e8-4d7c-beda-b87dc845b9fd service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] No waiting events found dispatching network-vif-plugged-36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:07:32 user nova-compute[75247]: WARNING nova.compute.manager [req-8f4cce1a-1389-4c2d-b835-132cb6d7d2d6 req-99d565e6-d8e8-4d7c-beda-b87dc845b9fd service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Received unexpected event network-vif-plugged-36c5fc9a-1100-48de-80da-1188909df5e5 for instance with vm_state building and task_state spawning.
Dec 06 13:07:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:07:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:07:32 user nova-compute[75247]: INFO nova.compute.manager [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Took 6.87 seconds to build instance.
Dec 06 13:07:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-57cec139-0b61-41b6-a875-cac38c2b71dd tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.019s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:07:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:07:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:07:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:07:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:07:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:07:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:07:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:07:33 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:07:33 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:07:33 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=8539MB free_disk=25.139892578125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:07:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:07:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:07:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:33 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 3e98845f-ad13-4240-beca-c3f70ef26f9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:07:33 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 8c836066-63ff-47ea-b3c7-f183abb5077a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:07:33 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 43522b23-79ba-457d-8a83-0c38b5dadf50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:07:33 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 2b633bf8-609f-4d56-86f6-b96218435aa6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:07:33 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:07:33 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:07:33 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:07:33 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:07:33 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:07:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.299s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:07:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:35 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:07:35 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:07:35 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 13:07:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-3e98845f-ad13-4240-beca-c3f70ef26f9e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:07:35 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-3e98845f-ad13-4240-beca-c3f70ef26f9e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:07:35 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 13:07:35 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lazy-loading 'info_cache' on Instance uuid 3e98845f-ad13-4240-beca-c3f70ef26f9e {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:07:36 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Updating instance_info_cache with network_info: [{"id": "8c291771-553f-41be-9bc1-e97d6dfb1cdd", "address": "fa:16:3e:e7:fd:e8", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c291771-55", "ovs_interfaceid": "8c291771-553f-41be-9bc1-e97d6dfb1cdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:07:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-3e98845f-ad13-4240-beca-c3f70ef26f9e" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:07:36 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 13:07:36 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:07:36 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:07:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:07:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:08:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:08:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:08:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:08:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:08:20 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:08:22 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:08:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:08:24 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:08:24 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:08:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:08:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:08:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:08:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:08:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:08:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:08:28 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:08:28 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:08:29 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:08:30 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:08:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:08:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:08:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:08:31 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:08:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:08:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:08:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:31 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:32 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:08:32 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:08:32 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=8596MB free_disk=25.11050796508789GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:08:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:08:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:08:32 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 3e98845f-ad13-4240-beca-c3f70ef26f9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:08:32 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 8c836066-63ff-47ea-b3c7-f183abb5077a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:08:32 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 43522b23-79ba-457d-8a83-0c38b5dadf50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:08:32 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 2b633bf8-609f-4d56-86f6-b96218435aa6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:08:32 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:08:32 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:08:32 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:08:32 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:08:32 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:08:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:08:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:08:33 user nova-compute[75247]: DEBUG nova.compute.manager [req-2abb2f83-3742-4180-aff0-f881ecba2289 req-0e099872-690e-40e9-85c6-ccf693cd43eb service nova] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Received event network-changed-449c3ded-5da6-4274-83bc-0014aed78ec4 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:08:33 user nova-compute[75247]: DEBUG nova.compute.manager [req-2abb2f83-3742-4180-aff0-f881ecba2289 req-0e099872-690e-40e9-85c6-ccf693cd43eb service nova] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Refreshing instance network info cache due to event network-changed-449c3ded-5da6-4274-83bc-0014aed78ec4. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:08:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2abb2f83-3742-4180-aff0-f881ecba2289 req-0e099872-690e-40e9-85c6-ccf693cd43eb service nova] Acquiring lock "refresh_cache-8c836066-63ff-47ea-b3c7-f183abb5077a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:08:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2abb2f83-3742-4180-aff0-f881ecba2289 req-0e099872-690e-40e9-85c6-ccf693cd43eb service nova] Acquired lock "refresh_cache-8c836066-63ff-47ea-b3c7-f183abb5077a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:08:33 user nova-compute[75247]: DEBUG nova.network.neutron [req-2abb2f83-3742-4180-aff0-f881ecba2289 req-0e099872-690e-40e9-85c6-ccf693cd43eb service nova] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Refreshing network info cache for port 449c3ded-5da6-4274-83bc-0014aed78ec4 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:08:33 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:08:33 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:08:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-8c836066-63ff-47ea-b3c7-f183abb5077a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:08:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Acquiring lock "8c836066-63ff-47ea-b3c7-f183abb5077a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:08:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:08:33 user nova-compute[75247]: DEBUG nova.objects.instance [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lazy-loading 'flavor' on Instance uuid 8c836066-63ff-47ea-b3c7-f183abb5077a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:08:33 user nova-compute[75247]: DEBUG nova.network.neutron [req-2abb2f83-3742-4180-aff0-f881ecba2289 req-0e099872-690e-40e9-85c6-ccf693cd43eb service nova] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Updated VIF entry in instance network info cache for port 449c3ded-5da6-4274-83bc-0014aed78ec4. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:08:33 user nova-compute[75247]: DEBUG nova.network.neutron [req-2abb2f83-3742-4180-aff0-f881ecba2289 req-0e099872-690e-40e9-85c6-ccf693cd43eb service nova] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Updating instance_info_cache with network_info: [{"id": "449c3ded-5da6-4274-83bc-0014aed78ec4", "address": "fa:16:3e:14:84:f0", "network": {"id": "21c71f39-1c81-456d-87df-d9b84a3f3f82", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-472433950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "266ddf79993c49c1825cd394ce5310ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449c3ded-5d", "ovs_interfaceid": "449c3ded-5da6-4274-83bc-0014aed78ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:08:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.136s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:08:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2abb2f83-3742-4180-aff0-f881ecba2289 req-0e099872-690e-40e9-85c6-ccf693cd43eb service nova] Releasing lock "refresh_cache-8c836066-63ff-47ea-b3c7-f183abb5077a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:08:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-8c836066-63ff-47ea-b3c7-f183abb5077a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:08:33 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Acquiring lock "8c836066-63ff-47ea-b3c7-f183abb5077a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:08:34 user nova-compute[75247]: INFO nova.compute.manager [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Attaching volume 6a01f9b0-4d95-4afb-8c80-d1161257c356 to /dev/vdb
Dec 06 13:08:34 user nova-compute[75247]: DEBUG os_brick.utils [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9665794b-74a2-409d-b99d-15b76e490a75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[460b9771-6d2a-46c4-9fb5-45138f0b2c35]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cd8ebd-02f0-4b87-9455-349e1687bbaf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aecfeb2-67c3-4ee0-a2cb-b0cd147d75c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:08:34 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 13:08:34 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2e9798-7bbc-4ced-83d3-f2ede6fadfd7]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG os_brick.utils [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Updating existing volume attachment record: 138d4844-44da-4700-8642-5a9ea84cf7e8 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Updating instance_info_cache with network_info: [{"id": "449c3ded-5da6-4274-83bc-0014aed78ec4", "address": "fa:16:3e:14:84:f0", "network": {"id": "21c71f39-1c81-456d-87df-d9b84a3f3f82", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-472433950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "266ddf79993c49c1825cd394ce5310ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449c3ded-5d", "ovs_interfaceid": "449c3ded-5da6-4274-83bc-0014aed78ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-8c836066-63ff-47ea-b3c7-f183abb5077a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:08:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:08:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:08:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHZKwkbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:08:43 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:08:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:08:43 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:08:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:08:43 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dd3637-1611-4b19-8ecf-9a575c978699]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 13:08:43 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b1333d-b0e9-4049-902c-afe0232fefe3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356] added
Dec 06 13:08:43 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe0f14d-129c-4134-8a30-b6c212dbbf56]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8645e30-b5be-4d75-b303-c49dae467385]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PHZKwkbJ {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PHZKwkbJ" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14b5631-d6f2-4d9a-9557-9c8a821f9b63]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PHZKwkbJ'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[561d9739-9b29-4652-b47b-6d7bfb1f8de7]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6dd0dd9-5522-41ac-a301-883da74ace76]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)
Dec 06 13:08:43 user nova-compute[75247]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa (non-flash)
Dec 06 13:08:43 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)
Dec 06 13:08:43 user nova-compute[75247]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa (non-flash)
Dec 06 13:08:43 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b471547-cb4c-45fc-8b64-8430a4462314]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356, portal: 172.16.0.220,3260]
Dec 06 13:08:43 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356, portal: 172.16.0.220,3260] successful.
Dec 06 13:08:43 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9938211-7cfe-4d0f-9d80-a4e4fd594d25]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a68ed3c-b2d4-4702-9e42-ea174bf3cd19]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)
Dec 06 13:08:43 user nova-compute[75247]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa (non-flash)
Dec 06 13:08:43 user nova-compute[75247]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 (non-flash)
Dec 06 13:08:43 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)
Dec 06 13:08:43 user nova-compute[75247]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa (non-flash)
Dec 06 13:08:43 user nova-compute[75247]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 (non-flash)
Dec 06 13:08:43 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] HCTL ('35', '-', '-', 0) found on session 56 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b48427-2516-444c-be67-2dff7fa3d7c7]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:43 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: None {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 13:08:44 user nova-compute[75247]: DEBUG nova.compute.manager [req-456b45b3-7e5b-491b-ae0a-200919e6f594 req-2e878216-5bc5-4bf7-b02b-00f795b9f91b service nova] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Received event network-changed-49d75e7e-b46c-4355-b93d-70c0abfdfacf {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:08:44 user nova-compute[75247]: DEBUG nova.compute.manager [req-456b45b3-7e5b-491b-ae0a-200919e6f594 req-2e878216-5bc5-4bf7-b02b-00f795b9f91b service nova] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Refreshing instance network info cache due to event network-changed-49d75e7e-b46c-4355-b93d-70c0abfdfacf. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:08:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-456b45b3-7e5b-491b-ae0a-200919e6f594 req-2e878216-5bc5-4bf7-b02b-00f795b9f91b service nova] Acquiring lock "refresh_cache-43522b23-79ba-457d-8a83-0c38b5dadf50" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:08:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-456b45b3-7e5b-491b-ae0a-200919e6f594 req-2e878216-5bc5-4bf7-b02b-00f795b9f91b service nova] Acquired lock "refresh_cache-43522b23-79ba-457d-8a83-0c38b5dadf50" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:08:44 user nova-compute[75247]: DEBUG nova.network.neutron [req-456b45b3-7e5b-491b-ae0a-200919e6f594 req-2e878216-5bc5-4bf7-b02b-00f795b9f91b service nova] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Refreshing network info cache for port 49d75e7e-b46c-4355-b93d-70c0abfdfacf {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:08:44 user nova-compute[75247]: DEBUG nova.network.neutron [req-456b45b3-7e5b-491b-ae0a-200919e6f594 req-2e878216-5bc5-4bf7-b02b-00f795b9f91b service nova] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Updated VIF entry in instance network info cache for port 49d75e7e-b46c-4355-b93d-70c0abfdfacf. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:08:44 user nova-compute[75247]: DEBUG nova.network.neutron [req-456b45b3-7e5b-491b-ae0a-200919e6f594 req-2e878216-5bc5-4bf7-b02b-00f795b9f91b service nova] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Updating instance_info_cache with network_info: [{"id": "49d75e7e-b46c-4355-b93d-70c0abfdfacf", "address": "fa:16:3e:a0:50:03", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49d75e7e-b4", "ovs_interfaceid": "49d75e7e-b46c-4355-b93d-70c0abfdfacf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:08:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-456b45b3-7e5b-491b-ae0a-200919e6f594 req-2e878216-5bc5-4bf7-b02b-00f795b9f91b service nova] Releasing lock "refresh_cache-43522b23-79ba-457d-8a83-0c38b5dadf50" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:08:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "43522b23-79ba-457d-8a83-0c38b5dadf50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:08:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "43522b23-79ba-457d-8a83-0c38b5dadf50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:08:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "43522b23-79ba-457d-8a83-0c38b5dadf50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:08:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "43522b23-79ba-457d-8a83-0c38b5dadf50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:08:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "43522b23-79ba-457d-8a83-0c38b5dadf50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:08:44 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 13:08:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHZKwkbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 13:08:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:08:44 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23836623433326264', 'path': '/dev/sdd'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:08:44 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836623433326264', 'path': '/dev/sdd'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 13:08:44 user nova-compute[75247]: INFO nova.compute.manager [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Terminating instance
Dec 06 13:08:44 user nova-compute[75247]: DEBUG nova.compute.manager [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 13:08:44 user nova-compute[75247]: DEBUG nova.objects.instance [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lazy-loading 'flavor' on Instance uuid 8c836066-63ff-47ea-b3c7-f183abb5077a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:08:44 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 13:08:44 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:08:44 user nova-compute[75247]:   <source dev="/dev/sdd"/>
Dec 06 13:08:44 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 13:08:44 user nova-compute[75247]:   <serial>6a01f9b0-4d95-4afb-8c80-d1161257c356</serial>
Dec 06 13:08:44 user nova-compute[75247]: </disk>
Dec 06 13:08:44 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 13:08:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:08:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:08:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG nova.compute.manager [req-35ded407-fc50-45fb-97e4-2b8fed498553 req-79acb97e-b04f-4726-b099-14f75dc177ee service nova] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Received event network-vif-unplugged-49d75e7e-b46c-4355-b93d-70c0abfdfacf {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-35ded407-fc50-45fb-97e4-2b8fed498553 req-79acb97e-b04f-4726-b099-14f75dc177ee service nova] Acquiring lock "43522b23-79ba-457d-8a83-0c38b5dadf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-35ded407-fc50-45fb-97e4-2b8fed498553 req-79acb97e-b04f-4726-b099-14f75dc177ee service nova] Lock "43522b23-79ba-457d-8a83-0c38b5dadf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-35ded407-fc50-45fb-97e4-2b8fed498553 req-79acb97e-b04f-4726-b099-14f75dc177ee service nova] Lock "43522b23-79ba-457d-8a83-0c38b5dadf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG nova.compute.manager [req-35ded407-fc50-45fb-97e4-2b8fed498553 req-79acb97e-b04f-4726-b099-14f75dc177ee service nova] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] No waiting events found dispatching network-vif-unplugged-49d75e7e-b46c-4355-b93d-70c0abfdfacf {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG nova.compute.manager [req-35ded407-fc50-45fb-97e4-2b8fed498553 req-79acb97e-b04f-4726-b099-14f75dc177ee service nova] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Received event network-vif-unplugged-49d75e7e-b46c-4355-b93d-70c0abfdfacf for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] No VIF found with MAC fa:16:3e:14:84:f0, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-05e5dff7-4a13-42d3-b4f2-3bf345cb7161 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.290s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:08:45 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Instance destroyed successfully.
Dec 06 13:08:45 user nova-compute[75247]: DEBUG nova.objects.instance [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lazy-loading 'resources' on Instance uuid 43522b23-79ba-457d-8a83-0c38b5dadf50 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-127916433',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-127916433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-127916433',id=46,image_ref='7ed8c0b1-6988-4054-9f3b-4ee44526e6b3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDvxJ/7BqGOEUAj9pK1GDRuBMzkXwEcx7R9lVH/VUHNRJOZ/W5jdwC+P3kVAVWA/0RRorYTqx4sjwIG9kkQTRq2M5/HT7cmZPYTgRJvboHEPbcf7IKQm0OEH35xKBtGhg==',key_name='tempest-keypair-986723898',keypairs=<?>,launch_index=0,launched_at=2023-12-06T13:07:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9493d9b0b1024cea9a550e2a42c1e6a1',ramdisk_id='',reservation_id='r-x4yl1j0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2088852773',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2088852773-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2088852773',owner_user_name='tempest-TestVolumeBootPattern-2088852773-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T13:07:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016714f7502b4a8fa12ed0ce6644c5fc',uuid=43522b23-79ba-457d-8a83-0c38b5dadf50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49d75e7e-b46c-4355-b93d-70c0abfdfacf", "address": "fa:16:3e:a0:50:03", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49d75e7e-b4", "ovs_interfaceid": "49d75e7e-b46c-4355-b93d-70c0abfdfacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converting VIF {"id": "49d75e7e-b46c-4355-b93d-70c0abfdfacf", "address": "fa:16:3e:a0:50:03", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49d75e7e-b4", "ovs_interfaceid": "49d75e7e-b46c-4355-b93d-70c0abfdfacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:50:03,bridge_name='br-int',has_traffic_filtering=True,id=49d75e7e-b46c-4355-b93d-70c0abfdfacf,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49d75e7e-b4') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG os_vif [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:50:03,bridge_name='br-int',has_traffic_filtering=True,id=49d75e7e-b46c-4355-b93d-70c0abfdfacf,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49d75e7e-b4') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49d75e7e-b4, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c916a480-6585-47e3-a678-71b61a8492aa) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:08:45 user nova-compute[75247]: INFO os_vif [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:50:03,bridge_name='br-int',has_traffic_filtering=True,id=49d75e7e-b46c-4355-b93d-70c0abfdfacf,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49d75e7e-b4')
Dec 06 13:08:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SGoPXusi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:08:45 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:08:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e0cf93-506b-4725-bd24-f28a26abded1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 13:08:45 user nova-compute[75247]: No targets found.
Dec 06 13:08:45 user nova-compute[75247]: iSNS:
Dec 06 13:08:45 user nova-compute[75247]: No targets found.
Dec 06 13:08:45 user nova-compute[75247]: STATIC:
Dec 06 13:08:45 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13
Dec 06 13:08:45 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:08:45 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:08:45 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356
Dec 06 13:08:45 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:08:45 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:08:45 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa
Dec 06 13:08:45 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:08:45 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:08:45 user nova-compute[75247]: FIRMWARE:
Dec 06 13:08:45 user nova-compute[75247]: No targets found.
Dec 06 13:08:45 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 13:08:45 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 13:08:45 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ba22f9-8429-495c-b8b9-ddcb75188002]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bbcb64-c26a-4b34-8c3a-31f2e33e340a]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)
Dec 06 13:08:45 user nova-compute[75247]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa (non-flash)
Dec 06 13:08:45 user nova-compute[75247]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 (non-flash)
Dec 06 13:08:45 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)
Dec 06 13:08:45 user nova-compute[75247]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa (non-flash)
Dec 06 13:08:45 user nova-compute[75247]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 (non-flash)
Dec 06 13:08:45 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c408550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa'): ({'sdc'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Removing single pathed devices sdc {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ee361d-f240-4204-aadc-dd10e1d736c4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab63fc6b-b81c-4005-9bf9-b0f9d5f024c8]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Flushing IO for device /dev/sdc {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[53db225f-8fb5-4628-b4fd-3c43960bfd19]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7f5e02-beec-41ad-8f97-8afdafd2bede]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] SCSI volumes sdc have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_5c7b5a25', '/dev/disk/by-id/scsi-26561323537653739', '/dev/disk/by-id/scsi-1SCST_BIO5c7b5a25-ea257e791b23df85') {{(pid=86354) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff51880-60bd-4ba1-b5da-555007deda56]: (4, None) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e884f24-ab2d-4348-bb9c-a266e90a1eec]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd78143-d43d-4362-9d34-8fea53f8484d]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa, portal: 172.16.0.220,3260]
Dec 06 13:08:45 user nova-compute[75247]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa, portal: 172.16.0.220,3260] successful.
Dec 06 13:08:45 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564fe2b3-7387-4f97-9a5b-6b002f8edbfa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b0355e-6879-4e26-9c6f-8467c7b164a4]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] <== disconnect_volume: return (306ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:08:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 13:08:45 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Deleting instance files /opt/stack/data/nova/instances/43522b23-79ba-457d-8a83-0c38b5dadf50_del
Dec 06 13:08:45 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Deletion of /opt/stack/data/nova/instances/43522b23-79ba-457d-8a83-0c38b5dadf50_del complete
Dec 06 13:08:46 user nova-compute[75247]: INFO nova.compute.manager [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Took 1.23 seconds to destroy the instance on the hypervisor.
Dec 06 13:08:46 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 13:08:46 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 13:08:46 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 13:08:46 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:08:46 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Took 0.70 seconds to deallocate network for instance.
Dec 06 13:08:46 user nova-compute[75247]: DEBUG nova.compute.manager [req-b09a7414-613f-498e-9229-3b434d9ba54e req-e8f11c6f-8781-483e-b286-284abbf69394 service nova] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Received event network-vif-deleted-49d75e7e-b46c-4355-b93d-70c0abfdfacf {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:08:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-fc5e29e6-9319-4e0f-bb91-4aced7c1e338 req-aeea63ec-3b14-4381-adc2-0f27dfdf6d4a service nova] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Received event network-vif-plugged-49d75e7e-b46c-4355-b93d-70c0abfdfacf {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:08:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fc5e29e6-9319-4e0f-bb91-4aced7c1e338 req-aeea63ec-3b14-4381-adc2-0f27dfdf6d4a service nova] Acquiring lock "43522b23-79ba-457d-8a83-0c38b5dadf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:08:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fc5e29e6-9319-4e0f-bb91-4aced7c1e338 req-aeea63ec-3b14-4381-adc2-0f27dfdf6d4a service nova] Lock "43522b23-79ba-457d-8a83-0c38b5dadf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:08:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-fc5e29e6-9319-4e0f-bb91-4aced7c1e338 req-aeea63ec-3b14-4381-adc2-0f27dfdf6d4a service nova] Lock "43522b23-79ba-457d-8a83-0c38b5dadf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:08:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-fc5e29e6-9319-4e0f-bb91-4aced7c1e338 req-aeea63ec-3b14-4381-adc2-0f27dfdf6d4a service nova] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] No waiting events found dispatching network-vif-plugged-49d75e7e-b46c-4355-b93d-70c0abfdfacf {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:08:47 user nova-compute[75247]: WARNING nova.compute.manager [req-fc5e29e6-9319-4e0f-bb91-4aced7c1e338 req-aeea63ec-3b14-4381-adc2-0f27dfdf6d4a service nova] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Received unexpected event network-vif-plugged-49d75e7e-b46c-4355-b93d-70c0abfdfacf for instance with vm_state active and task_state deleting.
Dec 06 13:08:47 user nova-compute[75247]: INFO nova.compute.manager [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Took 0.89 seconds to detach 1 volumes for instance.
Dec 06 13:08:47 user nova-compute[75247]: DEBUG nova.compute.manager [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 43522b23-79ba-457d-8a83-0c38b5dadf50] Deleting volume: 564fe2b3-7387-4f97-9a5b-6b002f8edbfa {{(pid=75247) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 06 13:08:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:08:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:08:47 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:08:47 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:08:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.243s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:08:48 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Deleted allocations for instance 43522b23-79ba-457d-8a83-0c38b5dadf50
Dec 06 13:08:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-03cf3620-3d1d-41b1-83e6-91fb79f9d889 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "43522b23-79ba-457d-8a83-0c38b5dadf50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.352s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:08:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Acquiring lock "8c836066-63ff-47ea-b3c7-f183abb5077a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:08:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:08:48 user nova-compute[75247]: DEBUG nova.objects.instance [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lazy-loading 'flavor' on Instance uuid 8c836066-63ff-47ea-b3c7-f183abb5077a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:08:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:08:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Acquiring lock "8c836066-63ff-47ea-b3c7-f183abb5077a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:08:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:08:48 user nova-compute[75247]: INFO nova.compute.manager [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Attaching volume 584f746e-8d51-43ba-a1f7-23185425c29d to /dev/vdc
Dec 06 13:08:48 user nova-compute[75247]: DEBUG os_brick.utils [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:08:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:48 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b82557e-7387-4da7-8a61-52bb7b1a3a27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:48 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6895e70e-d724-4059-b56c-c9ae85d5ad13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:48 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b36f452-133c-4387-80d8-c0ce6581ea66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:48 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a332e21-0c6a-4e14-a1df-ff5dadd91d80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:08:48 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 13:08:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:48 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:08:48 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 13:08:48 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[284b35c8-dfe7-41f5-9b6a-afd161c77d9f]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:48 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 13:08:48 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 13:08:48 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 13:08:48 user nova-compute[75247]: DEBUG os_brick.utils [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:08:48 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Updating existing volume attachment record: b9d8f8e4-e306-451c-8696-463a47a903c2 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 13:08:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:08:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:08:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dTjKqbra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:08:58 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:08:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:08:58 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:08:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:08:58 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[78dda152-2e0b-4feb-a47b-8f01f9acb091]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 13:08:58 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e8a2f1-d307-4006-805d-13d1deb2a6d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d] added
Dec 06 13:08:58 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5bc5da-bbc5-400b-9993-7d94e7345f5e]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2023875f-3c9b-4c6f-89b7-9ab511a73143]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dTjKqbra {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dTjKqbra" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc13b7b7-abfb-4064-943a-55a067872b9e]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dTjKqbra'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0036fd0-4827-4905-bda8-3ddf46949ecd]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4b3503-1d5e-40b3-b7d8-84c8fa55e0dd]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)
Dec 06 13:08:58 user nova-compute[75247]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 (non-flash)
Dec 06 13:08:58 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)
Dec 06 13:08:58 user nova-compute[75247]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 (non-flash)
Dec 06 13:08:58 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c007a7-7608-44b5-8b33-6b6ea7e38d1d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d, portal: 172.16.0.220,3260]
Dec 06 13:08:58 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d, portal: 172.16.0.220,3260] successful.
Dec 06 13:08:58 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde00e58-58eb-40b7-a196-07675d9876c3]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b6259f-fc10-459f-9ba3-1c6527d457b8]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)
Dec 06 13:08:58 user nova-compute[75247]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 (non-flash)
Dec 06 13:08:58 user nova-compute[75247]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d (non-flash)
Dec 06 13:08:58 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)
Dec 06 13:08:58 user nova-compute[75247]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 (non-flash)
Dec 06 13:08:58 user nova-compute[75247]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d (non-flash)
Dec 06 13:08:58 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f139eb1-2f3f-4678-8ccf-4fdae05b9e79]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 13:08:58 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dTjKqbra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 13:08:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:08:59 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26235366234376231', 'path': '/dev/sdc'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:08:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235366234376231', 'path': '/dev/sdc'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 13:08:59 user nova-compute[75247]: DEBUG nova.objects.instance [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lazy-loading 'flavor' on Instance uuid 8c836066-63ff-47ea-b3c7-f183abb5077a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:08:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 13:08:59 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:08:59 user nova-compute[75247]:   <source dev="/dev/sdc"/>
Dec 06 13:08:59 user nova-compute[75247]:   <target dev="vdc" bus="virtio"/>
Dec 06 13:08:59 user nova-compute[75247]:   <serial>584f746e-8d51-43ba-a1f7-23185425c29d</serial>
Dec 06 13:08:59 user nova-compute[75247]: </disk>
Dec 06 13:08:59 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 13:09:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:09:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:09:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:09:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] No VIF found with MAC fa:16:3e:14:84:f0, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 13:09:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-78d87f69-4e9e-42bc-bcbd-a10a6f67d3c9 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.510s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:09:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:09:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Acquiring lock "8c836066-63ff-47ea-b3c7-f183abb5077a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:09:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:09:00 user nova-compute[75247]: INFO nova.compute.manager [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Detaching volume 584f746e-8d51-43ba-a1f7-23185425c29d
Dec 06 13:09:00 user nova-compute[75247]: INFO nova.virt.block_device [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Attempting to driver detach volume 584f746e-8d51-43ba-a1f7-23185425c29d from mountpoint /dev/vdc
Dec 06 13:09:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Attempting to detach device vdc from instance 8c836066-63ff-47ea-b3c7-f183abb5077a from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 13:09:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 13:09:00 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:09:00 user nova-compute[75247]:   <source dev="/dev/sdc"/>
Dec 06 13:09:00 user nova-compute[75247]:   <target dev="vdc" bus="virtio"/>
Dec 06 13:09:00 user nova-compute[75247]:   <serial>584f746e-8d51-43ba-a1f7-23185425c29d</serial>
Dec 06 13:09:00 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 06 13:09:00 user nova-compute[75247]: </disk>
Dec 06 13:09:00 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 13:09:00 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Successfully detached device vdc from instance 8c836066-63ff-47ea-b3c7-f183abb5077a from the persistent domain config.
Dec 06 13:09:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8c836066-63ff-47ea-b3c7-f183abb5077a from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 13:09:00 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 13:09:00 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:09:00 user nova-compute[75247]:   <source dev="/dev/sdc"/>
Dec 06 13:09:00 user nova-compute[75247]:   <target dev="vdc" bus="virtio"/>
Dec 06 13:09:00 user nova-compute[75247]:   <serial>584f746e-8d51-43ba-a1f7-23185425c29d</serial>
Dec 06 13:09:00 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 06 13:09:00 user nova-compute[75247]: </disk>
Dec 06 13:09:00 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 13:09:01 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8c836066-63ff-47ea-b3c7-f183abb5077a {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 13:09:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:16 user nova-compute[75247]: DEBUG nova.compute.manager [req-77ef764a-2c7a-44a2-8fcf-81ed4cf5a1b6 req-1fe8148a-a905-4598-aed9-c3138e507030 service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Received event network-changed-36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:09:16 user nova-compute[75247]: DEBUG nova.compute.manager [req-77ef764a-2c7a-44a2-8fcf-81ed4cf5a1b6 req-1fe8148a-a905-4598-aed9-c3138e507030 service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Refreshing instance network info cache due to event network-changed-36c5fc9a-1100-48de-80da-1188909df5e5. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:09:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-77ef764a-2c7a-44a2-8fcf-81ed4cf5a1b6 req-1fe8148a-a905-4598-aed9-c3138e507030 service nova] Acquiring lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:09:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-77ef764a-2c7a-44a2-8fcf-81ed4cf5a1b6 req-1fe8148a-a905-4598-aed9-c3138e507030 service nova] Acquired lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:09:16 user nova-compute[75247]: DEBUG nova.network.neutron [req-77ef764a-2c7a-44a2-8fcf-81ed4cf5a1b6 req-1fe8148a-a905-4598-aed9-c3138e507030 service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Refreshing network info cache for port 36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:09:16 user nova-compute[75247]: DEBUG nova.network.neutron [req-77ef764a-2c7a-44a2-8fcf-81ed4cf5a1b6 req-1fe8148a-a905-4598-aed9-c3138e507030 service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Updated VIF entry in instance network info cache for port 36c5fc9a-1100-48de-80da-1188909df5e5. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:09:16 user nova-compute[75247]: DEBUG nova.network.neutron [req-77ef764a-2c7a-44a2-8fcf-81ed4cf5a1b6 req-1fe8148a-a905-4598-aed9-c3138e507030 service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Updating instance_info_cache with network_info: [{"id": "36c5fc9a-1100-48de-80da-1188909df5e5", "address": "fa:16:3e:91:16:cf", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c5fc9a-11", "ovs_interfaceid": "36c5fc9a-1100-48de-80da-1188909df5e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:09:16 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-77ef764a-2c7a-44a2-8fcf-81ed4cf5a1b6 req-1fe8148a-a905-4598-aed9-c3138e507030 service nova] Releasing lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:09:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "2b633bf8-609f-4d56-86f6-b96218435aa6" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:09:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:09:19 user nova-compute[75247]: INFO nova.compute.manager [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Shelving
Dec 06 13:09:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-5f5662da-28a5-4b77-a86b-36a516902fd3 req-64296c1a-91fe-44e8-a5fd-cb301f797137 service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Received event network-vif-unplugged-36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:09:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5f5662da-28a5-4b77-a86b-36a516902fd3 req-64296c1a-91fe-44e8-a5fd-cb301f797137 service nova] Acquiring lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:09:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5f5662da-28a5-4b77-a86b-36a516902fd3 req-64296c1a-91fe-44e8-a5fd-cb301f797137 service nova] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:09:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5f5662da-28a5-4b77-a86b-36a516902fd3 req-64296c1a-91fe-44e8-a5fd-cb301f797137 service nova] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:09:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-5f5662da-28a5-4b77-a86b-36a516902fd3 req-64296c1a-91fe-44e8-a5fd-cb301f797137 service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] No waiting events found dispatching network-vif-unplugged-36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:09:20 user nova-compute[75247]: WARNING nova.compute.manager [req-5f5662da-28a5-4b77-a86b-36a516902fd3 req-64296c1a-91fe-44e8-a5fd-cb301f797137 service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Received unexpected event network-vif-unplugged-36c5fc9a-1100-48de-80da-1188909df5e5 for instance with vm_state active and task_state shelving.
Dec 06 13:09:20 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Instance destroyed successfully.
Dec 06 13:09:20 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Beginning cold snapshot process
Dec 06 13:09:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:20 user nova-compute[75247]: DEBUG nova.privsep.utils [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 13:09:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk /opt/stack/data/nova/instances/snapshots/tmpt9361109/3a66f17acf2e4a03bd084d44ad645eb3 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk /opt/stack/data/nova/instances/snapshots/tmpt9361109/3a66f17acf2e4a03bd084d44ad645eb3" returned: 0 in 0.516s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:09:21 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Snapshot extracted, beginning image upload
Dec 06 13:09:21 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 8c836066-63ff-47ea-b3c7-f183abb5077a is timed out.
Dec 06 13:09:21 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Successfully detached device vdc from instance 8c836066-63ff-47ea-b3c7-f183abb5077a from the live domain config.
Dec 06 13:09:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dTjKqbra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:09:21 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:09:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[42385a16-74f1-4afa-a63d-027fb4120060]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 13:09:21 user nova-compute[75247]: No targets found.
Dec 06 13:09:21 user nova-compute[75247]: iSNS:
Dec 06 13:09:21 user nova-compute[75247]: No targets found.
Dec 06 13:09:21 user nova-compute[75247]: STATIC:
Dec 06 13:09:21 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d
Dec 06 13:09:21 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:09:21 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:09:21 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13
Dec 06 13:09:21 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:09:21 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:09:21 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356
Dec 06 13:09:21 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:09:21 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:09:21 user nova-compute[75247]: FIRMWARE:
Dec 06 13:09:21 user nova-compute[75247]: No targets found.
Dec 06 13:09:21 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 13:09:21 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 13:09:21 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6420180-e949-4e13-a2ac-c5cb2d724c68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e27f11b-d9c9-476f-805e-3f570b55a9b2]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)
Dec 06 13:09:21 user nova-compute[75247]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 (non-flash)
Dec 06 13:09:21 user nova-compute[75247]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d (non-flash)
Dec 06 13:09:21 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)
Dec 06 13:09:21 user nova-compute[75247]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 (non-flash)
Dec 06 13:09:21 user nova-compute[75247]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d (non-flash)
Dec 06 13:09:21 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c4092d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d'): ({'sdc'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Removing single pathed devices sdc {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d88e193-4735-44b6-a421-edc2136da74a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2a6ef7-59c4-4684-be1d-6aa0cf2cc951]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Flushing IO for device /dev/sdc {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb681fdd-6484-40e0-9c4c-89df91a8d65b]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cf3f5c-055d-4ded-a700-87620f5907ca]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] SCSI volumes sdc have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e58096b-16e8-422f-8f49-650bcced776a]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c1972c-0273-42a0-be2a-57d8fde465e3]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d, portal: 172.16.0.220,3260]
Dec 06 13:09:21 user nova-compute[75247]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d, portal: 172.16.0.220,3260] successful.
Dec 06 13:09:21 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584f746e-8d51-43ba-a1f7-23185425c29d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa49e44-cf4b-415a-b970-dd3d362440fe]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] <== disconnect_volume: return (283ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:09:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 13:09:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-628c000a-1258-4dab-a950-4382d4de6116 req-b26845dd-b471-41f4-9c8b-3a0517df9b4e service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Received event network-vif-plugged-36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:09:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-628c000a-1258-4dab-a950-4382d4de6116 req-b26845dd-b471-41f4-9c8b-3a0517df9b4e service nova] Acquiring lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:09:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-628c000a-1258-4dab-a950-4382d4de6116 req-b26845dd-b471-41f4-9c8b-3a0517df9b4e service nova] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:09:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-628c000a-1258-4dab-a950-4382d4de6116 req-b26845dd-b471-41f4-9c8b-3a0517df9b4e service nova] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:09:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-628c000a-1258-4dab-a950-4382d4de6116 req-b26845dd-b471-41f4-9c8b-3a0517df9b4e service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] No waiting events found dispatching network-vif-plugged-36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:09:22 user nova-compute[75247]: WARNING nova.compute.manager [req-628c000a-1258-4dab-a950-4382d4de6116 req-b26845dd-b471-41f4-9c8b-3a0517df9b4e service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Received unexpected event network-vif-plugged-36c5fc9a-1100-48de-80da-1188909df5e5 for instance with vm_state active and task_state shelving_image_uploading.
Dec 06 13:09:22 user nova-compute[75247]: DEBUG nova.objects.instance [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lazy-loading 'flavor' on Instance uuid 8c836066-63ff-47ea-b3c7-f183abb5077a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:09:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-4193bfde-31b8-4d30-9283-bf8357a2590f tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.847s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:09:22 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:09:23 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Snapshot image upload complete
Dec 06 13:09:23 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 13:09:23 user nova-compute[75247]: INFO nova.compute.manager [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Shelve offloading
Dec 06 13:09:23 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Instance destroyed successfully.
Dec 06 13:09:23 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 13:09:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:09:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquired lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:09:23 user nova-compute[75247]: DEBUG nova.network.neutron [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 13:09:23 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:09:24 user nova-compute[75247]: DEBUG nova.network.neutron [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Updating instance_info_cache with network_info: [{"id": "36c5fc9a-1100-48de-80da-1188909df5e5", "address": "fa:16:3e:91:16:cf", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c5fc9a-11", "ovs_interfaceid": "36c5fc9a-1100-48de-80da-1188909df5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:09:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Releasing lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:09:24 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Instance destroyed successfully.
Dec 06 13:09:24 user nova-compute[75247]: DEBUG nova.objects.instance [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lazy-loading 'resources' on Instance uuid 2b633bf8-609f-4d56-86f6-b96218435aa6 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:09:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:07:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1297482927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1297482927',id=47,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyfR84sYYIKmhk4Xel3+j5rZsBbDKhCIiuYagt2qk40+BPHAmsKSDMcOj86qj+sr16q3+XUviT2i8cP6TUSl4JNHIGJV60uIaSE11sWyCXuwMNXrH6f02pqMjSsty00Ug==',key_name='tempest-keypair-1683071845',keypairs=<?>,launch_index=0,launched_at=2023-12-06T13:07:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9f58adbd4d004a44b37a0e0922da5aa3',ramdisk_id='',reservation_id='r-lcgwlr3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2058750591',owner_user_name='tempest-AttachVolumeShelveTestJSON-2058750591-project-member',shelved_at='2023-12-06T13:09:23.589240',shelved_host='user',shelved_image_id='dfe37ca5-4d8d-4813-8ae5-48472191c5f3'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T13:09:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e50e8cc91ca4ff88ebfa0b2888699d5',uuid=2b633bf8-609f-4d56-86f6-b96218435aa6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "36c5fc9a-1100-48de-80da-1188909df5e5", "address": "fa:16:3e:91:16:cf", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c5fc9a-11", "ovs_interfaceid": "36c5fc9a-1100-48de-80da-1188909df5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 13:09:24 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Converting VIF {"id": "36c5fc9a-1100-48de-80da-1188909df5e5", "address": "fa:16:3e:91:16:cf", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c5fc9a-11", "ovs_interfaceid": "36c5fc9a-1100-48de-80da-1188909df5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:09:24 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:16:cf,bridge_name='br-int',has_traffic_filtering=True,id=36c5fc9a-1100-48de-80da-1188909df5e5,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c5fc9a-11') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:09:24 user nova-compute[75247]: DEBUG os_vif [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:16:cf,bridge_name='br-int',has_traffic_filtering=True,id=36c5fc9a-1100-48de-80da-1188909df5e5,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c5fc9a-11') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 13:09:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36c5fc9a-11, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:09:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:09:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29a64c10-01bd-493e-9e49-14f0d26c3a2f) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:09:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:24 user nova-compute[75247]: DEBUG nova.compute.manager [req-3ea810ed-a067-486a-a441-43b28b73253e req-c1350c97-8c60-4a5a-88dd-d8258502960e service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Received event network-changed-36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:09:24 user nova-compute[75247]: DEBUG nova.compute.manager [req-3ea810ed-a067-486a-a441-43b28b73253e req-c1350c97-8c60-4a5a-88dd-d8258502960e service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Refreshing instance network info cache due to event network-changed-36c5fc9a-1100-48de-80da-1188909df5e5. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:09:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ea810ed-a067-486a-a441-43b28b73253e req-c1350c97-8c60-4a5a-88dd-d8258502960e service nova] Acquiring lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:09:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ea810ed-a067-486a-a441-43b28b73253e req-c1350c97-8c60-4a5a-88dd-d8258502960e service nova] Acquired lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:09:24 user nova-compute[75247]: DEBUG nova.network.neutron [req-3ea810ed-a067-486a-a441-43b28b73253e req-c1350c97-8c60-4a5a-88dd-d8258502960e service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Refreshing network info cache for port 36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:09:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:09:24 user nova-compute[75247]: INFO os_vif [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:16:cf,bridge_name='br-int',has_traffic_filtering=True,id=36c5fc9a-1100-48de-80da-1188909df5e5,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c5fc9a-11')
Dec 06 13:09:24 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Deleting instance files /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6_del
Dec 06 13:09:24 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Deletion of /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6_del complete
Dec 06 13:09:24 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Deleted allocations for instance 2b633bf8-609f-4d56-86f6-b96218435aa6
Dec 06 13:09:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:09:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:09:24 user nova-compute[75247]: DEBUG nova.objects.instance [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lazy-loading 'numa_topology' on Instance uuid 2b633bf8-609f-4d56-86f6-b96218435aa6 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:09:24 user nova-compute[75247]: DEBUG nova.objects.base [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Object Instance<2b633bf8-609f-4d56-86f6-b96218435aa6> lazy-loaded attributes: resources,numa_topology {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 13:09:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:24 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:09:25 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:09:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:09:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bb7e23e-c8a6-462f-8a8d-358e8e51dce8 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.339s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:09:25 user nova-compute[75247]: DEBUG nova.network.neutron [req-3ea810ed-a067-486a-a441-43b28b73253e req-c1350c97-8c60-4a5a-88dd-d8258502960e service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Updated VIF entry in instance network info cache for port 36c5fc9a-1100-48de-80da-1188909df5e5. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:09:25 user nova-compute[75247]: DEBUG nova.network.neutron [req-3ea810ed-a067-486a-a441-43b28b73253e req-c1350c97-8c60-4a5a-88dd-d8258502960e service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Updating instance_info_cache with network_info: [{"id": "36c5fc9a-1100-48de-80da-1188909df5e5", "address": "fa:16:3e:91:16:cf", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap36c5fc9a-11", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:09:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ea810ed-a067-486a-a441-43b28b73253e req-c1350c97-8c60-4a5a-88dd-d8258502960e service nova] Releasing lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:09:25 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:09:28 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:09:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:30 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:09:31 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:09:31 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:09:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:09:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:09:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:09:31 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:09:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:09:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:09:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:09:32 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:09:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:09:32 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:09:32 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:09:32 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:09:32 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=8833MB free_disk=25.079627990722656GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:09:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:09:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:09:32 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 3e98845f-ad13-4240-beca-c3f70ef26f9e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:09:32 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 8c836066-63ff-47ea-b3c7-f183abb5077a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:09:32 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:09:32 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:09:32 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:09:32 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:09:33 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:09:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:09:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:09:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:09:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:09:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:09:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:35 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:09:35 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:09:35 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Dec 06 13:09:35 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Didn't find any instances for network info cache update. {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 13:09:35 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:09:35 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:09:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "3e98845f-ad13-4240-beca-c3f70ef26f9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:09:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "3e98845f-ad13-4240-beca-c3f70ef26f9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:09:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "3e98845f-ad13-4240-beca-c3f70ef26f9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:09:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "3e98845f-ad13-4240-beca-c3f70ef26f9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:09:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "3e98845f-ad13-4240-beca-c3f70ef26f9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:09:39 user nova-compute[75247]: INFO nova.compute.manager [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Terminating instance
Dec 06 13:09:39 user nova-compute[75247]: DEBUG nova.compute.manager [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 13:09:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:39 user nova-compute[75247]: DEBUG nova.compute.manager [req-a06a252c-142a-4d5f-b18c-d15e0e6ad6ed req-a42a700d-e3fe-4dcb-b3bf-20fcd223e477 service nova] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Received event network-vif-unplugged-8c291771-553f-41be-9bc1-e97d6dfb1cdd {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:09:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a06a252c-142a-4d5f-b18c-d15e0e6ad6ed req-a42a700d-e3fe-4dcb-b3bf-20fcd223e477 service nova] Acquiring lock "3e98845f-ad13-4240-beca-c3f70ef26f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:09:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a06a252c-142a-4d5f-b18c-d15e0e6ad6ed req-a42a700d-e3fe-4dcb-b3bf-20fcd223e477 service nova] Lock "3e98845f-ad13-4240-beca-c3f70ef26f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:09:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a06a252c-142a-4d5f-b18c-d15e0e6ad6ed req-a42a700d-e3fe-4dcb-b3bf-20fcd223e477 service nova] Lock "3e98845f-ad13-4240-beca-c3f70ef26f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:09:39 user nova-compute[75247]: DEBUG nova.compute.manager [req-a06a252c-142a-4d5f-b18c-d15e0e6ad6ed req-a42a700d-e3fe-4dcb-b3bf-20fcd223e477 service nova] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] No waiting events found dispatching network-vif-unplugged-8c291771-553f-41be-9bc1-e97d6dfb1cdd {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:09:39 user nova-compute[75247]: DEBUG nova.compute.manager [req-a06a252c-142a-4d5f-b18c-d15e0e6ad6ed req-a42a700d-e3fe-4dcb-b3bf-20fcd223e477 service nova] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Received event network-vif-unplugged-8c291771-553f-41be-9bc1-e97d6dfb1cdd for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 13:09:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:40 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Instance destroyed successfully.
Dec 06 13:09:40 user nova-compute[75247]: DEBUG nova.objects.instance [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lazy-loading 'resources' on Instance uuid 3e98845f-ad13-4240-beca-c3f70ef26f9e {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1217504595',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1217504595',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1217504595',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh+q+Ox5cRYT5ltlkGHYBtVLEWxrPr/2Htp0V8bZ1bDXBYy5rviIrzn/KCAt+0UuwwLA0e/SMMQErRsAHTzEaMTIZGclgEOcv4nlZb+0X5w0dNYavm72A6yG02KzO3GSw==',key_name='tempest-keypair-1608251655',keypairs=<?>,launch_index=0,launched_at=2023-12-06T13:05:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9493d9b0b1024cea9a550e2a42c1e6a1',ramdisk_id='',reservation_id='r-0n3x9pgm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2088852773',owner_user_name='tempest-TestVolumeBootPattern-2088852773-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T13:05:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016714f7502b4a8fa12ed0ce6644c5fc',uuid=3e98845f-ad13-4240-beca-c3f70ef26f9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c291771-553f-41be-9bc1-e97d6dfb1cdd", "address": "fa:16:3e:e7:fd:e8", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c291771-55", "ovs_interfaceid": "8c291771-553f-41be-9bc1-e97d6dfb1cdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converting VIF {"id": "8c291771-553f-41be-9bc1-e97d6dfb1cdd", "address": "fa:16:3e:e7:fd:e8", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c291771-55", "ovs_interfaceid": "8c291771-553f-41be-9bc1-e97d6dfb1cdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:fd:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c291771-553f-41be-9bc1-e97d6dfb1cdd,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c291771-55') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG os_vif [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:fd:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c291771-553f-41be-9bc1-e97d6dfb1cdd,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c291771-55') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c291771-55, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fc3d69b7-711d-4504-87ca-8afc0551cd00) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:09:40 user nova-compute[75247]: INFO os_vif [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:fd:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c291771-553f-41be-9bc1-e97d6dfb1cdd,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c291771-55')
Dec 06 13:09:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JWUSDjtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:09:40 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:09:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87a925a-488d-442e-8992-e607850f00ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 13:09:40 user nova-compute[75247]: No targets found.
Dec 06 13:09:40 user nova-compute[75247]: iSNS:
Dec 06 13:09:40 user nova-compute[75247]: No targets found.
Dec 06 13:09:40 user nova-compute[75247]: STATIC:
Dec 06 13:09:40 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13
Dec 06 13:09:40 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:09:40 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:09:40 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356
Dec 06 13:09:40 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:09:40 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:09:40 user nova-compute[75247]: FIRMWARE:
Dec 06 13:09:40 user nova-compute[75247]: No targets found.
Dec 06 13:09:40 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 13:09:40 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 13:09:40 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36aa32a-ecbf-413c-925d-005d4626b163]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92e9832-54f3-4ad9-9f08-e8c1b59a2da0]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)
Dec 06 13:09:40 user nova-compute[75247]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 (non-flash)
Dec 06 13:09:40 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 (non-flash)
Dec 06 13:09:40 user nova-compute[75247]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 (non-flash)
Dec 06 13:09:40 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd740364670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13'): ({'sdb'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Removing single pathed devices sdb {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80ac0f0-231e-4f5c-8e71-13336da651a2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba313bb3-c32f-4bb6-ba63-682c65cd4032]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Flushing IO for device /dev/sdb {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3622110a-5c76-4c2c-ba16-3d929c67d1ef]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[612e6eb3-5ac7-46e8-8910-8bc04dc7bc01]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[950a6e30-e8fc-4a83-b964-89bcbb5e9ec0]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac28bf3b-438e-4c3c-8f61-254a75340cbb]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13, portal: 172.16.0.220,3260]
Dec 06 13:09:40 user nova-compute[75247]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13, portal: 172.16.0.220,3260] successful.
Dec 06 13:09:40 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31187157-2599-406c-9191-7d392af73d13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3c1187-0f31-4c45-8cbb-a005ca17474a]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] <== disconnect_volume: return (291ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 13:09:40 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Deleting instance files /opt/stack/data/nova/instances/3e98845f-ad13-4240-beca-c3f70ef26f9e_del
Dec 06 13:09:40 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Deletion of /opt/stack/data/nova/instances/3e98845f-ad13-4240-beca-c3f70ef26f9e_del complete
Dec 06 13:09:40 user nova-compute[75247]: INFO nova.compute.manager [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Took 1.22 seconds to destroy the instance on the hypervisor.
Dec 06 13:09:40 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 13:09:40 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 13:09:41 user nova-compute[75247]: DEBUG nova.compute.manager [req-9ccc3fb8-888a-4b53-9f27-9c192e13a3d6 req-4e2abd78-928d-4d1c-b688-3daee6591577 service nova] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Received event network-vif-plugged-8c291771-553f-41be-9bc1-e97d6dfb1cdd {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:09:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-9ccc3fb8-888a-4b53-9f27-9c192e13a3d6 req-4e2abd78-928d-4d1c-b688-3daee6591577 service nova] Acquiring lock "3e98845f-ad13-4240-beca-c3f70ef26f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:09:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-9ccc3fb8-888a-4b53-9f27-9c192e13a3d6 req-4e2abd78-928d-4d1c-b688-3daee6591577 service nova] Lock "3e98845f-ad13-4240-beca-c3f70ef26f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:09:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-9ccc3fb8-888a-4b53-9f27-9c192e13a3d6 req-4e2abd78-928d-4d1c-b688-3daee6591577 service nova] Lock "3e98845f-ad13-4240-beca-c3f70ef26f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:09:41 user nova-compute[75247]: DEBUG nova.compute.manager [req-9ccc3fb8-888a-4b53-9f27-9c192e13a3d6 req-4e2abd78-928d-4d1c-b688-3daee6591577 service nova] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] No waiting events found dispatching network-vif-plugged-8c291771-553f-41be-9bc1-e97d6dfb1cdd {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:09:41 user nova-compute[75247]: WARNING nova.compute.manager [req-9ccc3fb8-888a-4b53-9f27-9c192e13a3d6 req-4e2abd78-928d-4d1c-b688-3daee6591577 service nova] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Received unexpected event network-vif-plugged-8c291771-553f-41be-9bc1-e97d6dfb1cdd for instance with vm_state active and task_state deleting.
Dec 06 13:09:41 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:09:41 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Took 1.13 seconds to deallocate network for instance.
Dec 06 13:09:41 user nova-compute[75247]: DEBUG nova.compute.manager [req-560281ce-024e-4223-8122-96ebb4d2d585 req-a2211c07-538e-4078-b9fe-43ced3a1fa74 service nova] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Received event network-vif-deleted-8c291771-553f-41be-9bc1-e97d6dfb1cdd {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:09:42 user nova-compute[75247]: INFO nova.compute.manager [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Took 0.89 seconds to detach 1 volumes for instance.
Dec 06 13:09:42 user nova-compute[75247]: DEBUG nova.compute.manager [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 3e98845f-ad13-4240-beca-c3f70ef26f9e] Deleting volume: 31187157-2599-406c-9191-7d392af73d13 {{(pid=75247) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 06 13:09:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:09:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:09:42 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:09:42 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:09:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:09:42 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Deleted allocations for instance 3e98845f-ad13-4240-beca-c3f70ef26f9e
Dec 06 13:09:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-54e8a98b-7a20-40e1-8070-f7f81200b833 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "3e98845f-ad13-4240-beca-c3f70ef26f9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.611s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:09:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:09:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Acquiring lock "8c836066-63ff-47ea-b3c7-f183abb5077a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:09:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:09:51 user nova-compute[75247]: INFO nova.compute.manager [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Detaching volume 6a01f9b0-4d95-4afb-8c80-d1161257c356
Dec 06 13:09:51 user nova-compute[75247]: INFO nova.virt.block_device [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Attempting to driver detach volume 6a01f9b0-4d95-4afb-8c80-d1161257c356 from mountpoint /dev/vdb
Dec 06 13:09:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Attempting to detach device vdb from instance 8c836066-63ff-47ea-b3c7-f183abb5077a from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 13:09:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 13:09:51 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:09:51 user nova-compute[75247]:   <source dev="/dev/sdd"/>
Dec 06 13:09:51 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 13:09:51 user nova-compute[75247]:   <serial>6a01f9b0-4d95-4afb-8c80-d1161257c356</serial>
Dec 06 13:09:51 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 13:09:51 user nova-compute[75247]: </disk>
Dec 06 13:09:51 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 13:09:51 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Successfully detached device vdb from instance 8c836066-63ff-47ea-b3c7-f183abb5077a from the persistent domain config.
Dec 06 13:09:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8c836066-63ff-47ea-b3c7-f183abb5077a from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 13:09:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 13:09:51 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:09:51 user nova-compute[75247]:   <source dev="/dev/sdd"/>
Dec 06 13:09:51 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 13:09:51 user nova-compute[75247]:   <serial>6a01f9b0-4d95-4afb-8c80-d1161257c356</serial>
Dec 06 13:09:51 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 13:09:51 user nova-compute[75247]: </disk>
Dec 06 13:09:51 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 13:09:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8c836066-63ff-47ea-b3c7-f183abb5077a {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 13:09:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:10:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:10:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:10:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:10:11 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8c836066-63ff-47ea-b3c7-f183abb5077a is timed out.
Dec 06 13:10:11 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Successfully detached device vdb from instance 8c836066-63ff-47ea-b3c7-f183abb5077a from the live domain config.
Dec 06 13:10:11 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHZKwkbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:10:11 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:10:11 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5860bca9-8b1b-480e-bf02-6bf890f67310]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 13:10:11 user nova-compute[75247]: No targets found.
Dec 06 13:10:11 user nova-compute[75247]: iSNS:
Dec 06 13:10:11 user nova-compute[75247]: No targets found.
Dec 06 13:10:11 user nova-compute[75247]: STATIC:
Dec 06 13:10:11 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356
Dec 06 13:10:11 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:10:11 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:10:11 user nova-compute[75247]: FIRMWARE:
Dec 06 13:10:11 user nova-compute[75247]: No targets found.
Dec 06 13:10:11 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 13:10:11 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 13:10:11 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23d4ba3-2af4-4ae0-8033-a2c666a99357]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[978fcc16-ce5d-4fa2-bea6-d94e2addbe5e]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 (non-flash)
Dec 06 13:10:11 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 (non-flash)
Dec 06 13:10:11 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c6101f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356'): ({'sdd'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Removing single pathed devices sdd {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9030f4-aa02-485c-8e66-1582bb92e018]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[db374b73-fd06-4fb5-9627-f3c348e16b3f]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Flushing IO for device /dev/sdd {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d218c5-6bc1-4353-93e1-8c1e038ea453]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 13:10:11 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:10:12 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[768dc5b8-289d-4e80-97d4-257f0e74ed24]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:10:12 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 13:10:12 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] SCSI volumes sdd have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 13:10:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 13:10:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:10:12 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2737045d-fdc8-4e00-8e20-b15390be43a5]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:10:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:10:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:10:12 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4849fc13-6b1a-4ff3-8438-09916c42e479]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:10:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356, portal: 172.16.0.220,3260]
Dec 06 13:10:12 user nova-compute[75247]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356, portal: 172.16.0.220,3260] successful.
Dec 06 13:10:12 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:10:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a01f9b0-4d95-4afb-8c80-d1161257c356 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:10:12 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f37a6dc-5b23-4905-85d0-8e01912e3490]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:10:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:10:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:10:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] <== disconnect_volume: return (286ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:10:12 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 13:10:12 user nova-compute[75247]: DEBUG nova.objects.instance [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lazy-loading 'flavor' on Instance uuid 8c836066-63ff-47ea-b3c7-f183abb5077a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:10:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-aee7afa7-ff86-404a-b952-200a0372733d tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.669s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:10:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:10:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:10:23 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:10:24 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:10:24 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:10:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:26 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:10:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:30 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:10:31 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:10:32 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:10:32 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:10:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:10:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:10:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:10:32 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:10:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:10:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:10:33 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:10:33 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:10:33 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=8939MB free_disk=25.078216552734375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:10:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:10:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:10:33 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 8c836066-63ff-47ea-b3c7-f183abb5077a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:10:33 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:10:33 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:10:34 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:10:34 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:10:34 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:10:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.451s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:10:35 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:10:35 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:10:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:10:35 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:10:35 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:10:35 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 13:10:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-8c836066-63ff-47ea-b3c7-f183abb5077a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:10:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-8c836066-63ff-47ea-b3c7-f183abb5077a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:10:36 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 13:10:36 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lazy-loading 'info_cache' on Instance uuid 8c836066-63ff-47ea-b3c7-f183abb5077a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:10:36 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Updating instance_info_cache with network_info: [{"id": "449c3ded-5da6-4274-83bc-0014aed78ec4", "address": "fa:16:3e:14:84:f0", "network": {"id": "21c71f39-1c81-456d-87df-d9b84a3f3f82", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-472433950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "266ddf79993c49c1825cd394ce5310ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449c3ded-5d", "ovs_interfaceid": "449c3ded-5da6-4274-83bc-0014aed78ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:10:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-8c836066-63ff-47ea-b3c7-f183abb5077a" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:10:36 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 13:10:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "df690bb9-fb1d-4a67-b9c8-785425c96116" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "df690bb9-fb1d-4a67-b9c8-785425c96116" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG nova.compute.manager [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 13:10:41 user nova-compute[75247]: INFO nova.compute.claims [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Claim successful on node user
Dec 06 13:10:41 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.221s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG nova.compute.manager [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-536c4cbd-5cee-4b52-8b0f-70c736b6f486 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Acquiring lock "8c836066-63ff-47ea-b3c7-f183abb5077a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-536c4cbd-5cee-4b52-8b0f-70c736b6f486 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-536c4cbd-5cee-4b52-8b0f-70c736b6f486 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Acquiring lock "8c836066-63ff-47ea-b3c7-f183abb5077a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-536c4cbd-5cee-4b52-8b0f-70c736b6f486 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-536c4cbd-5cee-4b52-8b0f-70c736b6f486 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:10:41 user nova-compute[75247]: INFO nova.compute.manager [None req-536c4cbd-5cee-4b52-8b0f-70c736b6f486 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Terminating instance
Dec 06 13:10:41 user nova-compute[75247]: DEBUG nova.compute.manager [None req-536c4cbd-5cee-4b52-8b0f-70c736b6f486 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG nova.compute.manager [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG nova.network.neutron [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 13:10:41 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 13:10:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG nova.compute.manager [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG nova.policy [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '016714f7502b4a8fa12ed0ce6644c5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9493d9b0b1024cea9a550e2a42c1e6a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 13:10:41 user nova-compute[75247]: INFO nova.virt.block_device [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Booting with volume 984f8ea6-7058-4b3c-8e61-fa4a45712e68 at /dev/vda
Dec 06 13:10:41 user nova-compute[75247]: DEBUG os_brick.utils [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b89fd39-7c68-4dce-8ce3-2d7733a0b239]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG nova.compute.manager [req-3860f726-66b6-4f7a-9646-a9faf9625ff2 req-54e10c58-ea37-4e00-97ca-e34e64ff8897 service nova] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Received event network-vif-unplugged-449c3ded-5da6-4274-83bc-0014aed78ec4 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3860f726-66b6-4f7a-9646-a9faf9625ff2 req-54e10c58-ea37-4e00-97ca-e34e64ff8897 service nova] Acquiring lock "8c836066-63ff-47ea-b3c7-f183abb5077a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3860f726-66b6-4f7a-9646-a9faf9625ff2 req-54e10c58-ea37-4e00-97ca-e34e64ff8897 service nova] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3860f726-66b6-4f7a-9646-a9faf9625ff2 req-54e10c58-ea37-4e00-97ca-e34e64ff8897 service nova] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG nova.compute.manager [req-3860f726-66b6-4f7a-9646-a9faf9625ff2 req-54e10c58-ea37-4e00-97ca-e34e64ff8897 service nova] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] No waiting events found dispatching network-vif-unplugged-449c3ded-5da6-4274-83bc-0014aed78ec4 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG nova.compute.manager [req-3860f726-66b6-4f7a-9646-a9faf9625ff2 req-54e10c58-ea37-4e00-97ca-e34e64ff8897 service nova] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Received event network-vif-unplugged-449c3ded-5da6-4274-83bc-0014aed78ec4 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a52284-0d33-404e-9e0e-ca085614a90c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:10:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acd9424-7587-48e9-8a2e-1f44be1de411]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49e7091-1e4c-4543-934b-86fc805b05cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:10:42 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 13:10:42 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d3a195-0ef7-4a8d-8316-2e8fcae886cd]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG os_brick.utils [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Updating existing volume attachment record: 604fd652-a9f4-43a4-b4db-7c40c83ed611 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:42 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Instance destroyed successfully.
Dec 06 13:10:42 user nova-compute[75247]: DEBUG nova.objects.instance [None req-536c4cbd-5cee-4b52-8b0f-70c736b6f486 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lazy-loading 'resources' on Instance uuid 8c836066-63ff-47ea-b3c7-f183abb5077a {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-536c4cbd-5cee-4b52-8b0f-70c736b6f486 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1695266635',display_name='tempest-TestServerVolumeAttachmentScenario-server-1695266635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1695266635',id=45,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0XoA/ftEd/JRhdiFnGYLnrYCGTPwweWd64soxWNnNgu41JLBpImwGz5vp4Yfw8b7ub3uFMRfnI9bvP/OMW0Vd2ILlQ9vmyeIL/I/CSk4G1fhgTYGgFBmnKmI9t0XRafw==',key_name='tempest-keypair-1217201418',keypairs=<?>,launch_index=0,launched_at=2023-12-06T13:06:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='266ddf79993c49c1825cd394ce5310ba',ramdisk_id='',reservation_id='r-3uzg7t34',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-362976929',owner_user_name='tempest-TestServerVolumeAttachmentScenario-362976929-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T13:06:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d51e2fb05d647d68600ea4e2ca62219',uuid=8c836066-63ff-47ea-b3c7-f183abb5077a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "449c3ded-5da6-4274-83bc-0014aed78ec4", "address": "fa:16:3e:14:84:f0", "network": {"id": "21c71f39-1c81-456d-87df-d9b84a3f3f82", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-472433950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "266ddf79993c49c1825cd394ce5310ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449c3ded-5d", "ovs_interfaceid": "449c3ded-5da6-4274-83bc-0014aed78ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-536c4cbd-5cee-4b52-8b0f-70c736b6f486 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Converting VIF {"id": "449c3ded-5da6-4274-83bc-0014aed78ec4", "address": "fa:16:3e:14:84:f0", "network": {"id": "21c71f39-1c81-456d-87df-d9b84a3f3f82", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-472433950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "266ddf79993c49c1825cd394ce5310ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap449c3ded-5d", "ovs_interfaceid": "449c3ded-5da6-4274-83bc-0014aed78ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-536c4cbd-5cee-4b52-8b0f-70c736b6f486 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:84:f0,bridge_name='br-int',has_traffic_filtering=True,id=449c3ded-5da6-4274-83bc-0014aed78ec4,network=Network(21c71f39-1c81-456d-87df-d9b84a3f3f82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap449c3ded-5d') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG os_vif [None req-536c4cbd-5cee-4b52-8b0f-70c736b6f486 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:84:f0,bridge_name='br-int',has_traffic_filtering=True,id=449c3ded-5da6-4274-83bc-0014aed78ec4,network=Network(21c71f39-1c81-456d-87df-d9b84a3f3f82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap449c3ded-5d') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap449c3ded-5d, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=843e9016-c36d-4e93-86b4-ce64de996c45) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:42 user nova-compute[75247]: INFO os_vif [None req-536c4cbd-5cee-4b52-8b0f-70c736b6f486 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:84:f0,bridge_name='br-int',has_traffic_filtering=True,id=449c3ded-5da6-4274-83bc-0014aed78ec4,network=Network(21c71f39-1c81-456d-87df-d9b84a3f3f82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap449c3ded-5d')
Dec 06 13:10:42 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-536c4cbd-5cee-4b52-8b0f-70c736b6f486 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Deleting instance files /opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a_del
Dec 06 13:10:42 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-536c4cbd-5cee-4b52-8b0f-70c736b6f486 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Deletion of /opt/stack/data/nova/instances/8c836066-63ff-47ea-b3c7-f183abb5077a_del complete
Dec 06 13:10:42 user nova-compute[75247]: DEBUG nova.network.neutron [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Successfully created port: f114e05d-020b-453c-83ad-15fc56b9f551 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 13:10:42 user nova-compute[75247]: INFO nova.compute.manager [None req-536c4cbd-5cee-4b52-8b0f-70c736b6f486 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Took 0.87 seconds to destroy the instance on the hypervisor.
Dec 06 13:10:42 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-536c4cbd-5cee-4b52-8b0f-70c736b6f486 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 13:10:42 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 13:10:43 user nova-compute[75247]: DEBUG nova.network.neutron [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Successfully updated port: f114e05d-020b-453c-83ad-15fc56b9f551 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 13:10:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "refresh_cache-df690bb9-fb1d-4a67-b9c8-785425c96116" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:10:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquired lock "refresh_cache-df690bb9-fb1d-4a67-b9c8-785425c96116" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:10:43 user nova-compute[75247]: DEBUG nova.network.neutron [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 13:10:43 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:10:43 user nova-compute[75247]: DEBUG nova.compute.manager [req-ab87295e-b40e-477e-9a19-93ce489abe74 req-b0fa68ac-5353-4b43-9e9a-31f1fd4ee11b service nova] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Received event network-changed-f114e05d-020b-453c-83ad-15fc56b9f551 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:10:43 user nova-compute[75247]: DEBUG nova.compute.manager [req-ab87295e-b40e-477e-9a19-93ce489abe74 req-b0fa68ac-5353-4b43-9e9a-31f1fd4ee11b service nova] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Refreshing instance network info cache due to event network-changed-f114e05d-020b-453c-83ad-15fc56b9f551. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:10:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ab87295e-b40e-477e-9a19-93ce489abe74 req-b0fa68ac-5353-4b43-9e9a-31f1fd4ee11b service nova] Acquiring lock "refresh_cache-df690bb9-fb1d-4a67-b9c8-785425c96116" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:10:43 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Took 1.10 seconds to deallocate network for instance.
Dec 06 13:10:43 user nova-compute[75247]: DEBUG nova.network.neutron [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 13:10:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-536c4cbd-5cee-4b52-8b0f-70c736b6f486 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:10:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-536c4cbd-5cee-4b52-8b0f-70c736b6f486 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:10:43 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-536c4cbd-5cee-4b52-8b0f-70c736b6f486 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:10:43 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-536c4cbd-5cee-4b52-8b0f-70c736b6f486 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:10:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-536c4cbd-5cee-4b52-8b0f-70c736b6f486 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:10:43 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-536c4cbd-5cee-4b52-8b0f-70c736b6f486 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Deleted allocations for instance 8c836066-63ff-47ea-b3c7-f183abb5077a
Dec 06 13:10:43 user nova-compute[75247]: DEBUG nova.network.neutron [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Updating instance_info_cache with network_info: [{"id": "f114e05d-020b-453c-83ad-15fc56b9f551", "address": "fa:16:3e:b3:af:b9", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf114e05d-02", "ovs_interfaceid": "f114e05d-020b-453c-83ad-15fc56b9f551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:10:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Releasing lock "refresh_cache-df690bb9-fb1d-4a67-b9c8-785425c96116" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:10:43 user nova-compute[75247]: DEBUG nova.compute.manager [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Instance network_info: |[{"id": "f114e05d-020b-453c-83ad-15fc56b9f551", "address": "fa:16:3e:b3:af:b9", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf114e05d-02", "ovs_interfaceid": "f114e05d-020b-453c-83ad-15fc56b9f551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 13:10:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ab87295e-b40e-477e-9a19-93ce489abe74 req-b0fa68ac-5353-4b43-9e9a-31f1fd4ee11b service nova] Acquired lock "refresh_cache-df690bb9-fb1d-4a67-b9c8-785425c96116" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:10:43 user nova-compute[75247]: DEBUG nova.network.neutron [req-ab87295e-b40e-477e-9a19-93ce489abe74 req-b0fa68ac-5353-4b43-9e9a-31f1fd4ee11b service nova] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Refreshing network info cache for port f114e05d-020b-453c-83ad-15fc56b9f551 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:10:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-536c4cbd-5cee-4b52-8b0f-70c736b6f486 tempest-TestServerVolumeAttachmentScenario-362976929 tempest-TestServerVolumeAttachmentScenario-362976929-project-member] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.314s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:10:44 user nova-compute[75247]: DEBUG nova.compute.manager [req-3f1db8ab-5ace-428f-9ffb-6fd0e6b36fe4 req-562763e5-dcef-440d-abf2-5f61113fe95b service nova] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Received event network-vif-plugged-449c3ded-5da6-4274-83bc-0014aed78ec4 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:10:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3f1db8ab-5ace-428f-9ffb-6fd0e6b36fe4 req-562763e5-dcef-440d-abf2-5f61113fe95b service nova] Acquiring lock "8c836066-63ff-47ea-b3c7-f183abb5077a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:10:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3f1db8ab-5ace-428f-9ffb-6fd0e6b36fe4 req-562763e5-dcef-440d-abf2-5f61113fe95b service nova] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:10:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3f1db8ab-5ace-428f-9ffb-6fd0e6b36fe4 req-562763e5-dcef-440d-abf2-5f61113fe95b service nova] Lock "8c836066-63ff-47ea-b3c7-f183abb5077a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:10:44 user nova-compute[75247]: DEBUG nova.compute.manager [req-3f1db8ab-5ace-428f-9ffb-6fd0e6b36fe4 req-562763e5-dcef-440d-abf2-5f61113fe95b service nova] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] No waiting events found dispatching network-vif-plugged-449c3ded-5da6-4274-83bc-0014aed78ec4 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:10:44 user nova-compute[75247]: WARNING nova.compute.manager [req-3f1db8ab-5ace-428f-9ffb-6fd0e6b36fe4 req-562763e5-dcef-440d-abf2-5f61113fe95b service nova] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Received unexpected event network-vif-plugged-449c3ded-5da6-4274-83bc-0014aed78ec4 for instance with vm_state deleted and task_state None.
Dec 06 13:10:44 user nova-compute[75247]: DEBUG nova.network.neutron [req-ab87295e-b40e-477e-9a19-93ce489abe74 req-b0fa68ac-5353-4b43-9e9a-31f1fd4ee11b service nova] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Updated VIF entry in instance network info cache for port f114e05d-020b-453c-83ad-15fc56b9f551. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:10:44 user nova-compute[75247]: DEBUG nova.network.neutron [req-ab87295e-b40e-477e-9a19-93ce489abe74 req-b0fa68ac-5353-4b43-9e9a-31f1fd4ee11b service nova] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Updating instance_info_cache with network_info: [{"id": "f114e05d-020b-453c-83ad-15fc56b9f551", "address": "fa:16:3e:b3:af:b9", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf114e05d-02", "ovs_interfaceid": "f114e05d-020b-453c-83ad-15fc56b9f551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:10:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ab87295e-b40e-477e-9a19-93ce489abe74 req-b0fa68ac-5353-4b43-9e9a-31f1fd4ee11b service nova] Releasing lock "refresh_cache-df690bb9-fb1d-4a67-b9c8-785425c96116" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:10:45 user nova-compute[75247]: DEBUG nova.compute.manager [req-9291ae64-900e-48a8-b363-e39bd07ff168 req-b024ec76-ff2b-4e6a-8e69-59a4f7223c64 service nova] [instance: 8c836066-63ff-47ea-b3c7-f183abb5077a] Received event network-vif-deleted-449c3ded-5da6-4274-83bc-0014aed78ec4 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:10:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG nova.compute.manager [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 13:10:54 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Creating image(s)
Dec 06 13:10:54 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Did not create local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Ensure instance console log exists: /opt/stack/data/nova/instances/df690bb9-fb1d-4a67-b9c8-785425c96116/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Start _get_guest_xml network_info=[{"id": "f114e05d-020b-453c-83ad-15fc56b9f551", "address": "fa:16:3e:b3:af:b9", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf114e05d-02", "ovs_interfaceid": "f114e05d-020b-453c-83ad-15fc56b9f551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '604fd652-a9f4-43a4-b4db-7c40c83ed611', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zldIYVrk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'df690bb9-fb1d-4a67-b9c8-785425c96116', 'attached_at': '', 'detached_at': '', 'volume_id': '984f8ea6-7058-4b3c-8e61-fa4a45712e68', 'serial': '984f8ea6-7058-4b3c-8e61-fa4a45712e68'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 13:10:54 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:10:54 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:10:54 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zldIYVrk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:10:54 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:10:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:10:54 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:10:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:10:54 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8fc805-598d-4077-b3fc-f6482bb6149c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 13:10:54 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56851a0-3651-4eef-92a3-68844057f6c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68] added
Dec 06 13:10:54 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad2bb29-f5d2-4c4b-9661-7995178a19bd]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0fb040-475e-4616-902c-eb3535cdbe28]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zldIYVrk {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zldIYVrk" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93ed8a5-50bf-4950-8e58-ae95b1bbf2e9]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zldIYVrk'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9e14bc-f33f-4fe9-b621-99aaea8007cf]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[312f84d6-27d0-40ac-bd4f-a839e6dd9e5e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 13:10:54 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 13:10:54 user nova-compute[75247]:  {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:10:54 user nova-compute[75247]: WARNING os_brick.initiator.connectors.iscsi [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 13:10:54 user nova-compute[75247]: 
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f6971b-2279-4775-bd2e-fa29d627a3cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68, portal: 172.16.0.220,3260]
Dec 06 13:10:54 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68, portal: 172.16.0.220,3260] successful.
Dec 06 13:10:54 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8507c237-4455-4813-b9ae-375c52bef74b]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[73eff82e-4c61-4852-a9ea-406b87f83c59]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:10:54 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:10:54 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b36554e-cbcd-410b-bcd8-ecd2ae37d15e]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 13:10:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zldIYVrk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23964656639633861', 'path': '/dev/sdb'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964656639633861', 'path': '/dev/sdb'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:10:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1497396733',display_name='tempest-TestVolumeBootPattern-server-1497396733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1497396733',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+e3XTLfVN8C3itmblwy09HtnE6ODmf3LMeZLWfbnBfl5D2ms/C+dYrJrc6lCBYNrZ/pLuupAxLsGv6ZOwhXojQ4RlmELXbFB3bv70Zc31yz9kRGkDkIlpeboSBmcUYgg==',key_name='tempest-TestVolumeBootPattern-1199968839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9493d9b0b1024cea9a550e2a42c1e6a1',ramdisk_id='',reservation_id='r-bspzmxhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2088852773',owner_user_name='tempest-TestVolumeBootPattern-2088852773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:10:42Z,user_data=None,user_id='016714f7502b4a8fa12ed0ce6644c5fc',uuid=df690bb9-fb1d-4a67-b9c8-785425c96116,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f114e05d-020b-453c-83ad-15fc56b9f551", "address": "fa:16:3e:b3:af:b9", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf114e05d-02", "ovs_interfaceid": "f114e05d-020b-453c-83ad-15fc56b9f551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converting VIF {"id": "f114e05d-020b-453c-83ad-15fc56b9f551", "address": "fa:16:3e:b3:af:b9", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf114e05d-02", "ovs_interfaceid": "f114e05d-020b-453c-83ad-15fc56b9f551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:af:b9,bridge_name='br-int',has_traffic_filtering=True,id=f114e05d-020b-453c-83ad-15fc56b9f551,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf114e05d-02') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG nova.objects.instance [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lazy-loading 'pci_devices' on Instance uuid df690bb9-fb1d-4a67-b9c8-785425c96116 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] End _get_guest_xml xml=<domain type="kvm">
Dec 06 13:10:55 user nova-compute[75247]:   <uuid>df690bb9-fb1d-4a67-b9c8-785425c96116</uuid>
Dec 06 13:10:55 user nova-compute[75247]:   <name>instance-00000030</name>
Dec 06 13:10:55 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 13:10:55 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 13:10:55 user nova-compute[75247]:   <metadata>
Dec 06 13:10:55 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 13:10:55 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 13:10:55 user nova-compute[75247]:       <nova:name>tempest-TestVolumeBootPattern-server-1497396733</nova:name>
Dec 06 13:10:55 user nova-compute[75247]:       <nova:creationTime>2023-12-06 13:10:54</nova:creationTime>
Dec 06 13:10:55 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 13:10:55 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 13:10:55 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 13:10:55 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 13:10:55 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 13:10:55 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 13:10:55 user nova-compute[75247]:       </nova:flavor>
Dec 06 13:10:55 user nova-compute[75247]:       <nova:owner>
Dec 06 13:10:55 user nova-compute[75247]:         <nova:user uuid="016714f7502b4a8fa12ed0ce6644c5fc">tempest-TestVolumeBootPattern-2088852773-project-member</nova:user>
Dec 06 13:10:55 user nova-compute[75247]:         <nova:project uuid="9493d9b0b1024cea9a550e2a42c1e6a1">tempest-TestVolumeBootPattern-2088852773</nova:project>
Dec 06 13:10:55 user nova-compute[75247]:       </nova:owner>
Dec 06 13:10:55 user nova-compute[75247]:       <nova:ports>
Dec 06 13:10:55 user nova-compute[75247]:         <nova:port uuid="f114e05d-020b-453c-83ad-15fc56b9f551">
Dec 06 13:10:55 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 13:10:55 user nova-compute[75247]:         </nova:port>
Dec 06 13:10:55 user nova-compute[75247]:       </nova:ports>
Dec 06 13:10:55 user nova-compute[75247]:     </nova:instance>
Dec 06 13:10:55 user nova-compute[75247]:   </metadata>
Dec 06 13:10:55 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 13:10:55 user nova-compute[75247]:     <system>
Dec 06 13:10:55 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 13:10:55 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 13:10:55 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 13:10:55 user nova-compute[75247]:       <entry name="serial">df690bb9-fb1d-4a67-b9c8-785425c96116</entry>
Dec 06 13:10:55 user nova-compute[75247]:       <entry name="uuid">df690bb9-fb1d-4a67-b9c8-785425c96116</entry>
Dec 06 13:10:55 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 13:10:55 user nova-compute[75247]:     </system>
Dec 06 13:10:55 user nova-compute[75247]:   </sysinfo>
Dec 06 13:10:55 user nova-compute[75247]:   <os>
Dec 06 13:10:55 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 13:10:55 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 13:10:55 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 13:10:55 user nova-compute[75247]:   </os>
Dec 06 13:10:55 user nova-compute[75247]:   <features>
Dec 06 13:10:55 user nova-compute[75247]:     <acpi/>
Dec 06 13:10:55 user nova-compute[75247]:     <apic/>
Dec 06 13:10:55 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 13:10:55 user nova-compute[75247]:   </features>
Dec 06 13:10:55 user nova-compute[75247]:   <clock offset="utc">
Dec 06 13:10:55 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 13:10:55 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 13:10:55 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 13:10:55 user nova-compute[75247]:   </clock>
Dec 06 13:10:55 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 13:10:55 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 13:10:55 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 13:10:55 user nova-compute[75247]:   </cpu>
Dec 06 13:10:55 user nova-compute[75247]:   <devices>
Dec 06 13:10:55 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 13:10:55 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:10:55 user nova-compute[75247]:       <source dev="/dev/sdb"/>
Dec 06 13:10:55 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 13:10:55 user nova-compute[75247]:       <serial>984f8ea6-7058-4b3c-8e61-fa4a45712e68</serial>
Dec 06 13:10:55 user nova-compute[75247]:     </disk>
Dec 06 13:10:55 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 13:10:55 user nova-compute[75247]:       <mac address="fa:16:3e:b3:af:b9"/>
Dec 06 13:10:55 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:10:55 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 13:10:55 user nova-compute[75247]:       <target dev="tapf114e05d-02"/>
Dec 06 13:10:55 user nova-compute[75247]:     </interface>
Dec 06 13:10:55 user nova-compute[75247]:     <serial type="pty">
Dec 06 13:10:55 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/df690bb9-fb1d-4a67-b9c8-785425c96116/console.log" append="off"/>
Dec 06 13:10:55 user nova-compute[75247]:     </serial>
Dec 06 13:10:55 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 13:10:55 user nova-compute[75247]:     <video>
Dec 06 13:10:55 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:10:55 user nova-compute[75247]:     </video>
Dec 06 13:10:55 user nova-compute[75247]:     <rng model="virtio">
Dec 06 13:10:55 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 13:10:55 user nova-compute[75247]:     </rng>
Dec 06 13:10:55 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 13:10:55 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 13:10:55 user nova-compute[75247]:       <stats period="10"/>
Dec 06 13:10:55 user nova-compute[75247]:     </memballoon>
Dec 06 13:10:55 user nova-compute[75247]:   </devices>
Dec 06 13:10:55 user nova-compute[75247]: </domain>
Dec 06 13:10:55 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:10:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1497396733',display_name='tempest-TestVolumeBootPattern-server-1497396733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1497396733',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+e3XTLfVN8C3itmblwy09HtnE6ODmf3LMeZLWfbnBfl5D2ms/C+dYrJrc6lCBYNrZ/pLuupAxLsGv6ZOwhXojQ4RlmELXbFB3bv70Zc31yz9kRGkDkIlpeboSBmcUYgg==',key_name='tempest-TestVolumeBootPattern-1199968839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9493d9b0b1024cea9a550e2a42c1e6a1',ramdisk_id='',reservation_id='r-bspzmxhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2088852773',owner_user_name='tempest-TestVolumeBootPattern-2088852773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:10:42Z,user_data=None,user_id='016714f7502b4a8fa12ed0ce6644c5fc',uuid=df690bb9-fb1d-4a67-b9c8-785425c96116,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f114e05d-020b-453c-83ad-15fc56b9f551", "address": "fa:16:3e:b3:af:b9", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf114e05d-02", "ovs_interfaceid": "f114e05d-020b-453c-83ad-15fc56b9f551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converting VIF {"id": "f114e05d-020b-453c-83ad-15fc56b9f551", "address": "fa:16:3e:b3:af:b9", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf114e05d-02", "ovs_interfaceid": "f114e05d-020b-453c-83ad-15fc56b9f551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:af:b9,bridge_name='br-int',has_traffic_filtering=True,id=f114e05d-020b-453c-83ad-15fc56b9f551,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf114e05d-02') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG os_vif [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:af:b9,bridge_name='br-int',has_traffic_filtering=True,id=f114e05d-020b-453c-83ad-15fc56b9f551,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf114e05d-02') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47d1640a-1e14-5661-97fd-957068dcafe5', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf114e05d-02, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf114e05d-02, col_values=(('qos', UUID('26ff3c13-7fb4-4a66-b845-511eccd8ac88')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf114e05d-02, col_values=(('external_ids', {'iface-id': 'f114e05d-020b-453c-83ad-15fc56b9f551', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:af:b9', 'vm-uuid': 'df690bb9-fb1d-4a67-b9c8-785425c96116'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:55 user nova-compute[75247]: INFO os_vif [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:af:b9,bridge_name='br-int',has_traffic_filtering=True,id=f114e05d-020b-453c-83ad-15fc56b9f551,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf114e05d-02')
Dec 06 13:10:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:10:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] No VIF found with MAC fa:16:3e:b3:af:b9, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 13:10:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:57 user nova-compute[75247]: DEBUG nova.compute.manager [req-f8fc28be-1127-411b-9952-65636caf3c2b req-dddef5fa-96e5-43b0-9cd6-5e9a7797d36d service nova] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Received event network-vif-plugged-f114e05d-020b-453c-83ad-15fc56b9f551 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:10:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f8fc28be-1127-411b-9952-65636caf3c2b req-dddef5fa-96e5-43b0-9cd6-5e9a7797d36d service nova] Acquiring lock "df690bb9-fb1d-4a67-b9c8-785425c96116-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:10:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f8fc28be-1127-411b-9952-65636caf3c2b req-dddef5fa-96e5-43b0-9cd6-5e9a7797d36d service nova] Lock "df690bb9-fb1d-4a67-b9c8-785425c96116-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:10:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f8fc28be-1127-411b-9952-65636caf3c2b req-dddef5fa-96e5-43b0-9cd6-5e9a7797d36d service nova] Lock "df690bb9-fb1d-4a67-b9c8-785425c96116-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:10:57 user nova-compute[75247]: DEBUG nova.compute.manager [req-f8fc28be-1127-411b-9952-65636caf3c2b req-dddef5fa-96e5-43b0-9cd6-5e9a7797d36d service nova] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] No waiting events found dispatching network-vif-plugged-f114e05d-020b-453c-83ad-15fc56b9f551 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:10:57 user nova-compute[75247]: WARNING nova.compute.manager [req-f8fc28be-1127-411b-9952-65636caf3c2b req-dddef5fa-96e5-43b0-9cd6-5e9a7797d36d service nova] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Received unexpected event network-vif-plugged-f114e05d-020b-453c-83ad-15fc56b9f551 for instance with vm_state building and task_state spawning.
Dec 06 13:10:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:10:59 user nova-compute[75247]: DEBUG nova.compute.manager [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 13:10:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 13:10:59 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Instance spawned successfully.
Dec 06 13:10:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 13:10:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:10:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:10:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:10:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:10:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:10:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:10:59 user nova-compute[75247]: INFO nova.compute.manager [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Took 5.03 seconds to spawn the instance on the hypervisor.
Dec 06 13:10:59 user nova-compute[75247]: DEBUG nova.compute.manager [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 13:10:59 user nova-compute[75247]: DEBUG nova.compute.manager [req-470d8392-e2ca-4bfb-8ac3-cce2cb365ae4 req-ef0e9b81-8b2d-4cb0-a9ca-4744c13dd22f service nova] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Received event network-vif-plugged-f114e05d-020b-453c-83ad-15fc56b9f551 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:10:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-470d8392-e2ca-4bfb-8ac3-cce2cb365ae4 req-ef0e9b81-8b2d-4cb0-a9ca-4744c13dd22f service nova] Acquiring lock "df690bb9-fb1d-4a67-b9c8-785425c96116-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:10:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-470d8392-e2ca-4bfb-8ac3-cce2cb365ae4 req-ef0e9b81-8b2d-4cb0-a9ca-4744c13dd22f service nova] Lock "df690bb9-fb1d-4a67-b9c8-785425c96116-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:10:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-470d8392-e2ca-4bfb-8ac3-cce2cb365ae4 req-ef0e9b81-8b2d-4cb0-a9ca-4744c13dd22f service nova] Lock "df690bb9-fb1d-4a67-b9c8-785425c96116-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:10:59 user nova-compute[75247]: DEBUG nova.compute.manager [req-470d8392-e2ca-4bfb-8ac3-cce2cb365ae4 req-ef0e9b81-8b2d-4cb0-a9ca-4744c13dd22f service nova] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] No waiting events found dispatching network-vif-plugged-f114e05d-020b-453c-83ad-15fc56b9f551 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:10:59 user nova-compute[75247]: WARNING nova.compute.manager [req-470d8392-e2ca-4bfb-8ac3-cce2cb365ae4 req-ef0e9b81-8b2d-4cb0-a9ca-4744c13dd22f service nova] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Received unexpected event network-vif-plugged-f114e05d-020b-453c-83ad-15fc56b9f551 for instance with vm_state active and task_state None.
Dec 06 13:10:59 user nova-compute[75247]: INFO nova.compute.manager [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Took 18.09 seconds to build instance.
Dec 06 13:10:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-42d80beb-d817-4b5c-98e3-b1a8095f10e7 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "df690bb9-fb1d-4a67-b9c8-785425c96116" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.190s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:10:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "2b633bf8-609f-4d56-86f6-b96218435aa6" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:11:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:11:12 user nova-compute[75247]: INFO nova.compute.manager [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Unshelving
Dec 06 13:11:12 user nova-compute[75247]: INFO nova.virt.block_device [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Booting with volume 8c6162bf-f14e-43fd-b8c3-d096887cb462 at /dev/vdc
Dec 06 13:11:12 user nova-compute[75247]: DEBUG os_brick.utils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:11:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:11:12 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b059f9b0-3560-4045-a61f-d0bc06aaeb69]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:11:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:11:12 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f0d982-5172-4f17-906c-cfa094b30445]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:11:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:11:12 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d8fb16-ffa1-4200-8a36-777b9367f2b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:11:12 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7fe5ae-4966-4870-9f4a-b4ffaacfc3fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:11:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:11:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 13:11:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:12 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:11:12 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 13:11:12 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc355c6-8444-42fa-bd25-7abe0b294f0f]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:11:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 13:11:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 13:11:12 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 13:11:12 user nova-compute[75247]: DEBUG os_brick.utils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:11:12 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Updating existing volume attachment record: 11820e0e-75d2-4edc-a8d4-9cd2975331c5 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 13:11:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:11:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:11:22 user nova-compute[75247]: DEBUG nova.objects.instance [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lazy-loading 'pci_requests' on Instance uuid 2b633bf8-609f-4d56-86f6-b96218435aa6 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:11:22 user nova-compute[75247]: DEBUG nova.objects.instance [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lazy-loading 'numa_topology' on Instance uuid 2b633bf8-609f-4d56-86f6-b96218435aa6 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:11:22 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 13:11:22 user nova-compute[75247]: INFO nova.compute.claims [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Claim successful on node user
Dec 06 13:11:22 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:11:22 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:11:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.257s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:11:22 user nova-compute[75247]: INFO nova.network.neutron [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Updating port 36c5fc9a-1100-48de-80da-1188909df5e5 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Dec 06 13:11:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:11:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquired lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:11:23 user nova-compute[75247]: DEBUG nova.network.neutron [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 13:11:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-40992546-461f-4790-934a-ded3601bd862 req-c443834f-c44f-4701-98db-44a1615be1a1 service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Received event network-changed-36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:11:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-40992546-461f-4790-934a-ded3601bd862 req-c443834f-c44f-4701-98db-44a1615be1a1 service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Refreshing instance network info cache due to event network-changed-36c5fc9a-1100-48de-80da-1188909df5e5. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:11:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-40992546-461f-4790-934a-ded3601bd862 req-c443834f-c44f-4701-98db-44a1615be1a1 service nova] Acquiring lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:11:23 user nova-compute[75247]: DEBUG nova.network.neutron [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Updating instance_info_cache with network_info: [{"id": "36c5fc9a-1100-48de-80da-1188909df5e5", "address": "fa:16:3e:91:16:cf", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c5fc9a-11", "ovs_interfaceid": "36c5fc9a-1100-48de-80da-1188909df5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:11:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Releasing lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:11:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 13:11:23 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Creating image(s)
Dec 06 13:11:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:11:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "/opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:11:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "/opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:11:23 user nova-compute[75247]: DEBUG nova.objects.instance [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2b633bf8-609f-4d56-86f6-b96218435aa6 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:11:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-40992546-461f-4790-934a-ded3601bd862 req-c443834f-c44f-4701-98db-44a1615be1a1 service nova] Acquired lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:11:23 user nova-compute[75247]: DEBUG nova.network.neutron [req-40992546-461f-4790-934a-ded3601bd862 req-c443834f-c44f-4701-98db-44a1615be1a1 service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Refreshing network info cache for port 36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:11:23 user nova-compute[75247]: DEBUG nova.objects.base [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Object Instance<2b633bf8-609f-4d56-86f6-b96218435aa6> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 13:11:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "31370a97735489de76e43b0fac097e99f9a2965d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:11:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "31370a97735489de76e43b0fac097e99f9a2965d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:11:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31370a97735489de76e43b0fac097e99f9a2965d.part --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:24 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31370a97735489de76e43b0fac097e99f9a2965d.part --force-share --output=json" returned: 0 in 0.184s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:11:24 user nova-compute[75247]: DEBUG nova.virt.images [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] dfe37ca5-4d8d-4813-8ae5-48472191c5f3 was qcow2, converting to raw {{(pid=75247) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 13:11:25 user nova-compute[75247]: DEBUG nova.privsep.utils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 13:11:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/31370a97735489de76e43b0fac097e99f9a2965d.part /opt/stack/data/nova/instances/_base/31370a97735489de76e43b0fac097e99f9a2965d.converted {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:25 user nova-compute[75247]: DEBUG nova.network.neutron [req-40992546-461f-4790-934a-ded3601bd862 req-c443834f-c44f-4701-98db-44a1615be1a1 service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Updated VIF entry in instance network info cache for port 36c5fc9a-1100-48de-80da-1188909df5e5. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:11:25 user nova-compute[75247]: DEBUG nova.network.neutron [req-40992546-461f-4790-934a-ded3601bd862 req-c443834f-c44f-4701-98db-44a1615be1a1 service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Updating instance_info_cache with network_info: [{"id": "36c5fc9a-1100-48de-80da-1188909df5e5", "address": "fa:16:3e:91:16:cf", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c5fc9a-11", "ovs_interfaceid": "36c5fc9a-1100-48de-80da-1188909df5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:11:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-40992546-461f-4790-934a-ded3601bd862 req-c443834f-c44f-4701-98db-44a1615be1a1 service nova] Releasing lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:11:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/31370a97735489de76e43b0fac097e99f9a2965d.part /opt/stack/data/nova/instances/_base/31370a97735489de76e43b0fac097e99f9a2965d.converted" returned: 0 in 0.785s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:11:25 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31370a97735489de76e43b0fac097e99f9a2965d.converted --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:25 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:11:25 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:11:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31370a97735489de76e43b0fac097e99f9a2965d.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:11:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "31370a97735489de76e43b0fac097e99f9a2965d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.394s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:11:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31370a97735489de76e43b0fac097e99f9a2965d --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31370a97735489de76e43b0fac097e99f9a2965d --force-share --output=json" returned: 0 in 0.171s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:11:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "31370a97735489de76e43b0fac097e99f9a2965d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:11:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "31370a97735489de76e43b0fac097e99f9a2965d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:11:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31370a97735489de76e43b0fac097e99f9a2965d --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31370a97735489de76e43b0fac097e99f9a2965d --force-share --output=json" returned: 0 in 0.178s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:11:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/31370a97735489de76e43b0fac097e99f9a2965d,backing_fmt=raw /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/31370a97735489de76e43b0fac097e99f9a2965d,backing_fmt=raw /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk 1073741824" returned: 0 in 0.049s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:11:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "31370a97735489de76e43b0fac097e99f9a2965d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:11:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31370a97735489de76e43b0fac097e99f9a2965d --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31370a97735489de76e43b0fac097e99f9a2965d --force-share --output=json" returned: 0 in 0.180s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:11:26 user nova-compute[75247]: DEBUG nova.objects.instance [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lazy-loading 'migration_context' on Instance uuid 2b633bf8-609f-4d56-86f6-b96218435aa6 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:11:26 user nova-compute[75247]: DEBUG nova.objects.base [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Object Instance<2b633bf8-609f-4d56-86f6-b96218435aa6> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 13:11:26 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Rebasing disk image.
Dec 06 13:11:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.168s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:11:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec -F raw /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:27 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec -F raw /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk" returned: 0 in 2.430s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Ensure instance console log exists: /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Start _get_guest_xml network_info=[{"id": "36c5fc9a-1100-48de-80da-1188909df5e5", "address": "fa:16:3e:91:16:cf", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c5fc9a-11", "ovs_interfaceid": "36c5fc9a-1100-48de-80da-1188909df5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='3e26dc8d1f8cfbaf47bce35483e59ca6',container_format='bare',created_at=2023-12-06T13:09:20Z,direct_url=<?>,disk_format='qcow2',id=dfe37ca5-4d8d-4813-8ae5-48472191c5f3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1297482927-shelved',owner='9f58adbd4d004a44b37a0e0922da5aa3',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-06T13:09:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '11820e0e-75d2-4edc-a8d4-9cd2975331c5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TiJvYhMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '2b633bf8-609f-4d56-86f6-b96218435aa6', 'attached_at': '', 'detached_at': '', 'volume_id': '8c6162bf-f14e-43fd-b8c3-d096887cb462', 'serial': '8c6162bf-f14e-43fd-b8c3-d096887cb462'}, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 13:11:29 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:11:29 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:11:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3e26dc8d1f8cfbaf47bce35483e59ca6',container_format='bare',created_at=2023-12-06T13:09:20Z,direct_url=<?>,disk_format='qcow2',id=dfe37ca5-4d8d-4813-8ae5-48472191c5f3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1297482927-shelved',owner='9f58adbd4d004a44b37a0e0922da5aa3',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-06T13:09:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG nova.objects.instance [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2b633bf8-609f-4d56-86f6-b96218435aa6 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG nova.objects.base [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Object Instance<2b633bf8-609f-4d56-86f6-b96218435aa6> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TiJvYhMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:11:29 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:11:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:11:29 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:11:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:11:29 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f37e0c3-7b15-4e8a-ae37-be5b6ce00b1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 13:11:29 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02de013-8df5-4230-ae54-a33c25c8f149]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462] added
Dec 06 13:11:29 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c46c8d-c62b-4e76-9642-abbac897cf87]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[45daa86d-fad4-4108-b4ca-03c6a2fd1030]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TiJvYhMp {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TiJvYhMp" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d98e174-9572-418b-9ec3-de6438e9f25d]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TiJvYhMp'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ea4f1f-db53-4526-a01d-e94d44f62813]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[300ea242-b277-4a32-af98-1216c283a1fe]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:11:29 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:11:29 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8af9d6-d619-4822-83cf-f84be6136501]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462, portal: 172.16.0.220,3260]
Dec 06 13:11:29 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462, portal: 172.16.0.220,3260] successful.
Dec 06 13:11:29 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca92721-b4d0-4b37-875b-7d7209882752]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea6787e-7a94-4c57-a3a7-93e1e9650a21]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:11:29 user nova-compute[75247]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 (non-flash)
Dec 06 13:11:29 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:11:29 user nova-compute[75247]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 (non-flash)
Dec 06 13:11:29 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75ff943-3ef4-48f9-8392-7baea76cb568]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: None {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 13:11:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TiJvYhMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26166363738353430', 'path': '/dev/sdc'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166363738353430', 'path': '/dev/sdc'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T13:07:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1297482927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1297482927',id=47,image_ref='dfe37ca5-4d8d-4813-8ae5-48472191c5f3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1683071845',keypairs=<?>,launch_index=0,launched_at=2023-12-06T13:07:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9f58adbd4d004a44b37a0e0922da5aa3',ramdisk_id='',reservation_id='r-lcgwlr3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2058750591',owner_user_name='tempest-AttachVolumeShelveTestJSON-2058750591-project-member',shelved_at='2023-12-06T13:09:23.589240',shelved_host='user',shelved_image_id='dfe37ca5-4d8d-4813-8ae5-48472191c5f3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:11:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e50e8cc91ca4ff88ebfa0b2888699d5',uuid=2b633bf8-609f-4d56-86f6-b96218435aa6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "36c5fc9a-1100-48de-80da-1188909df5e5", "address": "fa:16:3e:91:16:cf", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c5fc9a-11", "ovs_interfaceid": "36c5fc9a-1100-48de-80da-1188909df5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Converting VIF {"id": "36c5fc9a-1100-48de-80da-1188909df5e5", "address": "fa:16:3e:91:16:cf", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c5fc9a-11", "ovs_interfaceid": "36c5fc9a-1100-48de-80da-1188909df5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:16:cf,bridge_name='br-int',has_traffic_filtering=True,id=36c5fc9a-1100-48de-80da-1188909df5e5,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c5fc9a-11') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG nova.objects.instance [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b633bf8-609f-4d56-86f6-b96218435aa6 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG nova.objects.base [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Object Instance<2b633bf8-609f-4d56-86f6-b96218435aa6> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] End _get_guest_xml xml=<domain type="kvm">
Dec 06 13:11:30 user nova-compute[75247]:   <uuid>2b633bf8-609f-4d56-86f6-b96218435aa6</uuid>
Dec 06 13:11:30 user nova-compute[75247]:   <name>instance-0000002f</name>
Dec 06 13:11:30 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 13:11:30 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 13:11:30 user nova-compute[75247]:   <metadata>
Dec 06 13:11:30 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 13:11:30 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 13:11:30 user nova-compute[75247]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1297482927</nova:name>
Dec 06 13:11:30 user nova-compute[75247]:       <nova:creationTime>2023-12-06 13:11:29</nova:creationTime>
Dec 06 13:11:30 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 13:11:30 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 13:11:30 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 13:11:30 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 13:11:30 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 13:11:30 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 13:11:30 user nova-compute[75247]:       </nova:flavor>
Dec 06 13:11:30 user nova-compute[75247]:       <nova:owner>
Dec 06 13:11:30 user nova-compute[75247]:         <nova:user uuid="6e50e8cc91ca4ff88ebfa0b2888699d5">tempest-AttachVolumeShelveTestJSON-2058750591-project-member</nova:user>
Dec 06 13:11:30 user nova-compute[75247]:         <nova:project uuid="9f58adbd4d004a44b37a0e0922da5aa3">tempest-AttachVolumeShelveTestJSON-2058750591</nova:project>
Dec 06 13:11:30 user nova-compute[75247]:       </nova:owner>
Dec 06 13:11:30 user nova-compute[75247]:       <nova:root type="image" uuid="dfe37ca5-4d8d-4813-8ae5-48472191c5f3"/>
Dec 06 13:11:30 user nova-compute[75247]:       <nova:ports>
Dec 06 13:11:30 user nova-compute[75247]:         <nova:port uuid="36c5fc9a-1100-48de-80da-1188909df5e5">
Dec 06 13:11:30 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 06 13:11:30 user nova-compute[75247]:         </nova:port>
Dec 06 13:11:30 user nova-compute[75247]:       </nova:ports>
Dec 06 13:11:30 user nova-compute[75247]:     </nova:instance>
Dec 06 13:11:30 user nova-compute[75247]:   </metadata>
Dec 06 13:11:30 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 13:11:30 user nova-compute[75247]:     <system>
Dec 06 13:11:30 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 13:11:30 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 13:11:30 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 13:11:30 user nova-compute[75247]:       <entry name="serial">2b633bf8-609f-4d56-86f6-b96218435aa6</entry>
Dec 06 13:11:30 user nova-compute[75247]:       <entry name="uuid">2b633bf8-609f-4d56-86f6-b96218435aa6</entry>
Dec 06 13:11:30 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 13:11:30 user nova-compute[75247]:     </system>
Dec 06 13:11:30 user nova-compute[75247]:   </sysinfo>
Dec 06 13:11:30 user nova-compute[75247]:   <os>
Dec 06 13:11:30 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 13:11:30 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 13:11:30 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 13:11:30 user nova-compute[75247]:   </os>
Dec 06 13:11:30 user nova-compute[75247]:   <features>
Dec 06 13:11:30 user nova-compute[75247]:     <acpi/>
Dec 06 13:11:30 user nova-compute[75247]:     <apic/>
Dec 06 13:11:30 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 13:11:30 user nova-compute[75247]:   </features>
Dec 06 13:11:30 user nova-compute[75247]:   <clock offset="utc">
Dec 06 13:11:30 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 13:11:30 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 13:11:30 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 13:11:30 user nova-compute[75247]:   </clock>
Dec 06 13:11:30 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 13:11:30 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 13:11:30 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 13:11:30 user nova-compute[75247]:   </cpu>
Dec 06 13:11:30 user nova-compute[75247]:   <devices>
Dec 06 13:11:30 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 13:11:30 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 13:11:30 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk"/>
Dec 06 13:11:30 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 13:11:30 user nova-compute[75247]:     </disk>
Dec 06 13:11:30 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 13:11:30 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:11:30 user nova-compute[75247]:       <source dev="/dev/sdc"/>
Dec 06 13:11:30 user nova-compute[75247]:       <target dev="vdc" bus="virtio"/>
Dec 06 13:11:30 user nova-compute[75247]:       <serial>8c6162bf-f14e-43fd-b8c3-d096887cb462</serial>
Dec 06 13:11:30 user nova-compute[75247]:     </disk>
Dec 06 13:11:30 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 13:11:30 user nova-compute[75247]:       <mac address="fa:16:3e:91:16:cf"/>
Dec 06 13:11:30 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:11:30 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 13:11:30 user nova-compute[75247]:       <target dev="tap36c5fc9a-11"/>
Dec 06 13:11:30 user nova-compute[75247]:     </interface>
Dec 06 13:11:30 user nova-compute[75247]:     <serial type="pty">
Dec 06 13:11:30 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/console.log" append="off"/>
Dec 06 13:11:30 user nova-compute[75247]:     </serial>
Dec 06 13:11:30 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 13:11:30 user nova-compute[75247]:     <video>
Dec 06 13:11:30 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:11:30 user nova-compute[75247]:     </video>
Dec 06 13:11:30 user nova-compute[75247]:     <rng model="virtio">
Dec 06 13:11:30 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 13:11:30 user nova-compute[75247]:     </rng>
Dec 06 13:11:30 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 13:11:30 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 13:11:30 user nova-compute[75247]:       <stats period="10"/>
Dec 06 13:11:30 user nova-compute[75247]:     </memballoon>
Dec 06 13:11:30 user nova-compute[75247]:   </devices>
Dec 06 13:11:30 user nova-compute[75247]: </domain>
Dec 06 13:11:30 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T13:07:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1297482927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1297482927',id=47,image_ref='dfe37ca5-4d8d-4813-8ae5-48472191c5f3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1683071845',keypairs=<?>,launch_index=0,launched_at=2023-12-06T13:07:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9f58adbd4d004a44b37a0e0922da5aa3',ramdisk_id='',reservation_id='r-lcgwlr3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2058750591',owner_user_name='tempest-AttachVolumeShelveTestJSON-2058750591-project-member',shelved_at='2023-12-06T13:09:23.589240',shelved_host='user',shelved_image_id='dfe37ca5-4d8d-4813-8ae5-48472191c5f3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:11:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e50e8cc91ca4ff88ebfa0b2888699d5',uuid=2b633bf8-609f-4d56-86f6-b96218435aa6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "36c5fc9a-1100-48de-80da-1188909df5e5", "address": "fa:16:3e:91:16:cf", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c5fc9a-11", "ovs_interfaceid": "36c5fc9a-1100-48de-80da-1188909df5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Converting VIF {"id": "36c5fc9a-1100-48de-80da-1188909df5e5", "address": "fa:16:3e:91:16:cf", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c5fc9a-11", "ovs_interfaceid": "36c5fc9a-1100-48de-80da-1188909df5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:16:cf,bridge_name='br-int',has_traffic_filtering=True,id=36c5fc9a-1100-48de-80da-1188909df5e5,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c5fc9a-11') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG os_vif [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:16:cf,bridge_name='br-int',has_traffic_filtering=True,id=36c5fc9a-1100-48de-80da-1188909df5e5,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c5fc9a-11') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4af5a21-e4d6-56fe-afaf-a9a9120bade8', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36c5fc9a-11, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36c5fc9a-11, col_values=(('qos', UUID('97dff1a8-6acc-4fe8-a58b-352f99b2098c')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36c5fc9a-11, col_values=(('external_ids', {'iface-id': '36c5fc9a-1100-48de-80da-1188909df5e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:16:cf', 'vm-uuid': '2b633bf8-609f-4d56-86f6-b96218435aa6'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:30 user nova-compute[75247]: INFO os_vif [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:16:cf,bridge_name='br-int',has_traffic_filtering=True,id=36c5fc9a-1100-48de-80da-1188909df5e5,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c5fc9a-11')
Dec 06 13:11:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:11:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] No VIF found with MAC fa:16:3e:91:16:cf, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 13:11:31 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:11:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-c0c5e404-2023-49fe-bd19-493f1ca7c6de req-d90ce0ea-0056-4459-af15-8e97d6d41802 service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Received event network-vif-plugged-36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:11:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c0c5e404-2023-49fe-bd19-493f1ca7c6de req-d90ce0ea-0056-4459-af15-8e97d6d41802 service nova] Acquiring lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:11:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c0c5e404-2023-49fe-bd19-493f1ca7c6de req-d90ce0ea-0056-4459-af15-8e97d6d41802 service nova] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:11:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c0c5e404-2023-49fe-bd19-493f1ca7c6de req-d90ce0ea-0056-4459-af15-8e97d6d41802 service nova] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:11:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-c0c5e404-2023-49fe-bd19-493f1ca7c6de req-d90ce0ea-0056-4459-af15-8e97d6d41802 service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] No waiting events found dispatching network-vif-plugged-36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:11:32 user nova-compute[75247]: WARNING nova.compute.manager [req-c0c5e404-2023-49fe-bd19-493f1ca7c6de req-d90ce0ea-0056-4459-af15-8e97d6d41802 service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Received unexpected event network-vif-plugged-36c5fc9a-1100-48de-80da-1188909df5e5 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 06 13:11:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:32 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:11:32 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:11:32 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:11:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:11:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:11:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:11:32 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:11:33 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:11:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:11:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:11:33 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:11:33 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:11:33 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:11:33 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:11:33 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=8858MB free_disk=24.97360610961914GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:11:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:11:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:11:34 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance df690bb9-fb1d-4a67-b9c8-785425c96116 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:11:34 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 2b633bf8-609f-4d56-86f6-b96218435aa6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:11:34 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:11:34 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:11:34 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Refreshing inventories for resource provider d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 13:11:34 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Updating ProviderTree inventory for provider d326b140-3450-4409-964c-9eafc6cc025d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 13:11:34 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Updating inventory in ProviderTree for provider d326b140-3450-4409-964c-9eafc6cc025d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 13:11:34 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Refreshing aggregate associations for resource provider d326b140-3450-4409-964c-9eafc6cc025d, aggregates: None {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 13:11:34 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Refreshing trait associations for resource provider d326b140-3450-4409-964c-9eafc6cc025d, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 13:11:34 user nova-compute[75247]: DEBUG nova.compute.manager [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 13:11:34 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 13:11:34 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Instance spawned successfully.
Dec 06 13:11:34 user nova-compute[75247]: DEBUG nova.compute.manager [req-643574ea-741e-49f2-b0d1-0a1f4a636eb3 req-c4475c55-3702-4ffd-8f07-473725fbb388 service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Received event network-vif-plugged-36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:11:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-643574ea-741e-49f2-b0d1-0a1f4a636eb3 req-c4475c55-3702-4ffd-8f07-473725fbb388 service nova] Acquiring lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:11:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-643574ea-741e-49f2-b0d1-0a1f4a636eb3 req-c4475c55-3702-4ffd-8f07-473725fbb388 service nova] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:11:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-643574ea-741e-49f2-b0d1-0a1f4a636eb3 req-c4475c55-3702-4ffd-8f07-473725fbb388 service nova] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:11:34 user nova-compute[75247]: DEBUG nova.compute.manager [req-643574ea-741e-49f2-b0d1-0a1f4a636eb3 req-c4475c55-3702-4ffd-8f07-473725fbb388 service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] No waiting events found dispatching network-vif-plugged-36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:11:34 user nova-compute[75247]: WARNING nova.compute.manager [req-643574ea-741e-49f2-b0d1-0a1f4a636eb3 req-c4475c55-3702-4ffd-8f07-473725fbb388 service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Received unexpected event network-vif-plugged-36c5fc9a-1100-48de-80da-1188909df5e5 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 06 13:11:34 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:11:34 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:11:34 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:11:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.586s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:11:34 user nova-compute[75247]: DEBUG nova.compute.manager [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 13:11:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-63ebaf91-4c8d-4a4d-8ded-e31332fdd030 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 22.759s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:11:34 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:11:34 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75247) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 13:11:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:35 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:11:35 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:11:36 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:11:36 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:11:36 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 13:11:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:11:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:11:37 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 13:11:37 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lazy-loading 'info_cache' on Instance uuid 2b633bf8-609f-4d56-86f6-b96218435aa6 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:11:37 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Updating instance_info_cache with network_info: [{"id": "36c5fc9a-1100-48de-80da-1188909df5e5", "address": "fa:16:3e:91:16:cf", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c5fc9a-11", "ovs_interfaceid": "36c5fc9a-1100-48de-80da-1188909df5e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:11:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:11:37 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 13:11:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:40 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:11:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:45 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:11:45 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Cleaning up deleted instances {{(pid=75247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 13:11:45 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] There are 0 instances to clean {{(pid=75247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 13:11:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:11:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Acquiring lock "637e64f2-3377-47ce-9891-ea9d9f3b6729" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG nova.compute.manager [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 13:12:10 user nova-compute[75247]: INFO nova.compute.claims [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Claim successful on node user
Dec 06 13:12:10 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.240s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG nova.compute.manager [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG nova.compute.manager [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG nova.network.neutron [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 13:12:10 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 13:12:10 user nova-compute[75247]: DEBUG nova.compute.manager [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG nova.policy [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '830024d5b05e4b5aa6d6d9674cf661e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05e39382f114be6a2c762890523f4b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 13:12:10 user nova-compute[75247]: INFO nova.virt.block_device [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Booting with volume 710dc4b0-99e7-4bd7-8695-2ac4eddf322c at /dev/vda
Dec 06 13:12:10 user nova-compute[75247]: DEBUG os_brick.utils [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1851841d-89ec-4ab3-9dda-42de9bbf7d0b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7538cb-82b8-4865-9a0a-c111854850d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2adc4c-dbdf-4426-ad4e-035d7df52be3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[459e1f9b-e05e-4839-a649-94b73f4c53dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:12:10 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 13:12:10 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ab64dc-96a2-4a21-a41a-6be6f784088f]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG os_brick.utils [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:12:10 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Updating existing volume attachment record: 5aabed56-7df2-47f2-b6d3-ee422f381d7c {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 13:12:11 user nova-compute[75247]: DEBUG nova.network.neutron [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Successfully created port: 7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 13:12:12 user nova-compute[75247]: DEBUG nova.network.neutron [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Successfully updated port: 7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 13:12:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Acquiring lock "refresh_cache-637e64f2-3377-47ce-9891-ea9d9f3b6729" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:12:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Acquired lock "refresh_cache-637e64f2-3377-47ce-9891-ea9d9f3b6729" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:12:12 user nova-compute[75247]: DEBUG nova.network.neutron [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 13:12:12 user nova-compute[75247]: DEBUG nova.compute.manager [req-ebe618f4-4d17-4af9-8107-666545cc3c22 req-36af1999-abd2-4220-a187-f35c223e4636 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Received event network-changed-7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:12:12 user nova-compute[75247]: DEBUG nova.compute.manager [req-ebe618f4-4d17-4af9-8107-666545cc3c22 req-36af1999-abd2-4220-a187-f35c223e4636 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Refreshing instance network info cache due to event network-changed-7110c508-ba09-4d19-bf5f-e2d73c988c28. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:12:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ebe618f4-4d17-4af9-8107-666545cc3c22 req-36af1999-abd2-4220-a187-f35c223e4636 service nova] Acquiring lock "refresh_cache-637e64f2-3377-47ce-9891-ea9d9f3b6729" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:12:12 user nova-compute[75247]: DEBUG nova.network.neutron [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 13:12:12 user nova-compute[75247]: DEBUG nova.network.neutron [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Updating instance_info_cache with network_info: [{"id": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "address": "fa:16:3e:dd:1a:11", "network": {"id": "7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1998461599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c05e39382f114be6a2c762890523f4b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7110c508-ba", "ovs_interfaceid": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:12:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Releasing lock "refresh_cache-637e64f2-3377-47ce-9891-ea9d9f3b6729" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:12:12 user nova-compute[75247]: DEBUG nova.compute.manager [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Instance network_info: |[{"id": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "address": "fa:16:3e:dd:1a:11", "network": {"id": "7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1998461599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c05e39382f114be6a2c762890523f4b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7110c508-ba", "ovs_interfaceid": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 13:12:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ebe618f4-4d17-4af9-8107-666545cc3c22 req-36af1999-abd2-4220-a187-f35c223e4636 service nova] Acquired lock "refresh_cache-637e64f2-3377-47ce-9891-ea9d9f3b6729" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:12:12 user nova-compute[75247]: DEBUG nova.network.neutron [req-ebe618f4-4d17-4af9-8107-666545cc3c22 req-36af1999-abd2-4220-a187-f35c223e4636 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Refreshing network info cache for port 7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:12:12 user nova-compute[75247]: DEBUG nova.network.neutron [req-ebe618f4-4d17-4af9-8107-666545cc3c22 req-36af1999-abd2-4220-a187-f35c223e4636 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Updated VIF entry in instance network info cache for port 7110c508-ba09-4d19-bf5f-e2d73c988c28. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:12:12 user nova-compute[75247]: DEBUG nova.network.neutron [req-ebe618f4-4d17-4af9-8107-666545cc3c22 req-36af1999-abd2-4220-a187-f35c223e4636 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Updating instance_info_cache with network_info: [{"id": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "address": "fa:16:3e:dd:1a:11", "network": {"id": "7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1998461599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c05e39382f114be6a2c762890523f4b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7110c508-ba", "ovs_interfaceid": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:12:12 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ebe618f4-4d17-4af9-8107-666545cc3c22 req-36af1999-abd2-4220-a187-f35c223e4636 service nova] Releasing lock "refresh_cache-637e64f2-3377-47ce-9891-ea9d9f3b6729" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:12:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG nova.compute.manager [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 13:12:20 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Creating image(s)
Dec 06 13:12:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Did not create local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Ensure instance console log exists: /opt/stack/data/nova/instances/637e64f2-3377-47ce-9891-ea9d9f3b6729/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Start _get_guest_xml network_info=[{"id": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "address": "fa:16:3e:dd:1a:11", "network": {"id": "7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1998461599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c05e39382f114be6a2c762890523f4b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7110c508-ba", "ovs_interfaceid": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '5aabed56-7df2-47f2-b6d3-ee422f381d7c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDgEaVNI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '637e64f2-3377-47ce-9891-ea9d9f3b6729', 'attached_at': '', 'detached_at': '', 'volume_id': '710dc4b0-99e7-4bd7-8695-2ac4eddf322c', 'serial': '710dc4b0-99e7-4bd7-8695-2ac4eddf322c'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 13:12:20 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:12:20 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:12:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDgEaVNI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:12:20 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:12:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:12:20 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:12:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:12:20 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[52435a22-abdf-478a-b37c-ff43a2b40a0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 13:12:20 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[98af296e-956c-4994-aa93-0a98fe2bc839]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c] added
Dec 06 13:12:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9d75b2-5283-4526-9bdd-c11237a20b49]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[119f644b-7522-4f22-9e9b-e57d103a2cc6]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cDgEaVNI {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cDgEaVNI" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ae0e14-73a0-4452-accb-0cd7bc328f68]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cDgEaVNI'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabd91bb-7e51-49e2-8def-40f4992c5c9c]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdc079c-cc3a-488b-a38b-e9c01e6ec79f]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:12:20 user nova-compute[75247]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 (non-flash)
Dec 06 13:12:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:12:20 user nova-compute[75247]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 (non-flash)
Dec 06 13:12:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f77f28-e251-4e0d-a0e5-5cec693db7eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c, portal: 172.16.0.220,3260]
Dec 06 13:12:20 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c, portal: 172.16.0.220,3260] successful.
Dec 06 13:12:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7519c943-ee79-47e3-90cc-25a069644059]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdaaa497-3965-4ea9-bc86-dd9a2c760271]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:12:20 user nova-compute[75247]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 (non-flash)
Dec 06 13:12:20 user nova-compute[75247]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)
Dec 06 13:12:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:12:20 user nova-compute[75247]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 (non-flash)
Dec 06 13:12:20 user nova-compute[75247]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)
Dec 06 13:12:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] HCTL ('35', '-', '-', 0) found on session 60 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0511240b-37f6-4f16-99f4-df84e78da9a7]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Searching for a device in session 60 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 13:12:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDgEaVNI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 13:12:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:12:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26632653938313666', 'path': '/dev/sdd'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:12:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632653938313666', 'path': '/dev/sdd'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 13:12:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-585733721',display_name='tempest-TestShelveInstance-server-585733721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-585733721',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6bCNIz5q4P0bc7HSiL9tc3LJpv7C6/FKkLh94ST7t6mQK9UVwAkT4qnr/0qZdIPWPutLB+0ikdlsUQLbRuaqB4YyYQlbU4kFnfiRHSFeOt/3VIAmpE/aFHmv7lchH0vQ==',key_name='tempest-TestShelveInstance-816568645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c05e39382f114be6a2c762890523f4b1',ramdisk_id='',reservation_id='r-nnlrt39q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1636467499',owner_user_name='tempest-TestShelveInstance-1636467499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:12:11Z,user_data=None,user_id='830024d5b05e4b5aa6d6d9674cf661e2',uuid=637e64f2-3377-47ce-9891-ea9d9f3b6729,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "address": "fa:16:3e:dd:1a:11", "network": {"id": "7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1998461599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c05e39382f114be6a2c762890523f4b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7110c508-ba", "ovs_interfaceid": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 13:12:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Converting VIF {"id": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "address": "fa:16:3e:dd:1a:11", "network": {"id": "7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1998461599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c05e39382f114be6a2c762890523f4b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7110c508-ba", "ovs_interfaceid": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:12:21 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=7110c508-ba09-4d19-bf5f-e2d73c988c28,network=Network(7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7110c508-ba') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:12:21 user nova-compute[75247]: DEBUG nova.objects.instance [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lazy-loading 'pci_devices' on Instance uuid 637e64f2-3377-47ce-9891-ea9d9f3b6729 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:12:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] End _get_guest_xml xml=<domain type="kvm">
Dec 06 13:12:22 user nova-compute[75247]:   <uuid>637e64f2-3377-47ce-9891-ea9d9f3b6729</uuid>
Dec 06 13:12:22 user nova-compute[75247]:   <name>instance-00000031</name>
Dec 06 13:12:22 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 13:12:22 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 13:12:22 user nova-compute[75247]:   <metadata>
Dec 06 13:12:22 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 13:12:22 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 13:12:22 user nova-compute[75247]:       <nova:name>tempest-TestShelveInstance-server-585733721</nova:name>
Dec 06 13:12:22 user nova-compute[75247]:       <nova:creationTime>2023-12-06 13:12:20</nova:creationTime>
Dec 06 13:12:22 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 13:12:22 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 13:12:22 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 13:12:22 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 13:12:22 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 13:12:22 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 13:12:22 user nova-compute[75247]:       </nova:flavor>
Dec 06 13:12:22 user nova-compute[75247]:       <nova:owner>
Dec 06 13:12:22 user nova-compute[75247]:         <nova:user uuid="830024d5b05e4b5aa6d6d9674cf661e2">tempest-TestShelveInstance-1636467499-project-member</nova:user>
Dec 06 13:12:22 user nova-compute[75247]:         <nova:project uuid="c05e39382f114be6a2c762890523f4b1">tempest-TestShelveInstance-1636467499</nova:project>
Dec 06 13:12:22 user nova-compute[75247]:       </nova:owner>
Dec 06 13:12:22 user nova-compute[75247]:       <nova:ports>
Dec 06 13:12:22 user nova-compute[75247]:         <nova:port uuid="7110c508-ba09-4d19-bf5f-e2d73c988c28">
Dec 06 13:12:22 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 13:12:22 user nova-compute[75247]:         </nova:port>
Dec 06 13:12:22 user nova-compute[75247]:       </nova:ports>
Dec 06 13:12:22 user nova-compute[75247]:     </nova:instance>
Dec 06 13:12:22 user nova-compute[75247]:   </metadata>
Dec 06 13:12:22 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 13:12:22 user nova-compute[75247]:     <system>
Dec 06 13:12:22 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 13:12:22 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 13:12:22 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 13:12:22 user nova-compute[75247]:       <entry name="serial">637e64f2-3377-47ce-9891-ea9d9f3b6729</entry>
Dec 06 13:12:22 user nova-compute[75247]:       <entry name="uuid">637e64f2-3377-47ce-9891-ea9d9f3b6729</entry>
Dec 06 13:12:22 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 13:12:22 user nova-compute[75247]:     </system>
Dec 06 13:12:22 user nova-compute[75247]:   </sysinfo>
Dec 06 13:12:22 user nova-compute[75247]:   <os>
Dec 06 13:12:22 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 13:12:22 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 13:12:22 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 13:12:22 user nova-compute[75247]:   </os>
Dec 06 13:12:22 user nova-compute[75247]:   <features>
Dec 06 13:12:22 user nova-compute[75247]:     <acpi/>
Dec 06 13:12:22 user nova-compute[75247]:     <apic/>
Dec 06 13:12:22 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 13:12:22 user nova-compute[75247]:   </features>
Dec 06 13:12:22 user nova-compute[75247]:   <clock offset="utc">
Dec 06 13:12:22 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 13:12:22 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 13:12:22 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 13:12:22 user nova-compute[75247]:   </clock>
Dec 06 13:12:22 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 13:12:22 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 13:12:22 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 13:12:22 user nova-compute[75247]:   </cpu>
Dec 06 13:12:22 user nova-compute[75247]:   <devices>
Dec 06 13:12:22 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 13:12:22 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:12:22 user nova-compute[75247]:       <source dev="/dev/sdd"/>
Dec 06 13:12:22 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 13:12:22 user nova-compute[75247]:       <serial>710dc4b0-99e7-4bd7-8695-2ac4eddf322c</serial>
Dec 06 13:12:22 user nova-compute[75247]:     </disk>
Dec 06 13:12:22 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 13:12:22 user nova-compute[75247]:       <mac address="fa:16:3e:dd:1a:11"/>
Dec 06 13:12:22 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:12:22 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 13:12:22 user nova-compute[75247]:       <target dev="tap7110c508-ba"/>
Dec 06 13:12:22 user nova-compute[75247]:     </interface>
Dec 06 13:12:22 user nova-compute[75247]:     <serial type="pty">
Dec 06 13:12:22 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/637e64f2-3377-47ce-9891-ea9d9f3b6729/console.log" append="off"/>
Dec 06 13:12:22 user nova-compute[75247]:     </serial>
Dec 06 13:12:22 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 13:12:22 user nova-compute[75247]:     <video>
Dec 06 13:12:22 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:12:22 user nova-compute[75247]:     </video>
Dec 06 13:12:22 user nova-compute[75247]:     <rng model="virtio">
Dec 06 13:12:22 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 13:12:22 user nova-compute[75247]:     </rng>
Dec 06 13:12:22 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 13:12:22 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 13:12:22 user nova-compute[75247]:       <stats period="10"/>
Dec 06 13:12:22 user nova-compute[75247]:     </memballoon>
Dec 06 13:12:22 user nova-compute[75247]:   </devices>
Dec 06 13:12:22 user nova-compute[75247]: </domain>
Dec 06 13:12:22 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 13:12:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-585733721',display_name='tempest-TestShelveInstance-server-585733721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-585733721',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6bCNIz5q4P0bc7HSiL9tc3LJpv7C6/FKkLh94ST7t6mQK9UVwAkT4qnr/0qZdIPWPutLB+0ikdlsUQLbRuaqB4YyYQlbU4kFnfiRHSFeOt/3VIAmpE/aFHmv7lchH0vQ==',key_name='tempest-TestShelveInstance-816568645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c05e39382f114be6a2c762890523f4b1',ramdisk_id='',reservation_id='r-nnlrt39q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1636467499',owner_user_name='tempest-TestShelveInstance-1636467499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:12:11Z,user_data=None,user_id='830024d5b05e4b5aa6d6d9674cf661e2',uuid=637e64f2-3377-47ce-9891-ea9d9f3b6729,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "address": "fa:16:3e:dd:1a:11", "network": {"id": "7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1998461599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c05e39382f114be6a2c762890523f4b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7110c508-ba", "ovs_interfaceid": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 13:12:22 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Converting VIF {"id": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "address": "fa:16:3e:dd:1a:11", "network": {"id": "7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1998461599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c05e39382f114be6a2c762890523f4b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7110c508-ba", "ovs_interfaceid": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:12:22 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=7110c508-ba09-4d19-bf5f-e2d73c988c28,network=Network(7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7110c508-ba') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:12:22 user nova-compute[75247]: DEBUG os_vif [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=7110c508-ba09-4d19-bf5f-e2d73c988c28,network=Network(7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7110c508-ba') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 13:12:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:12:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 13:12:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0adbc3d0-74ff-5175-82f4-2409125fcc5d', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:12:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:12:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7110c508-ba, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:12:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7110c508-ba, col_values=(('qos', UUID('814b9e77-c5a4-4d58-a9c7-c41824c64020')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:12:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7110c508-ba, col_values=(('external_ids', {'iface-id': '7110c508-ba09-4d19-bf5f-e2d73c988c28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:1a:11', 'vm-uuid': '637e64f2-3377-47ce-9891-ea9d9f3b6729'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:12:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:12:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:22 user nova-compute[75247]: INFO os_vif [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=7110c508-ba09-4d19-bf5f-e2d73c988c28,network=Network(7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7110c508-ba')
Dec 06 13:12:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:12:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] No VIF found with MAC fa:16:3e:dd:1a:11, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 13:12:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-11ade502-81de-4729-9f48-8275aa1400dc req-8e70871b-05e9-4177-8abd-0090d511a0d0 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Received event network-vif-plugged-7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:12:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-11ade502-81de-4729-9f48-8275aa1400dc req-8e70871b-05e9-4177-8abd-0090d511a0d0 service nova] Acquiring lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:12:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-11ade502-81de-4729-9f48-8275aa1400dc req-8e70871b-05e9-4177-8abd-0090d511a0d0 service nova] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:12:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-11ade502-81de-4729-9f48-8275aa1400dc req-8e70871b-05e9-4177-8abd-0090d511a0d0 service nova] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:12:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-11ade502-81de-4729-9f48-8275aa1400dc req-8e70871b-05e9-4177-8abd-0090d511a0d0 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] No waiting events found dispatching network-vif-plugged-7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:12:23 user nova-compute[75247]: WARNING nova.compute.manager [req-11ade502-81de-4729-9f48-8275aa1400dc req-8e70871b-05e9-4177-8abd-0090d511a0d0 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Received unexpected event network-vif-plugged-7110c508-ba09-4d19-bf5f-e2d73c988c28 for instance with vm_state building and task_state spawning.
Dec 06 13:12:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:25 user nova-compute[75247]: DEBUG nova.compute.manager [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 13:12:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 13:12:25 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Instance spawned successfully.
Dec 06 13:12:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 13:12:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:12:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:12:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:12:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:12:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:12:25 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:12:25 user nova-compute[75247]: INFO nova.compute.manager [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Took 4.88 seconds to spawn the instance on the hypervisor.
Dec 06 13:12:25 user nova-compute[75247]: DEBUG nova.compute.manager [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 13:12:25 user nova-compute[75247]: INFO nova.compute.manager [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Took 15.28 seconds to build instance.
Dec 06 13:12:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-93ad5324-ce4e-48f6-9890-bba0e8914051 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.382s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:12:25 user nova-compute[75247]: DEBUG nova.compute.manager [req-edb6266e-6736-4ded-9f5e-040592fabd83 req-82fd8c8d-df07-4ac6-8701-a0bf49d6b1bb service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Received event network-vif-plugged-7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:12:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-edb6266e-6736-4ded-9f5e-040592fabd83 req-82fd8c8d-df07-4ac6-8701-a0bf49d6b1bb service nova] Acquiring lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:12:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-edb6266e-6736-4ded-9f5e-040592fabd83 req-82fd8c8d-df07-4ac6-8701-a0bf49d6b1bb service nova] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:12:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-edb6266e-6736-4ded-9f5e-040592fabd83 req-82fd8c8d-df07-4ac6-8701-a0bf49d6b1bb service nova] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:12:25 user nova-compute[75247]: DEBUG nova.compute.manager [req-edb6266e-6736-4ded-9f5e-040592fabd83 req-82fd8c8d-df07-4ac6-8701-a0bf49d6b1bb service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] No waiting events found dispatching network-vif-plugged-7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:12:25 user nova-compute[75247]: WARNING nova.compute.manager [req-edb6266e-6736-4ded-9f5e-040592fabd83 req-82fd8c8d-df07-4ac6-8701-a0bf49d6b1bb service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Received unexpected event network-vif-plugged-7110c508-ba09-4d19-bf5f-e2d73c988c28 for instance with vm_state active and task_state None.
Dec 06 13:12:26 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:12:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:27 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:12:28 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:12:28 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:12:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-6984e5b3-43eb-4d6f-a6fd-da5fec968c53 req-e3da9c19-103c-4272-af2a-2677a5a64936 service nova] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Received event network-changed-f114e05d-020b-453c-83ad-15fc56b9f551 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:12:32 user nova-compute[75247]: DEBUG nova.compute.manager [req-6984e5b3-43eb-4d6f-a6fd-da5fec968c53 req-e3da9c19-103c-4272-af2a-2677a5a64936 service nova] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Refreshing instance network info cache due to event network-changed-f114e05d-020b-453c-83ad-15fc56b9f551. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:12:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6984e5b3-43eb-4d6f-a6fd-da5fec968c53 req-e3da9c19-103c-4272-af2a-2677a5a64936 service nova] Acquiring lock "refresh_cache-df690bb9-fb1d-4a67-b9c8-785425c96116" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:12:32 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6984e5b3-43eb-4d6f-a6fd-da5fec968c53 req-e3da9c19-103c-4272-af2a-2677a5a64936 service nova] Acquired lock "refresh_cache-df690bb9-fb1d-4a67-b9c8-785425c96116" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:12:32 user nova-compute[75247]: DEBUG nova.network.neutron [req-6984e5b3-43eb-4d6f-a6fd-da5fec968c53 req-e3da9c19-103c-4272-af2a-2677a5a64936 service nova] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Refreshing network info cache for port f114e05d-020b-453c-83ad-15fc56b9f551 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:12:33 user nova-compute[75247]: DEBUG nova.network.neutron [req-6984e5b3-43eb-4d6f-a6fd-da5fec968c53 req-e3da9c19-103c-4272-af2a-2677a5a64936 service nova] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Updated VIF entry in instance network info cache for port f114e05d-020b-453c-83ad-15fc56b9f551. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:12:33 user nova-compute[75247]: DEBUG nova.network.neutron [req-6984e5b3-43eb-4d6f-a6fd-da5fec968c53 req-e3da9c19-103c-4272-af2a-2677a5a64936 service nova] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Updating instance_info_cache with network_info: [{"id": "f114e05d-020b-453c-83ad-15fc56b9f551", "address": "fa:16:3e:b3:af:b9", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf114e05d-02", "ovs_interfaceid": "f114e05d-020b-453c-83ad-15fc56b9f551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:12:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-6984e5b3-43eb-4d6f-a6fd-da5fec968c53 req-e3da9c19-103c-4272-af2a-2677a5a64936 service nova] Releasing lock "refresh_cache-df690bb9-fb1d-4a67-b9c8-785425c96116" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:12:33 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:12:33 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:12:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "df690bb9-fb1d-4a67-b9c8-785425c96116" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:12:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "df690bb9-fb1d-4a67-b9c8-785425c96116" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:12:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "df690bb9-fb1d-4a67-b9c8-785425c96116-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:12:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "df690bb9-fb1d-4a67-b9c8-785425c96116-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:12:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "df690bb9-fb1d-4a67-b9c8-785425c96116-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:12:34 user nova-compute[75247]: INFO nova.compute.manager [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Terminating instance
Dec 06 13:12:34 user nova-compute[75247]: DEBUG nova.compute.manager [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 13:12:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:34 user nova-compute[75247]: DEBUG nova.compute.manager [req-bbf5caec-efc4-4823-b1d2-b1300cbe8f7e req-d8212f92-0c62-490f-b8d8-0ccd42c6678e service nova] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Received event network-vif-unplugged-f114e05d-020b-453c-83ad-15fc56b9f551 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:12:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bbf5caec-efc4-4823-b1d2-b1300cbe8f7e req-d8212f92-0c62-490f-b8d8-0ccd42c6678e service nova] Acquiring lock "df690bb9-fb1d-4a67-b9c8-785425c96116-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:12:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bbf5caec-efc4-4823-b1d2-b1300cbe8f7e req-d8212f92-0c62-490f-b8d8-0ccd42c6678e service nova] Lock "df690bb9-fb1d-4a67-b9c8-785425c96116-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:12:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bbf5caec-efc4-4823-b1d2-b1300cbe8f7e req-d8212f92-0c62-490f-b8d8-0ccd42c6678e service nova] Lock "df690bb9-fb1d-4a67-b9c8-785425c96116-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:12:34 user nova-compute[75247]: DEBUG nova.compute.manager [req-bbf5caec-efc4-4823-b1d2-b1300cbe8f7e req-d8212f92-0c62-490f-b8d8-0ccd42c6678e service nova] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] No waiting events found dispatching network-vif-unplugged-f114e05d-020b-453c-83ad-15fc56b9f551 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:12:34 user nova-compute[75247]: DEBUG nova.compute.manager [req-bbf5caec-efc4-4823-b1d2-b1300cbe8f7e req-d8212f92-0c62-490f-b8d8-0ccd42c6678e service nova] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Received event network-vif-unplugged-f114e05d-020b-453c-83ad-15fc56b9f551 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 13:12:34 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:12:34 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:12:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:12:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:12:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:12:34 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:12:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:35 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Instance destroyed successfully.
Dec 06 13:12:35 user nova-compute[75247]: DEBUG nova.objects.instance [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lazy-loading 'resources' on Instance uuid df690bb9-fb1d-4a67-b9c8-785425c96116 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:10:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1497396733',display_name='tempest-TestVolumeBootPattern-server-1497396733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1497396733',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+e3XTLfVN8C3itmblwy09HtnE6ODmf3LMeZLWfbnBfl5D2ms/C+dYrJrc6lCBYNrZ/pLuupAxLsGv6ZOwhXojQ4RlmELXbFB3bv70Zc31yz9kRGkDkIlpeboSBmcUYgg==',key_name='tempest-TestVolumeBootPattern-1199968839',keypairs=<?>,launch_index=0,launched_at=2023-12-06T13:10:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9493d9b0b1024cea9a550e2a42c1e6a1',ramdisk_id='',reservation_id='r-bspzmxhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2088852773',owner_user_name='tempest-TestVolumeBootPattern-2088852773-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T13:10:59Z,user_data=None,user_id='016714f7502b4a8fa12ed0ce6644c5fc',uuid=df690bb9-fb1d-4a67-b9c8-785425c96116,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f114e05d-020b-453c-83ad-15fc56b9f551", "address": "fa:16:3e:b3:af:b9", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf114e05d-02", "ovs_interfaceid": "f114e05d-020b-453c-83ad-15fc56b9f551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converting VIF {"id": "f114e05d-020b-453c-83ad-15fc56b9f551", "address": "fa:16:3e:b3:af:b9", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf114e05d-02", "ovs_interfaceid": "f114e05d-020b-453c-83ad-15fc56b9f551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:af:b9,bridge_name='br-int',has_traffic_filtering=True,id=f114e05d-020b-453c-83ad-15fc56b9f551,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf114e05d-02') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG os_vif [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:af:b9,bridge_name='br-int',has_traffic_filtering=True,id=f114e05d-020b-453c-83ad-15fc56b9f551,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf114e05d-02') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf114e05d-02, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=26ff3c13-7fb4-4a66-b845-511eccd8ac88) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:12:35 user nova-compute[75247]: INFO os_vif [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:af:b9,bridge_name='br-int',has_traffic_filtering=True,id=f114e05d-020b-453c-83ad-15fc56b9f551,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf114e05d-02')
Dec 06 13:12:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zldIYVrk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:12:35 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:12:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8d1dac-c21d-4303-81bd-d36656878e65]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 13:12:35 user nova-compute[75247]: No targets found.
Dec 06 13:12:35 user nova-compute[75247]: iSNS:
Dec 06 13:12:35 user nova-compute[75247]: No targets found.
Dec 06 13:12:35 user nova-compute[75247]: STATIC:
Dec 06 13:12:35 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68
Dec 06 13:12:35 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:12:35 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:12:35 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c
Dec 06 13:12:35 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:12:35 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:12:35 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462
Dec 06 13:12:35 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:12:35 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:12:35 user nova-compute[75247]: FIRMWARE:
Dec 06 13:12:35 user nova-compute[75247]: No targets found.
Dec 06 13:12:35 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 13:12:35 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 13:12:35 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[712b7de1-a472-4e42-aea1-a1deeb0f0795]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[02211d88-beb2-48fc-9c89-d3fcae7924bb]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:12:35 user nova-compute[75247]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 (non-flash)
Dec 06 13:12:35 user nova-compute[75247]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)
Dec 06 13:12:35 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:12:35 user nova-compute[75247]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 (non-flash)
Dec 06 13:12:35 user nova-compute[75247]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)
Dec 06 13:12:35 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd73060d090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68'): ({'sdb'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Removing single pathed devices sdb {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[618cae70-cdc2-4f20-a341-827aa2ed4685]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc176910-51a6-41e8-bc74-2cce1c420871]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Flushing IO for device /dev/sdb {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[449a29c3-8219-4f7c-9f7c-98c18e98fd04]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[af147ef7-f74f-429d-8595-1a6c8c8fd769]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d3cb03-9273-4ee4-92ca-2fad1d3cb0c6]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3547c5a-2209-415e-9277-350dd6e8aa03]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68, portal: 172.16.0.220,3260]
Dec 06 13:12:35 user nova-compute[75247]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68, portal: 172.16.0.220,3260] successful.
Dec 06 13:12:35 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d16a50-b4ce-43c5-aad4-96b1503ebf0b]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.426s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] <== disconnect_volume: return (427ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 13:12:35 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Deleting instance files /opt/stack/data/nova/instances/df690bb9-fb1d-4a67-b9c8-785425c96116_del
Dec 06 13:12:35 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Deletion of /opt/stack/data/nova/instances/df690bb9-fb1d-4a67-b9c8-785425c96116_del complete
Dec 06 13:12:35 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:12:35 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:12:36 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:12:36 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:12:36 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=8736MB free_disk=25.066997528076172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:12:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:12:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:12:36 user nova-compute[75247]: INFO nova.compute.manager [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Took 1.67 seconds to destroy the instance on the hypervisor.
Dec 06 13:12:36 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 13:12:36 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 13:12:36 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 13:12:36 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance df690bb9-fb1d-4a67-b9c8-785425c96116 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:12:36 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 2b633bf8-609f-4d56-86f6-b96218435aa6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:12:36 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 637e64f2-3377-47ce-9891-ea9d9f3b6729 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:12:36 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:12:36 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:12:36 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:12:36 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:12:36 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:12:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:12:36 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:12:36 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Took 0.67 seconds to deallocate network for instance.
Dec 06 13:12:36 user nova-compute[75247]: DEBUG nova.compute.manager [req-0e28bd09-a591-47d4-9177-61ba47b2c974 req-d00e48cb-7298-4906-ad2c-81487d708af1 service nova] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Received event network-vif-deleted-f114e05d-020b-453c-83ad-15fc56b9f551 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:12:36 user nova-compute[75247]: INFO nova.compute.manager [req-0e28bd09-a591-47d4-9177-61ba47b2c974 req-d00e48cb-7298-4906-ad2c-81487d708af1 service nova] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Neutron deleted interface f114e05d-020b-453c-83ad-15fc56b9f551; detaching it from the instance and deleting it from the info cache
Dec 06 13:12:36 user nova-compute[75247]: DEBUG nova.network.neutron [req-0e28bd09-a591-47d4-9177-61ba47b2c974 req-d00e48cb-7298-4906-ad2c-81487d708af1 service nova] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:12:36 user nova-compute[75247]: DEBUG nova.compute.manager [req-c48cee95-172a-4d0a-866d-a43aee6703bb req-f2ab1a5d-fd8f-4d52-ad47-b32f46d41d3f service nova] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Received event network-vif-plugged-f114e05d-020b-453c-83ad-15fc56b9f551 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:12:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c48cee95-172a-4d0a-866d-a43aee6703bb req-f2ab1a5d-fd8f-4d52-ad47-b32f46d41d3f service nova] Acquiring lock "df690bb9-fb1d-4a67-b9c8-785425c96116-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:12:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c48cee95-172a-4d0a-866d-a43aee6703bb req-f2ab1a5d-fd8f-4d52-ad47-b32f46d41d3f service nova] Lock "df690bb9-fb1d-4a67-b9c8-785425c96116-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:12:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-c48cee95-172a-4d0a-866d-a43aee6703bb req-f2ab1a5d-fd8f-4d52-ad47-b32f46d41d3f service nova] Lock "df690bb9-fb1d-4a67-b9c8-785425c96116-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:12:36 user nova-compute[75247]: DEBUG nova.compute.manager [req-c48cee95-172a-4d0a-866d-a43aee6703bb req-f2ab1a5d-fd8f-4d52-ad47-b32f46d41d3f service nova] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] No waiting events found dispatching network-vif-plugged-f114e05d-020b-453c-83ad-15fc56b9f551 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:12:36 user nova-compute[75247]: WARNING nova.compute.manager [req-c48cee95-172a-4d0a-866d-a43aee6703bb req-f2ab1a5d-fd8f-4d52-ad47-b32f46d41d3f service nova] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Received unexpected event network-vif-plugged-f114e05d-020b-453c-83ad-15fc56b9f551 for instance with vm_state active and task_state deleting.
Dec 06 13:12:36 user nova-compute[75247]: DEBUG nova.compute.manager [req-0e28bd09-a591-47d4-9177-61ba47b2c974 req-d00e48cb-7298-4906-ad2c-81487d708af1 service nova] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Detach interface failed, port_id=f114e05d-020b-453c-83ad-15fc56b9f551, reason: Instance df690bb9-fb1d-4a67-b9c8-785425c96116 could not be found. {{(pid=75247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 13:12:37 user nova-compute[75247]: INFO nova.compute.manager [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: df690bb9-fb1d-4a67-b9c8-785425c96116] Took 1.00 seconds to detach 1 volumes for instance.
Dec 06 13:12:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:12:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:12:38 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:12:38 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:12:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:12:38 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Deleted allocations for instance df690bb9-fb1d-4a67-b9c8-785425c96116
Dec 06 13:12:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5963a7fd-2b55-425b-8ece-7557da37d0a8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "df690bb9-fb1d-4a67-b9c8-785425c96116" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.723s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:12:39 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:12:39 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:12:39 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Didn't find any instances for network info cache update. {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 13:12:39 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:12:39 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:12:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:12:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:13:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "2b633bf8-609f-4d56-86f6-b96218435aa6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:13:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:13:02 user nova-compute[75247]: INFO nova.compute.manager [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Detaching volume 8c6162bf-f14e-43fd-b8c3-d096887cb462
Dec 06 13:13:02 user nova-compute[75247]: INFO nova.virt.block_device [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Attempting to driver detach volume 8c6162bf-f14e-43fd-b8c3-d096887cb462 from mountpoint /dev/vdc
Dec 06 13:13:02 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Attempting to detach device vdc from instance 2b633bf8-609f-4d56-86f6-b96218435aa6 from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 13:13:02 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 13:13:02 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:13:02 user nova-compute[75247]:   <source dev="/dev/sdc"/>
Dec 06 13:13:02 user nova-compute[75247]:   <target dev="vdc" bus="virtio"/>
Dec 06 13:13:02 user nova-compute[75247]:   <serial>8c6162bf-f14e-43fd-b8c3-d096887cb462</serial>
Dec 06 13:13:02 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 06 13:13:02 user nova-compute[75247]: </disk>
Dec 06 13:13:02 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 13:13:02 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Successfully detached device vdc from instance 2b633bf8-609f-4d56-86f6-b96218435aa6 from the persistent domain config.
Dec 06 13:13:02 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 2b633bf8-609f-4d56-86f6-b96218435aa6 from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 13:13:02 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 13:13:02 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:13:02 user nova-compute[75247]:   <source dev="/dev/sdc"/>
Dec 06 13:13:02 user nova-compute[75247]:   <target dev="vdc" bus="virtio"/>
Dec 06 13:13:02 user nova-compute[75247]:   <serial>8c6162bf-f14e-43fd-b8c3-d096887cb462</serial>
Dec 06 13:13:02 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 06 13:13:02 user nova-compute[75247]: </disk>
Dec 06 13:13:02 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 13:13:02 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 2b633bf8-609f-4d56-86f6-b96218435aa6 {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 13:13:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:13:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:22 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 2b633bf8-609f-4d56-86f6-b96218435aa6 is timed out.
Dec 06 13:13:22 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Successfully detached device vdc from instance 2b633bf8-609f-4d56-86f6-b96218435aa6 from the live domain config.
Dec 06 13:13:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TiJvYhMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:13:22 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:13:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f9e541-a17e-4f6b-bfef-9b2fd08314d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 13:13:22 user nova-compute[75247]: No targets found.
Dec 06 13:13:22 user nova-compute[75247]: iSNS:
Dec 06 13:13:22 user nova-compute[75247]: No targets found.
Dec 06 13:13:22 user nova-compute[75247]: STATIC:
Dec 06 13:13:22 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c
Dec 06 13:13:22 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:13:22 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:13:22 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462
Dec 06 13:13:22 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:13:22 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:13:22 user nova-compute[75247]: FIRMWARE:
Dec 06 13:13:22 user nova-compute[75247]: No targets found.
Dec 06 13:13:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 13:13:22 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 13:13:22 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[185ce932-c75f-48b2-ac89-c01c37403037]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[de29de3e-d672-4ef9-a017-662e7f3645a5]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 (non-flash)
Dec 06 13:13:22 user nova-compute[75247]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)
Dec 06 13:13:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 (non-flash)
Dec 06 13:13:22 user nova-compute[75247]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)
Dec 06 13:13:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c6115a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462'): ({'sdc'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Removing single pathed devices sdc {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[622500b7-0fde-4c3b-8e6d-a98d91f7c2de]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddab448-f2dc-4c6f-b0a1-ceb75a4ad146]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Flushing IO for device /dev/sdc {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca56a9d-2247-4c1e-8af1-caaf6ec22a80]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 13:13:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:13:23 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6bca80-6490-42e4-b577-f1a9004ec760]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:13:23 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 13:13:23 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] SCSI volumes sdc have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 13:13:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 13:13:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:13:23 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43850ba-a5dd-4e9a-871c-a775df7c089a]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:13:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:13:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:13:23 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d6c271-a871-47d6-9b93-2603b6aec365]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:13:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462, portal: 172.16.0.220,3260]
Dec 06 13:13:23 user nova-compute[75247]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462, portal: 172.16.0.220,3260] successful.
Dec 06 13:13:23 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:13:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:23 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c6162bf-f14e-43fd-b8c3-d096887cb462 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:13:23 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7769e7-5865-4460-81d1-0c393de76100]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:13:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:13:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:13:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] <== disconnect_volume: return (290ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:13:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 13:13:23 user nova-compute[75247]: DEBUG nova.objects.instance [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lazy-loading 'flavor' on Instance uuid 2b633bf8-609f-4d56-86f6-b96218435aa6 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:13:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ea4e8142-1445-435a-87db-55b71b1f1957 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.658s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:13:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:13:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:13:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:13:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:13:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:13:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "c15d3c59-c91a-4b67-bd8a-731751a2fa6c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:13:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "c15d3c59-c91a-4b67-bd8a-731751a2fa6c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:13:26 user nova-compute[75247]: DEBUG nova.compute.manager [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 13:13:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:13:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:13:26 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 13:13:26 user nova-compute[75247]: INFO nova.compute.claims [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Claim successful on node user
Dec 06 13:13:26 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:13:26 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:13:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.233s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:13:26 user nova-compute[75247]: DEBUG nova.compute.manager [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 13:13:26 user nova-compute[75247]: DEBUG nova.compute.manager [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 13:13:26 user nova-compute[75247]: DEBUG nova.network.neutron [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 13:13:26 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 13:13:26 user nova-compute[75247]: DEBUG nova.compute.manager [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 13:13:26 user nova-compute[75247]: DEBUG nova.policy [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '016714f7502b4a8fa12ed0ce6644c5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9493d9b0b1024cea9a550e2a42c1e6a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 13:13:26 user nova-compute[75247]: INFO nova.virt.block_device [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Booting with volume 984f8ea6-7058-4b3c-8e61-fa4a45712e68 at /dev/vda
Dec 06 13:13:26 user nova-compute[75247]: DEBUG os_brick.utils [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:13:26 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:13:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b917401-580f-42cb-b715-faf904b4bbbb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:13:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:13:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a542528-e8a0-41e0-9dee-2e06800a06b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:13:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:13:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcabfca1-f895-432d-ba27-b90b1183fdbe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:13:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2774c431-2228-4319-9489-3e6e3b3fb8ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:13:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:13:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 13:13:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:13:27 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 13:13:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc701e6-60bf-455b-a723-92627b3e85e5]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:13:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 13:13:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 13:13:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 13:13:27 user nova-compute[75247]: DEBUG os_brick.utils [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:13:27 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Updating existing volume attachment record: d9d9d772-6c18-44a9-bb1e-6a7bad2f1dea {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 13:13:27 user nova-compute[75247]: DEBUG nova.network.neutron [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Successfully created port: 774027f4-84e8-46cd-8d40-4cdb269c4591 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 13:13:27 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:13:28 user nova-compute[75247]: DEBUG nova.network.neutron [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Successfully updated port: 774027f4-84e8-46cd-8d40-4cdb269c4591 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 13:13:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "refresh_cache-c15d3c59-c91a-4b67-bd8a-731751a2fa6c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:13:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquired lock "refresh_cache-c15d3c59-c91a-4b67-bd8a-731751a2fa6c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:13:28 user nova-compute[75247]: DEBUG nova.network.neutron [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 13:13:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-68b3da8f-e73b-4fcb-a414-3c60fdccacc6 req-f045577b-57a4-40a3-980a-0ce48f702a76 service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Received event network-changed-774027f4-84e8-46cd-8d40-4cdb269c4591 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:13:28 user nova-compute[75247]: DEBUG nova.compute.manager [req-68b3da8f-e73b-4fcb-a414-3c60fdccacc6 req-f045577b-57a4-40a3-980a-0ce48f702a76 service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Refreshing instance network info cache due to event network-changed-774027f4-84e8-46cd-8d40-4cdb269c4591. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:13:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-68b3da8f-e73b-4fcb-a414-3c60fdccacc6 req-f045577b-57a4-40a3-980a-0ce48f702a76 service nova] Acquiring lock "refresh_cache-c15d3c59-c91a-4b67-bd8a-731751a2fa6c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:13:28 user nova-compute[75247]: DEBUG nova.network.neutron [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 13:13:28 user nova-compute[75247]: DEBUG nova.network.neutron [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Updating instance_info_cache with network_info: [{"id": "774027f4-84e8-46cd-8d40-4cdb269c4591", "address": "fa:16:3e:75:aa:77", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774027f4-84", "ovs_interfaceid": "774027f4-84e8-46cd-8d40-4cdb269c4591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:13:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Releasing lock "refresh_cache-c15d3c59-c91a-4b67-bd8a-731751a2fa6c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:13:28 user nova-compute[75247]: DEBUG nova.compute.manager [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Instance network_info: |[{"id": "774027f4-84e8-46cd-8d40-4cdb269c4591", "address": "fa:16:3e:75:aa:77", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774027f4-84", "ovs_interfaceid": "774027f4-84e8-46cd-8d40-4cdb269c4591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 13:13:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-68b3da8f-e73b-4fcb-a414-3c60fdccacc6 req-f045577b-57a4-40a3-980a-0ce48f702a76 service nova] Acquired lock "refresh_cache-c15d3c59-c91a-4b67-bd8a-731751a2fa6c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:13:28 user nova-compute[75247]: DEBUG nova.network.neutron [req-68b3da8f-e73b-4fcb-a414-3c60fdccacc6 req-f045577b-57a4-40a3-980a-0ce48f702a76 service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Refreshing network info cache for port 774027f4-84e8-46cd-8d40-4cdb269c4591 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:13:28 user nova-compute[75247]: DEBUG nova.network.neutron [req-68b3da8f-e73b-4fcb-a414-3c60fdccacc6 req-f045577b-57a4-40a3-980a-0ce48f702a76 service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Updated VIF entry in instance network info cache for port 774027f4-84e8-46cd-8d40-4cdb269c4591. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:13:28 user nova-compute[75247]: DEBUG nova.network.neutron [req-68b3da8f-e73b-4fcb-a414-3c60fdccacc6 req-f045577b-57a4-40a3-980a-0ce48f702a76 service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Updating instance_info_cache with network_info: [{"id": "774027f4-84e8-46cd-8d40-4cdb269c4591", "address": "fa:16:3e:75:aa:77", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774027f4-84", "ovs_interfaceid": "774027f4-84e8-46cd-8d40-4cdb269c4591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:13:28 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-68b3da8f-e73b-4fcb-a414-3c60fdccacc6 req-f045577b-57a4-40a3-980a-0ce48f702a76 service nova] Releasing lock "refresh_cache-c15d3c59-c91a-4b67-bd8a-731751a2fa6c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:13:28 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:13:29 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:13:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:13:33 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:13:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:13:35 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG nova.compute.manager [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 13:13:36 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Creating image(s)
Dec 06 13:13:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Did not create local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Ensure instance console log exists: /opt/stack/data/nova/instances/c15d3c59-c91a-4b67-bd8a-731751a2fa6c/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Start _get_guest_xml network_info=[{"id": "774027f4-84e8-46cd-8d40-4cdb269c4591", "address": "fa:16:3e:75:aa:77", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774027f4-84", "ovs_interfaceid": "774027f4-84e8-46cd-8d40-4cdb269c4591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'd9d9d772-6c18-44a9-bb1e-6a7bad2f1dea', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zldIYVrk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c15d3c59-c91a-4b67-bd8a-731751a2fa6c', 'attached_at': '', 'detached_at': '', 'volume_id': '984f8ea6-7058-4b3c-8e61-fa4a45712e68', 'serial': '984f8ea6-7058-4b3c-8e61-fa4a45712e68'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 13:13:36 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:13:36 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:13:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zldIYVrk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:13:36 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:13:36 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:13:36 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:13:36 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:13:36 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7042d4bf-ae45-477f-a82b-afc0d42b5acc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 13:13:36 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba90398-6677-42f3-ae46-b2d26865512c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68] added
Dec 06 13:13:36 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e21d97-ef1e-4fd2-bd78-6ef02859e3cd]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[550d8a31-38b9-426a-9698-60f6bacc7d8e]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zldIYVrk {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zldIYVrk" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47ebc3d-4e4b-4136-8116-9a337b31c52d]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zldIYVrk'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[232884dc-7b80-4b8d-aab4-16fb6a27c74c]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4ccdf9-178c-4419-8691-9d7435eebafb]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)
Dec 06 13:13:36 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)
Dec 06 13:13:36 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[29514769-fe64-4d6c-8343-6e6219b511d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68, portal: 172.16.0.220,3260]
Dec 06 13:13:36 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68, portal: 172.16.0.220,3260] successful.
Dec 06 13:13:36 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f0cef4-d4fc-447b-b9dd-32c187d43542]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eaf4d69-dff0-425c-99e1-c2f550835b91]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)
Dec 06 13:13:36 user nova-compute[75247]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:13:36 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)
Dec 06 13:13:36 user nova-compute[75247]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:13:36 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[867cc429-f15a-43e2-ab7b-613ba7b6e4b7]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:13:36 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zldIYVrk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23964656639633861', 'path': '/dev/sdb'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964656639633861', 'path': '/dev/sdb'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 13:13:37 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:13:37 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:13:37 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=8814MB free_disk=25.057884216308594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:13:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-337727585',display_name='tempest-TestVolumeBootPattern-server-337727585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-337727585',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+e3XTLfVN8C3itmblwy09HtnE6ODmf3LMeZLWfbnBfl5D2ms/C+dYrJrc6lCBYNrZ/pLuupAxLsGv6ZOwhXojQ4RlmELXbFB3bv70Zc31yz9kRGkDkIlpeboSBmcUYgg==',key_name='tempest-TestVolumeBootPattern-1199968839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9493d9b0b1024cea9a550e2a42c1e6a1',ramdisk_id='',reservation_id='r-48vdobs5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2088852773',owner_user_name='tempest-TestVolumeBootPattern-2088852773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:13:27Z,user_data=None,user_id='016714f7502b4a8fa12ed0ce6644c5fc',uuid=c15d3c59-c91a-4b67-bd8a-731751a2fa6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "774027f4-84e8-46cd-8d40-4cdb269c4591", "address": "fa:16:3e:75:aa:77", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774027f4-84", "ovs_interfaceid": "774027f4-84e8-46cd-8d40-4cdb269c4591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converting VIF {"id": "774027f4-84e8-46cd-8d40-4cdb269c4591", "address": "fa:16:3e:75:aa:77", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774027f4-84", "ovs_interfaceid": "774027f4-84e8-46cd-8d40-4cdb269c4591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:aa:77,bridge_name='br-int',has_traffic_filtering=True,id=774027f4-84e8-46cd-8d40-4cdb269c4591,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap774027f4-84') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG nova.objects.instance [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lazy-loading 'pci_devices' on Instance uuid c15d3c59-c91a-4b67-bd8a-731751a2fa6c {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] End _get_guest_xml xml=<domain type="kvm">
Dec 06 13:13:37 user nova-compute[75247]:   <uuid>c15d3c59-c91a-4b67-bd8a-731751a2fa6c</uuid>
Dec 06 13:13:37 user nova-compute[75247]:   <name>instance-00000032</name>
Dec 06 13:13:37 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 13:13:37 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 13:13:37 user nova-compute[75247]:   <metadata>
Dec 06 13:13:37 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 13:13:37 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 13:13:37 user nova-compute[75247]:       <nova:name>tempest-TestVolumeBootPattern-server-337727585</nova:name>
Dec 06 13:13:37 user nova-compute[75247]:       <nova:creationTime>2023-12-06 13:13:36</nova:creationTime>
Dec 06 13:13:37 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 13:13:37 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 13:13:37 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 13:13:37 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 13:13:37 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 13:13:37 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 13:13:37 user nova-compute[75247]:       </nova:flavor>
Dec 06 13:13:37 user nova-compute[75247]:       <nova:owner>
Dec 06 13:13:37 user nova-compute[75247]:         <nova:user uuid="016714f7502b4a8fa12ed0ce6644c5fc">tempest-TestVolumeBootPattern-2088852773-project-member</nova:user>
Dec 06 13:13:37 user nova-compute[75247]:         <nova:project uuid="9493d9b0b1024cea9a550e2a42c1e6a1">tempest-TestVolumeBootPattern-2088852773</nova:project>
Dec 06 13:13:37 user nova-compute[75247]:       </nova:owner>
Dec 06 13:13:37 user nova-compute[75247]:       <nova:ports>
Dec 06 13:13:37 user nova-compute[75247]:         <nova:port uuid="774027f4-84e8-46cd-8d40-4cdb269c4591">
Dec 06 13:13:37 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 06 13:13:37 user nova-compute[75247]:         </nova:port>
Dec 06 13:13:37 user nova-compute[75247]:       </nova:ports>
Dec 06 13:13:37 user nova-compute[75247]:     </nova:instance>
Dec 06 13:13:37 user nova-compute[75247]:   </metadata>
Dec 06 13:13:37 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 13:13:37 user nova-compute[75247]:     <system>
Dec 06 13:13:37 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 13:13:37 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 13:13:37 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 13:13:37 user nova-compute[75247]:       <entry name="serial">c15d3c59-c91a-4b67-bd8a-731751a2fa6c</entry>
Dec 06 13:13:37 user nova-compute[75247]:       <entry name="uuid">c15d3c59-c91a-4b67-bd8a-731751a2fa6c</entry>
Dec 06 13:13:37 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 13:13:37 user nova-compute[75247]:     </system>
Dec 06 13:13:37 user nova-compute[75247]:   </sysinfo>
Dec 06 13:13:37 user nova-compute[75247]:   <os>
Dec 06 13:13:37 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 13:13:37 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 13:13:37 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 13:13:37 user nova-compute[75247]:   </os>
Dec 06 13:13:37 user nova-compute[75247]:   <features>
Dec 06 13:13:37 user nova-compute[75247]:     <acpi/>
Dec 06 13:13:37 user nova-compute[75247]:     <apic/>
Dec 06 13:13:37 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 13:13:37 user nova-compute[75247]:   </features>
Dec 06 13:13:37 user nova-compute[75247]:   <clock offset="utc">
Dec 06 13:13:37 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 13:13:37 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 13:13:37 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 13:13:37 user nova-compute[75247]:   </clock>
Dec 06 13:13:37 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 13:13:37 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 13:13:37 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 13:13:37 user nova-compute[75247]:   </cpu>
Dec 06 13:13:37 user nova-compute[75247]:   <devices>
Dec 06 13:13:37 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 13:13:37 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:13:37 user nova-compute[75247]:       <source dev="/dev/sdb"/>
Dec 06 13:13:37 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 13:13:37 user nova-compute[75247]:       <serial>984f8ea6-7058-4b3c-8e61-fa4a45712e68</serial>
Dec 06 13:13:37 user nova-compute[75247]:     </disk>
Dec 06 13:13:37 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 13:13:37 user nova-compute[75247]:       <mac address="fa:16:3e:75:aa:77"/>
Dec 06 13:13:37 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:13:37 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 13:13:37 user nova-compute[75247]:       <target dev="tap774027f4-84"/>
Dec 06 13:13:37 user nova-compute[75247]:     </interface>
Dec 06 13:13:37 user nova-compute[75247]:     <serial type="pty">
Dec 06 13:13:37 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/c15d3c59-c91a-4b67-bd8a-731751a2fa6c/console.log" append="off"/>
Dec 06 13:13:37 user nova-compute[75247]:     </serial>
Dec 06 13:13:37 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 13:13:37 user nova-compute[75247]:     <video>
Dec 06 13:13:37 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:13:37 user nova-compute[75247]:     </video>
Dec 06 13:13:37 user nova-compute[75247]:     <rng model="virtio">
Dec 06 13:13:37 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 13:13:37 user nova-compute[75247]:     </rng>
Dec 06 13:13:37 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 13:13:37 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 13:13:37 user nova-compute[75247]:       <stats period="10"/>
Dec 06 13:13:37 user nova-compute[75247]:     </memballoon>
Dec 06 13:13:37 user nova-compute[75247]:   </devices>
Dec 06 13:13:37 user nova-compute[75247]: </domain>
Dec 06 13:13:37 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:13:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-337727585',display_name='tempest-TestVolumeBootPattern-server-337727585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-337727585',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+e3XTLfVN8C3itmblwy09HtnE6ODmf3LMeZLWfbnBfl5D2ms/C+dYrJrc6lCBYNrZ/pLuupAxLsGv6ZOwhXojQ4RlmELXbFB3bv70Zc31yz9kRGkDkIlpeboSBmcUYgg==',key_name='tempest-TestVolumeBootPattern-1199968839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9493d9b0b1024cea9a550e2a42c1e6a1',ramdisk_id='',reservation_id='r-48vdobs5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2088852773',owner_user_name='tempest-TestVolumeBootPattern-2088852773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:13:27Z,user_data=None,user_id='016714f7502b4a8fa12ed0ce6644c5fc',uuid=c15d3c59-c91a-4b67-bd8a-731751a2fa6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "774027f4-84e8-46cd-8d40-4cdb269c4591", "address": "fa:16:3e:75:aa:77", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774027f4-84", "ovs_interfaceid": "774027f4-84e8-46cd-8d40-4cdb269c4591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converting VIF {"id": "774027f4-84e8-46cd-8d40-4cdb269c4591", "address": "fa:16:3e:75:aa:77", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774027f4-84", "ovs_interfaceid": "774027f4-84e8-46cd-8d40-4cdb269c4591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:aa:77,bridge_name='br-int',has_traffic_filtering=True,id=774027f4-84e8-46cd-8d40-4cdb269c4591,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap774027f4-84') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG os_vif [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:aa:77,bridge_name='br-int',has_traffic_filtering=True,id=774027f4-84e8-46cd-8d40-4cdb269c4591,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap774027f4-84') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8cd42063-fe92-5bd4-90cb-558468e0f3c3', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap774027f4-84, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap774027f4-84, col_values=(('qos', UUID('5ae2334f-54a3-4c65-ab19-6bae284c3af5')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap774027f4-84, col_values=(('external_ids', {'iface-id': '774027f4-84e8-46cd-8d40-4cdb269c4591', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:aa:77', 'vm-uuid': 'c15d3c59-c91a-4b67-bd8a-731751a2fa6c'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:37 user nova-compute[75247]: INFO os_vif [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:aa:77,bridge_name='br-int',has_traffic_filtering=True,id=774027f4-84e8-46cd-8d40-4cdb269c4591,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap774027f4-84')
Dec 06 13:13:37 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 2b633bf8-609f-4d56-86f6-b96218435aa6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 637e64f2-3377-47ce-9891-ea9d9f3b6729 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance c15d3c59-c91a-4b67-bd8a-731751a2fa6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:13:37 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:13:38 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:13:38 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] No VIF found with MAC fa:16:3e:75:aa:77, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 13:13:38 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:13:38 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:13:38 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:13:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.277s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:13:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:39 user nova-compute[75247]: DEBUG nova.compute.manager [req-aba14adc-8597-4e9c-8d8d-34884a58c452 req-3e6e2021-c746-4aac-8bac-019e7d3b5f0d service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Received event network-vif-plugged-774027f4-84e8-46cd-8d40-4cdb269c4591 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:13:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-aba14adc-8597-4e9c-8d8d-34884a58c452 req-3e6e2021-c746-4aac-8bac-019e7d3b5f0d service nova] Acquiring lock "c15d3c59-c91a-4b67-bd8a-731751a2fa6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:13:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-aba14adc-8597-4e9c-8d8d-34884a58c452 req-3e6e2021-c746-4aac-8bac-019e7d3b5f0d service nova] Lock "c15d3c59-c91a-4b67-bd8a-731751a2fa6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:13:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-aba14adc-8597-4e9c-8d8d-34884a58c452 req-3e6e2021-c746-4aac-8bac-019e7d3b5f0d service nova] Lock "c15d3c59-c91a-4b67-bd8a-731751a2fa6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:13:39 user nova-compute[75247]: DEBUG nova.compute.manager [req-aba14adc-8597-4e9c-8d8d-34884a58c452 req-3e6e2021-c746-4aac-8bac-019e7d3b5f0d service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] No waiting events found dispatching network-vif-plugged-774027f4-84e8-46cd-8d40-4cdb269c4591 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:13:39 user nova-compute[75247]: WARNING nova.compute.manager [req-aba14adc-8597-4e9c-8d8d-34884a58c452 req-3e6e2021-c746-4aac-8bac-019e7d3b5f0d service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Received unexpected event network-vif-plugged-774027f4-84e8-46cd-8d40-4cdb269c4591 for instance with vm_state building and task_state spawning.
Dec 06 13:13:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:40 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:13:40 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:13:40 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 13:13:40 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Skipping network cache update for instance because it is Building. {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Dec 06 13:13:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:13:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:13:40 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 13:13:40 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lazy-loading 'info_cache' on Instance uuid 2b633bf8-609f-4d56-86f6-b96218435aa6 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:13:40 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Updating instance_info_cache with network_info: [{"id": "36c5fc9a-1100-48de-80da-1188909df5e5", "address": "fa:16:3e:91:16:cf", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c5fc9a-11", "ovs_interfaceid": "36c5fc9a-1100-48de-80da-1188909df5e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:13:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-2b633bf8-609f-4d56-86f6-b96218435aa6" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:13:40 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 13:13:40 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:13:40 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:13:41 user nova-compute[75247]: DEBUG nova.compute.manager [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 13:13:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 13:13:41 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Instance spawned successfully.
Dec 06 13:13:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 13:13:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:13:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:13:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:13:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:13:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:13:41 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:13:41 user nova-compute[75247]: INFO nova.compute.manager [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Took 4.99 seconds to spawn the instance on the hypervisor.
Dec 06 13:13:41 user nova-compute[75247]: DEBUG nova.compute.manager [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 13:13:41 user nova-compute[75247]: INFO nova.compute.manager [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Took 14.97 seconds to build instance.
Dec 06 13:13:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-daba37f9-7cea-47fb-b1a1-2658635046e0 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "c15d3c59-c91a-4b67-bd8a-731751a2fa6c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.080s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:13:41 user nova-compute[75247]: DEBUG nova.compute.manager [req-f25781fd-3b44-4a96-85aa-f9067e561c1e req-0902f438-ede7-4b03-aadf-b2e6d50b788b service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Received event network-vif-plugged-774027f4-84e8-46cd-8d40-4cdb269c4591 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:13:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f25781fd-3b44-4a96-85aa-f9067e561c1e req-0902f438-ede7-4b03-aadf-b2e6d50b788b service nova] Acquiring lock "c15d3c59-c91a-4b67-bd8a-731751a2fa6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:13:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f25781fd-3b44-4a96-85aa-f9067e561c1e req-0902f438-ede7-4b03-aadf-b2e6d50b788b service nova] Lock "c15d3c59-c91a-4b67-bd8a-731751a2fa6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:13:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-f25781fd-3b44-4a96-85aa-f9067e561c1e req-0902f438-ede7-4b03-aadf-b2e6d50b788b service nova] Lock "c15d3c59-c91a-4b67-bd8a-731751a2fa6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:13:41 user nova-compute[75247]: DEBUG nova.compute.manager [req-f25781fd-3b44-4a96-85aa-f9067e561c1e req-0902f438-ede7-4b03-aadf-b2e6d50b788b service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] No waiting events found dispatching network-vif-plugged-774027f4-84e8-46cd-8d40-4cdb269c4591 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:13:41 user nova-compute[75247]: WARNING nova.compute.manager [req-f25781fd-3b44-4a96-85aa-f9067e561c1e req-0902f438-ede7-4b03-aadf-b2e6d50b788b service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Received unexpected event network-vif-plugged-774027f4-84e8-46cd-8d40-4cdb269c4591 for instance with vm_state active and task_state None.
Dec 06 13:13:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5f643788-46dc-4f14-a133-e5bb4c9e858e tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "2b633bf8-609f-4d56-86f6-b96218435aa6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:13:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5f643788-46dc-4f14-a133-e5bb4c9e858e tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:13:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5f643788-46dc-4f14-a133-e5bb4c9e858e tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:13:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5f643788-46dc-4f14-a133-e5bb4c9e858e tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:13:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5f643788-46dc-4f14-a133-e5bb4c9e858e tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:13:52 user nova-compute[75247]: INFO nova.compute.manager [None req-5f643788-46dc-4f14-a133-e5bb4c9e858e tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Terminating instance
Dec 06 13:13:52 user nova-compute[75247]: DEBUG nova.compute.manager [None req-5f643788-46dc-4f14-a133-e5bb4c9e858e tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 13:13:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:52 user nova-compute[75247]: DEBUG nova.compute.manager [req-394cbb3a-96ef-4a07-bdd4-854fb7d3205f req-2fdb045c-fa2b-4f1d-a016-1fa56604a564 service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Received event network-vif-unplugged-36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:13:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-394cbb3a-96ef-4a07-bdd4-854fb7d3205f req-2fdb045c-fa2b-4f1d-a016-1fa56604a564 service nova] Acquiring lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:13:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-394cbb3a-96ef-4a07-bdd4-854fb7d3205f req-2fdb045c-fa2b-4f1d-a016-1fa56604a564 service nova] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:13:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-394cbb3a-96ef-4a07-bdd4-854fb7d3205f req-2fdb045c-fa2b-4f1d-a016-1fa56604a564 service nova] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:13:52 user nova-compute[75247]: DEBUG nova.compute.manager [req-394cbb3a-96ef-4a07-bdd4-854fb7d3205f req-2fdb045c-fa2b-4f1d-a016-1fa56604a564 service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] No waiting events found dispatching network-vif-unplugged-36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:13:52 user nova-compute[75247]: DEBUG nova.compute.manager [req-394cbb3a-96ef-4a07-bdd4-854fb7d3205f req-2fdb045c-fa2b-4f1d-a016-1fa56604a564 service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Received event network-vif-unplugged-36c5fc9a-1100-48de-80da-1188909df5e5 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 13:13:53 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Instance destroyed successfully.
Dec 06 13:13:53 user nova-compute[75247]: DEBUG nova.objects.instance [None req-5f643788-46dc-4f14-a133-e5bb4c9e858e tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lazy-loading 'resources' on Instance uuid 2b633bf8-609f-4d56-86f6-b96218435aa6 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:13:53 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-5f643788-46dc-4f14-a133-e5bb4c9e858e tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T13:07:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1297482927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1297482927',id=47,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyfR84sYYIKmhk4Xel3+j5rZsBbDKhCIiuYagt2qk40+BPHAmsKSDMcOj86qj+sr16q3+XUviT2i8cP6TUSl4JNHIGJV60uIaSE11sWyCXuwMNXrH6f02pqMjSsty00Ug==',key_name='tempest-keypair-1683071845',keypairs=<?>,launch_index=0,launched_at=2023-12-06T13:11:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f58adbd4d004a44b37a0e0922da5aa3',ramdisk_id='',reservation_id='r-lcgwlr3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2058750591',owner_user_name='tempest-AttachVolumeShelveTestJSON-2058750591-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T13:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e50e8cc91ca4ff88ebfa0b2888699d5',uuid=2b633bf8-609f-4d56-86f6-b96218435aa6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36c5fc9a-1100-48de-80da-1188909df5e5", "address": "fa:16:3e:91:16:cf", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c5fc9a-11", "ovs_interfaceid": "36c5fc9a-1100-48de-80da-1188909df5e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 13:13:53 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-5f643788-46dc-4f14-a133-e5bb4c9e858e tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Converting VIF {"id": "36c5fc9a-1100-48de-80da-1188909df5e5", "address": "fa:16:3e:91:16:cf", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c5fc9a-11", "ovs_interfaceid": "36c5fc9a-1100-48de-80da-1188909df5e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:13:53 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-5f643788-46dc-4f14-a133-e5bb4c9e858e tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:16:cf,bridge_name='br-int',has_traffic_filtering=True,id=36c5fc9a-1100-48de-80da-1188909df5e5,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c5fc9a-11') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:13:53 user nova-compute[75247]: DEBUG os_vif [None req-5f643788-46dc-4f14-a133-e5bb4c9e858e tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:16:cf,bridge_name='br-int',has_traffic_filtering=True,id=36c5fc9a-1100-48de-80da-1188909df5e5,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c5fc9a-11') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 13:13:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36c5fc9a-11, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:13:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:13:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97dff1a8-6acc-4fe8-a58b-352f99b2098c) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:13:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:13:53 user nova-compute[75247]: INFO os_vif [None req-5f643788-46dc-4f14-a133-e5bb4c9e858e tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:16:cf,bridge_name='br-int',has_traffic_filtering=True,id=36c5fc9a-1100-48de-80da-1188909df5e5,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c5fc9a-11')
Dec 06 13:13:53 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-5f643788-46dc-4f14-a133-e5bb4c9e858e tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Deleting instance files /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6_del
Dec 06 13:13:53 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-5f643788-46dc-4f14-a133-e5bb4c9e858e tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Deletion of /opt/stack/data/nova/instances/2b633bf8-609f-4d56-86f6-b96218435aa6_del complete
Dec 06 13:13:53 user nova-compute[75247]: INFO nova.compute.manager [None req-5f643788-46dc-4f14-a133-e5bb4c9e858e tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Took 0.85 seconds to destroy the instance on the hypervisor.
Dec 06 13:13:53 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-5f643788-46dc-4f14-a133-e5bb4c9e858e tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 13:13:53 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 13:13:53 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 13:13:54 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:13:54 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Took 1.00 seconds to deallocate network for instance.
Dec 06 13:13:54 user nova-compute[75247]: DEBUG nova.compute.manager [req-4aa3161c-2f55-4e89-9eb5-d824063d013b req-346fc291-de9a-4575-a1d6-f0814e83c7fb service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Received event network-vif-deleted-36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:13:54 user nova-compute[75247]: INFO nova.compute.manager [req-4aa3161c-2f55-4e89-9eb5-d824063d013b req-346fc291-de9a-4575-a1d6-f0814e83c7fb service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Neutron deleted interface 36c5fc9a-1100-48de-80da-1188909df5e5; detaching it from the instance and deleting it from the info cache
Dec 06 13:13:54 user nova-compute[75247]: DEBUG nova.network.neutron [req-4aa3161c-2f55-4e89-9eb5-d824063d013b req-346fc291-de9a-4575-a1d6-f0814e83c7fb service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:13:54 user nova-compute[75247]: DEBUG nova.compute.manager [req-4aa3161c-2f55-4e89-9eb5-d824063d013b req-346fc291-de9a-4575-a1d6-f0814e83c7fb service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Detach interface failed, port_id=36c5fc9a-1100-48de-80da-1188909df5e5, reason: Instance 2b633bf8-609f-4d56-86f6-b96218435aa6 could not be found. {{(pid=75247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 13:13:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5f643788-46dc-4f14-a133-e5bb4c9e858e tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:13:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5f643788-46dc-4f14-a133-e5bb4c9e858e tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:13:54 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-5f643788-46dc-4f14-a133-e5bb4c9e858e tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:13:54 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-5f643788-46dc-4f14-a133-e5bb4c9e858e tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:13:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5f643788-46dc-4f14-a133-e5bb4c9e858e tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:13:54 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-5f643788-46dc-4f14-a133-e5bb4c9e858e tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Deleted allocations for instance 2b633bf8-609f-4d56-86f6-b96218435aa6
Dec 06 13:13:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5f643788-46dc-4f14-a133-e5bb4c9e858e tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.227s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:13:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:13:55 user nova-compute[75247]: DEBUG nova.compute.manager [req-e2c58de8-de73-4ed9-8826-2b6dd5cc117e req-d8f1ad59-2342-42be-a3a7-dc487dc60d75 service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Received event network-vif-plugged-36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:13:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e2c58de8-de73-4ed9-8826-2b6dd5cc117e req-d8f1ad59-2342-42be-a3a7-dc487dc60d75 service nova] Acquiring lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:13:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e2c58de8-de73-4ed9-8826-2b6dd5cc117e req-d8f1ad59-2342-42be-a3a7-dc487dc60d75 service nova] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:13:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e2c58de8-de73-4ed9-8826-2b6dd5cc117e req-d8f1ad59-2342-42be-a3a7-dc487dc60d75 service nova] Lock "2b633bf8-609f-4d56-86f6-b96218435aa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:13:55 user nova-compute[75247]: DEBUG nova.compute.manager [req-e2c58de8-de73-4ed9-8826-2b6dd5cc117e req-d8f1ad59-2342-42be-a3a7-dc487dc60d75 service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] No waiting events found dispatching network-vif-plugged-36c5fc9a-1100-48de-80da-1188909df5e5 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:13:55 user nova-compute[75247]: WARNING nova.compute.manager [req-e2c58de8-de73-4ed9-8826-2b6dd5cc117e req-d8f1ad59-2342-42be-a3a7-dc487dc60d75 service nova] [instance: 2b633bf8-609f-4d56-86f6-b96218435aa6] Received unexpected event network-vif-plugged-36c5fc9a-1100-48de-80da-1188909df5e5 for instance with vm_state deleted and task_state None.
Dec 06 13:13:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:02 user nova-compute[75247]: DEBUG nova.compute.manager [req-ee12d0f1-4da3-4e11-bd36-bfb73a5628b4 req-2f92234d-a796-4baa-9dc2-a329bbb82de0 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Received event network-changed-7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:14:02 user nova-compute[75247]: DEBUG nova.compute.manager [req-ee12d0f1-4da3-4e11-bd36-bfb73a5628b4 req-2f92234d-a796-4baa-9dc2-a329bbb82de0 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Refreshing instance network info cache due to event network-changed-7110c508-ba09-4d19-bf5f-e2d73c988c28. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:14:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ee12d0f1-4da3-4e11-bd36-bfb73a5628b4 req-2f92234d-a796-4baa-9dc2-a329bbb82de0 service nova] Acquiring lock "refresh_cache-637e64f2-3377-47ce-9891-ea9d9f3b6729" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:14:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ee12d0f1-4da3-4e11-bd36-bfb73a5628b4 req-2f92234d-a796-4baa-9dc2-a329bbb82de0 service nova] Acquired lock "refresh_cache-637e64f2-3377-47ce-9891-ea9d9f3b6729" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:14:02 user nova-compute[75247]: DEBUG nova.network.neutron [req-ee12d0f1-4da3-4e11-bd36-bfb73a5628b4 req-2f92234d-a796-4baa-9dc2-a329bbb82de0 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Refreshing network info cache for port 7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:14:02 user nova-compute[75247]: DEBUG nova.network.neutron [req-ee12d0f1-4da3-4e11-bd36-bfb73a5628b4 req-2f92234d-a796-4baa-9dc2-a329bbb82de0 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Updated VIF entry in instance network info cache for port 7110c508-ba09-4d19-bf5f-e2d73c988c28. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:14:02 user nova-compute[75247]: DEBUG nova.network.neutron [req-ee12d0f1-4da3-4e11-bd36-bfb73a5628b4 req-2f92234d-a796-4baa-9dc2-a329bbb82de0 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Updating instance_info_cache with network_info: [{"id": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "address": "fa:16:3e:dd:1a:11", "network": {"id": "7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1998461599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c05e39382f114be6a2c762890523f4b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7110c508-ba", "ovs_interfaceid": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:14:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ee12d0f1-4da3-4e11-bd36-bfb73a5628b4 req-2f92234d-a796-4baa-9dc2-a329bbb82de0 service nova] Releasing lock "refresh_cache-637e64f2-3377-47ce-9891-ea9d9f3b6729" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:14:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Acquiring lock "637e64f2-3377-47ce-9891-ea9d9f3b6729" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:14:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:14:02 user nova-compute[75247]: INFO nova.compute.manager [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Shelve offloading
Dec 06 13:14:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:03 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Instance destroyed successfully.
Dec 06 13:14:03 user nova-compute[75247]: DEBUG nova.compute.manager [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 13:14:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Acquiring lock "refresh_cache-637e64f2-3377-47ce-9891-ea9d9f3b6729" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:14:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Acquired lock "refresh_cache-637e64f2-3377-47ce-9891-ea9d9f3b6729" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:14:03 user nova-compute[75247]: DEBUG nova.network.neutron [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 13:14:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:03 user nova-compute[75247]: DEBUG nova.network.neutron [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Updating instance_info_cache with network_info: [{"id": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "address": "fa:16:3e:dd:1a:11", "network": {"id": "7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1998461599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c05e39382f114be6a2c762890523f4b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7110c508-ba", "ovs_interfaceid": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:14:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Releasing lock "refresh_cache-637e64f2-3377-47ce-9891-ea9d9f3b6729" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG nova.compute.manager [req-eda62b26-004e-40a8-bf52-30f13de3d1c3 req-fd0370a3-aee3-4a98-a62a-bedb31be6ad9 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Received event network-vif-unplugged-7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-eda62b26-004e-40a8-bf52-30f13de3d1c3 req-fd0370a3-aee3-4a98-a62a-bedb31be6ad9 service nova] Acquiring lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-eda62b26-004e-40a8-bf52-30f13de3d1c3 req-fd0370a3-aee3-4a98-a62a-bedb31be6ad9 service nova] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-eda62b26-004e-40a8-bf52-30f13de3d1c3 req-fd0370a3-aee3-4a98-a62a-bedb31be6ad9 service nova] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG nova.compute.manager [req-eda62b26-004e-40a8-bf52-30f13de3d1c3 req-fd0370a3-aee3-4a98-a62a-bedb31be6ad9 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] No waiting events found dispatching network-vif-unplugged-7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:14:04 user nova-compute[75247]: WARNING nova.compute.manager [req-eda62b26-004e-40a8-bf52-30f13de3d1c3 req-fd0370a3-aee3-4a98-a62a-bedb31be6ad9 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Received unexpected event network-vif-unplugged-7110c508-ba09-4d19-bf5f-e2d73c988c28 for instance with vm_state active and task_state shelving.
Dec 06 13:14:04 user nova-compute[75247]: DEBUG nova.compute.manager [req-eda62b26-004e-40a8-bf52-30f13de3d1c3 req-fd0370a3-aee3-4a98-a62a-bedb31be6ad9 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Received event network-vif-plugged-7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-eda62b26-004e-40a8-bf52-30f13de3d1c3 req-fd0370a3-aee3-4a98-a62a-bedb31be6ad9 service nova] Acquiring lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-eda62b26-004e-40a8-bf52-30f13de3d1c3 req-fd0370a3-aee3-4a98-a62a-bedb31be6ad9 service nova] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-eda62b26-004e-40a8-bf52-30f13de3d1c3 req-fd0370a3-aee3-4a98-a62a-bedb31be6ad9 service nova] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG nova.compute.manager [req-eda62b26-004e-40a8-bf52-30f13de3d1c3 req-fd0370a3-aee3-4a98-a62a-bedb31be6ad9 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] No waiting events found dispatching network-vif-plugged-7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:14:04 user nova-compute[75247]: WARNING nova.compute.manager [req-eda62b26-004e-40a8-bf52-30f13de3d1c3 req-fd0370a3-aee3-4a98-a62a-bedb31be6ad9 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Received unexpected event network-vif-plugged-7110c508-ba09-4d19-bf5f-e2d73c988c28 for instance with vm_state active and task_state shelving.
Dec 06 13:14:04 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Instance destroyed successfully.
Dec 06 13:14:04 user nova-compute[75247]: DEBUG nova.objects.instance [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lazy-loading 'resources' on Instance uuid 637e64f2-3377-47ce-9891-ea9d9f3b6729 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-585733721',display_name='tempest-TestShelveInstance-server-585733721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-585733721',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6bCNIz5q4P0bc7HSiL9tc3LJpv7C6/FKkLh94ST7t6mQK9UVwAkT4qnr/0qZdIPWPutLB+0ikdlsUQLbRuaqB4YyYQlbU4kFnfiRHSFeOt/3VIAmpE/aFHmv7lchH0vQ==',key_name='tempest-TestShelveInstance-816568645',keypairs=<?>,launch_index=0,launched_at=2023-12-06T13:12:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c05e39382f114be6a2c762890523f4b1',ramdisk_id='',reservation_id='r-nnlrt39q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1636467499',owner_user_name='tempest-TestShelveInstance-1636467499-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T13:12:26Z,user_data=None,user_id='830024d5b05e4b5aa6d6d9674cf661e2',uuid=637e64f2-3377-47ce-9891-ea9d9f3b6729,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "address": "fa:16:3e:dd:1a:11", "network": {"id": "7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1998461599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c05e39382f114be6a2c762890523f4b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7110c508-ba", "ovs_interfaceid": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Converting VIF {"id": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "address": "fa:16:3e:dd:1a:11", "network": {"id": "7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1998461599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c05e39382f114be6a2c762890523f4b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7110c508-ba", "ovs_interfaceid": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=7110c508-ba09-4d19-bf5f-e2d73c988c28,network=Network(7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7110c508-ba') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG os_vif [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=7110c508-ba09-4d19-bf5f-e2d73c988c28,network=Network(7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7110c508-ba') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7110c508-ba, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG nova.compute.manager [req-968603a4-4373-4e0d-ade8-2e545a3e59f9 req-25e7a47c-f05e-43c4-a6c9-676781b70835 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Received event network-changed-7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG nova.compute.manager [req-968603a4-4373-4e0d-ade8-2e545a3e59f9 req-25e7a47c-f05e-43c4-a6c9-676781b70835 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Refreshing instance network info cache due to event network-changed-7110c508-ba09-4d19-bf5f-e2d73c988c28. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-968603a4-4373-4e0d-ade8-2e545a3e59f9 req-25e7a47c-f05e-43c4-a6c9-676781b70835 service nova] Acquiring lock "refresh_cache-637e64f2-3377-47ce-9891-ea9d9f3b6729" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-968603a4-4373-4e0d-ade8-2e545a3e59f9 req-25e7a47c-f05e-43c4-a6c9-676781b70835 service nova] Acquired lock "refresh_cache-637e64f2-3377-47ce-9891-ea9d9f3b6729" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG nova.network.neutron [req-968603a4-4373-4e0d-ade8-2e545a3e59f9 req-25e7a47c-f05e-43c4-a6c9-676781b70835 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Refreshing network info cache for port 7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=814b9e77-c5a4-4d58-a9c7-c41824c64020) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:14:04 user nova-compute[75247]: INFO os_vif [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=7110c508-ba09-4d19-bf5f-e2d73c988c28,network=Network(7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7110c508-ba')
Dec 06 13:14:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDgEaVNI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:14:04 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:14:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7b79f3-edec-4b06-aba2-f9fd880a0084]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 13:14:04 user nova-compute[75247]: No targets found.
Dec 06 13:14:04 user nova-compute[75247]: iSNS:
Dec 06 13:14:04 user nova-compute[75247]: No targets found.
Dec 06 13:14:04 user nova-compute[75247]: STATIC:
Dec 06 13:14:04 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68
Dec 06 13:14:04 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:14:04 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:14:04 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c
Dec 06 13:14:04 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:14:04 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:14:04 user nova-compute[75247]: FIRMWARE:
Dec 06 13:14:04 user nova-compute[75247]: No targets found.
Dec 06 13:14:04 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 13:14:04 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 13:14:04 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[384c3852-70d4-46ec-9247-cee53330d9fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35f748e-4f1d-460f-9461-2143172d7809]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)
Dec 06 13:14:04 user nova-compute[75247]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:14:04 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)
Dec 06 13:14:04 user nova-compute[75247]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:14:04 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c68af80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c'): ({'sdd'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Removing single pathed devices sdd {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72b15f1-7d03-4790-ae5f-b05e5e7a761c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[62be635a-9a2e-4991-bcab-9d058e959a62]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Flushing IO for device /dev/sdd {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[585655d5-58fa-425e-aec5-34218dfc55eb]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[863fabde-3ce7-43b0-a265-9b2b1940eeca]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] SCSI volumes sdd have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[febc7d80-7443-4e83-b6ae-5ddb7a6c5c50]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19da78a-e8be-4f91-ba3d-2272ef726ac5]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c, portal: 172.16.0.220,3260]
Dec 06 13:14:04 user nova-compute[75247]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c, portal: 172.16.0.220,3260] successful.
Dec 06 13:14:04 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f050cfaf-b08e-4df5-92e1-ebc81d1f8fa6]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] <== disconnect_volume: return (309ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 13:14:04 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Deleting instance files /opt/stack/data/nova/instances/637e64f2-3377-47ce-9891-ea9d9f3b6729_del
Dec 06 13:14:04 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Deletion of /opt/stack/data/nova/instances/637e64f2-3377-47ce-9891-ea9d9f3b6729_del complete
Dec 06 13:14:04 user nova-compute[75247]: DEBUG nova.network.neutron [req-968603a4-4373-4e0d-ade8-2e545a3e59f9 req-25e7a47c-f05e-43c4-a6c9-676781b70835 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Updated VIF entry in instance network info cache for port 7110c508-ba09-4d19-bf5f-e2d73c988c28. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG nova.network.neutron [req-968603a4-4373-4e0d-ade8-2e545a3e59f9 req-25e7a47c-f05e-43c4-a6c9-676781b70835 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Updating instance_info_cache with network_info: [{"id": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "address": "fa:16:3e:dd:1a:11", "network": {"id": "7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5", "bridge": null, "label": "tempest-TestShelveInstance-1998461599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c05e39382f114be6a2c762890523f4b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap7110c508-ba", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:14:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-968603a4-4373-4e0d-ade8-2e545a3e59f9 req-25e7a47c-f05e-43c4-a6c9-676781b70835 service nova] Releasing lock "refresh_cache-637e64f2-3377-47ce-9891-ea9d9f3b6729" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:14:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:05 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Deleted allocations for instance 637e64f2-3377-47ce-9891-ea9d9f3b6729
Dec 06 13:14:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:14:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:14:05 user nova-compute[75247]: DEBUG nova.objects.instance [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lazy-loading 'numa_topology' on Instance uuid 637e64f2-3377-47ce-9891-ea9d9f3b6729 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:14:05 user nova-compute[75247]: DEBUG nova.objects.base [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Object Instance<637e64f2-3377-47ce-9891-ea9d9f3b6729> lazy-loaded attributes: resources,numa_topology {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 13:14:05 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:14:05 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:14:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:14:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d417e627-eb7e-4cf9-b1d6-68801f4042bc tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.269s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:14:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:14:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:14:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:14:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:14:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:14:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:29 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:14:30 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:14:30 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:14:31 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:14:33 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:14:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:14:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:36 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:14:37 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:14:37 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:14:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:14:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:14:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:14:37 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:14:38 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:14:38 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:14:38 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:14:38 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=8925MB free_disk=25.084182739257812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:14:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:14:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:14:38 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance c15d3c59-c91a-4b67-bd8a-731751a2fa6c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:14:38 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:14:38 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:14:38 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:14:38 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:14:38 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:14:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:14:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:39 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:14:39 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:14:40 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:14:40 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:14:40 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Dec 06 13:14:40 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Didn't find any instances for network info cache update. {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 13:14:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "a8e82f38-ad86-4592-988f-a2bd5f917172" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:14:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "a8e82f38-ad86-4592-988f-a2bd5f917172" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:14:45 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 13:14:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:14:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:14:45 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 13:14:45 user nova-compute[75247]: INFO nova.compute.claims [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Claim successful on node user
Dec 06 13:14:46 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:14:46 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:14:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.239s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:14:46 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 13:14:46 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 13:14:46 user nova-compute[75247]: DEBUG nova.network.neutron [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 13:14:46 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 13:14:46 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 13:14:46 user nova-compute[75247]: DEBUG nova.policy [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6e50e8cc91ca4ff88ebfa0b2888699d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f58adbd4d004a44b37a0e0922da5aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 13:14:46 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 13:14:46 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 13:14:46 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Creating image(s)
Dec 06 13:14:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:14:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "/opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:14:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "/opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:14:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:14:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.180s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:14:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:14:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:14:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:14:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.172s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:14:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:14:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk 1073741824" returned: 0 in 0.050s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:14:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:14:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:14:46 user nova-compute[75247]: DEBUG nova.network.neutron [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Successfully created port: 8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.181s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Cannot resize image /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Ensure instance console log exists: /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.network.neutron [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Successfully updated port: 8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquired lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.network.neutron [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-1447d6e2-a8fb-46bd-b0e7-8e8a7191d149 req-80139469-2a40-4c6d-8e0b-c954041f7b4c service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Received event network-changed-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-1447d6e2-a8fb-46bd-b0e7-8e8a7191d149 req-80139469-2a40-4c6d-8e0b-c954041f7b4c service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Refreshing instance network info cache due to event network-changed-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1447d6e2-a8fb-46bd-b0e7-8e8a7191d149 req-80139469-2a40-4c6d-8e0b-c954041f7b4c service nova] Acquiring lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.network.neutron [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.network.neutron [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Updating instance_info_cache with network_info: [{"id": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "address": "fa:16:3e:55:4b:24", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e50c43f-5c", "ovs_interfaceid": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Releasing lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Instance network_info: |[{"id": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "address": "fa:16:3e:55:4b:24", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e50c43f-5c", "ovs_interfaceid": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1447d6e2-a8fb-46bd-b0e7-8e8a7191d149 req-80139469-2a40-4c6d-8e0b-c954041f7b4c service nova] Acquired lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.network.neutron [req-1447d6e2-a8fb-46bd-b0e7-8e8a7191d149 req-80139469-2a40-4c6d-8e0b-c954041f7b4c service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Refreshing network info cache for port 8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Start _get_guest_xml network_info=[{"id": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "address": "fa:16:3e:55:4b:24", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e50c43f-5c", "ovs_interfaceid": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 13:14:47 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:14:47 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:14:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-568751134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-568751134',id=51,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDirUm2nl+6xaUZ6Yxi+egbsaNJRnA3LShnM84PDKd17/Zx/JnnPkY/xZcoDkfexZcEbGFZHezj44E5uV1v3R4USebgCgWihz36GwGfRzTF2yDzBboC/1ieEBOvIi4v3OQ==',key_name='tempest-keypair-476765996',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f58adbd4d004a44b37a0e0922da5aa3',ramdisk_id='',reservation_id='r-xzfpgnx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2058750591',owner_user_name='tempest-AttachVolumeShelveTestJSON-2058750591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:14:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e50e8cc91ca4ff88ebfa0b2888699d5',uuid=a8e82f38-ad86-4592-988f-a2bd5f917172,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "address": "fa:16:3e:55:4b:24", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e50c43f-5c", "ovs_interfaceid": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Converting VIF {"id": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "address": "fa:16:3e:55:4b:24", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e50c43f-5c", "ovs_interfaceid": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:4b:24,bridge_name='br-int',has_traffic_filtering=True,id=8e50c43f-5c99-4e86-ab1f-f90ed2a390ac,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e50c43f-5c') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.objects.instance [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lazy-loading 'pci_devices' on Instance uuid a8e82f38-ad86-4592-988f-a2bd5f917172 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] End _get_guest_xml xml=<domain type="kvm">
Dec 06 13:14:47 user nova-compute[75247]:   <uuid>a8e82f38-ad86-4592-988f-a2bd5f917172</uuid>
Dec 06 13:14:47 user nova-compute[75247]:   <name>instance-00000033</name>
Dec 06 13:14:47 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 13:14:47 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 13:14:47 user nova-compute[75247]:   <metadata>
Dec 06 13:14:47 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 13:14:47 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 13:14:47 user nova-compute[75247]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-568751134</nova:name>
Dec 06 13:14:47 user nova-compute[75247]:       <nova:creationTime>2023-12-06 13:14:47</nova:creationTime>
Dec 06 13:14:47 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 13:14:47 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 13:14:47 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 13:14:47 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 13:14:47 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 13:14:47 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 13:14:47 user nova-compute[75247]:       </nova:flavor>
Dec 06 13:14:47 user nova-compute[75247]:       <nova:owner>
Dec 06 13:14:47 user nova-compute[75247]:         <nova:user uuid="6e50e8cc91ca4ff88ebfa0b2888699d5">tempest-AttachVolumeShelveTestJSON-2058750591-project-member</nova:user>
Dec 06 13:14:47 user nova-compute[75247]:         <nova:project uuid="9f58adbd4d004a44b37a0e0922da5aa3">tempest-AttachVolumeShelveTestJSON-2058750591</nova:project>
Dec 06 13:14:47 user nova-compute[75247]:       </nova:owner>
Dec 06 13:14:47 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 13:14:47 user nova-compute[75247]:       <nova:ports>
Dec 06 13:14:47 user nova-compute[75247]:         <nova:port uuid="8e50c43f-5c99-4e86-ab1f-f90ed2a390ac">
Dec 06 13:14:47 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 06 13:14:47 user nova-compute[75247]:         </nova:port>
Dec 06 13:14:47 user nova-compute[75247]:       </nova:ports>
Dec 06 13:14:47 user nova-compute[75247]:     </nova:instance>
Dec 06 13:14:47 user nova-compute[75247]:   </metadata>
Dec 06 13:14:47 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 13:14:47 user nova-compute[75247]:     <system>
Dec 06 13:14:47 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 13:14:47 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 13:14:47 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 13:14:47 user nova-compute[75247]:       <entry name="serial">a8e82f38-ad86-4592-988f-a2bd5f917172</entry>
Dec 06 13:14:47 user nova-compute[75247]:       <entry name="uuid">a8e82f38-ad86-4592-988f-a2bd5f917172</entry>
Dec 06 13:14:47 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 13:14:47 user nova-compute[75247]:     </system>
Dec 06 13:14:47 user nova-compute[75247]:   </sysinfo>
Dec 06 13:14:47 user nova-compute[75247]:   <os>
Dec 06 13:14:47 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 13:14:47 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 13:14:47 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 13:14:47 user nova-compute[75247]:   </os>
Dec 06 13:14:47 user nova-compute[75247]:   <features>
Dec 06 13:14:47 user nova-compute[75247]:     <acpi/>
Dec 06 13:14:47 user nova-compute[75247]:     <apic/>
Dec 06 13:14:47 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 13:14:47 user nova-compute[75247]:   </features>
Dec 06 13:14:47 user nova-compute[75247]:   <clock offset="utc">
Dec 06 13:14:47 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 13:14:47 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 13:14:47 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 13:14:47 user nova-compute[75247]:   </clock>
Dec 06 13:14:47 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 13:14:47 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 13:14:47 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 13:14:47 user nova-compute[75247]:   </cpu>
Dec 06 13:14:47 user nova-compute[75247]:   <devices>
Dec 06 13:14:47 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 13:14:47 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 13:14:47 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk"/>
Dec 06 13:14:47 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 13:14:47 user nova-compute[75247]:     </disk>
Dec 06 13:14:47 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 13:14:47 user nova-compute[75247]:       <mac address="fa:16:3e:55:4b:24"/>
Dec 06 13:14:47 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:14:47 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 13:14:47 user nova-compute[75247]:       <target dev="tap8e50c43f-5c"/>
Dec 06 13:14:47 user nova-compute[75247]:     </interface>
Dec 06 13:14:47 user nova-compute[75247]:     <serial type="pty">
Dec 06 13:14:47 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/console.log" append="off"/>
Dec 06 13:14:47 user nova-compute[75247]:     </serial>
Dec 06 13:14:47 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 13:14:47 user nova-compute[75247]:     <video>
Dec 06 13:14:47 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:14:47 user nova-compute[75247]:     </video>
Dec 06 13:14:47 user nova-compute[75247]:     <rng model="virtio">
Dec 06 13:14:47 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 13:14:47 user nova-compute[75247]:     </rng>
Dec 06 13:14:47 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 13:14:47 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 13:14:47 user nova-compute[75247]:       <stats period="10"/>
Dec 06 13:14:47 user nova-compute[75247]:     </memballoon>
Dec 06 13:14:47 user nova-compute[75247]:   </devices>
Dec 06 13:14:47 user nova-compute[75247]: </domain>
Dec 06 13:14:47 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:14:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-568751134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-568751134',id=51,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDirUm2nl+6xaUZ6Yxi+egbsaNJRnA3LShnM84PDKd17/Zx/JnnPkY/xZcoDkfexZcEbGFZHezj44E5uV1v3R4USebgCgWihz36GwGfRzTF2yDzBboC/1ieEBOvIi4v3OQ==',key_name='tempest-keypair-476765996',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f58adbd4d004a44b37a0e0922da5aa3',ramdisk_id='',reservation_id='r-xzfpgnx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2058750591',owner_user_name='tempest-AttachVolumeShelveTestJSON-2058750591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:14:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e50e8cc91ca4ff88ebfa0b2888699d5',uuid=a8e82f38-ad86-4592-988f-a2bd5f917172,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "address": "fa:16:3e:55:4b:24", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e50c43f-5c", "ovs_interfaceid": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Converting VIF {"id": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "address": "fa:16:3e:55:4b:24", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e50c43f-5c", "ovs_interfaceid": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:4b:24,bridge_name='br-int',has_traffic_filtering=True,id=8e50c43f-5c99-4e86-ab1f-f90ed2a390ac,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e50c43f-5c') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG os_vif [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:4b:24,bridge_name='br-int',has_traffic_filtering=True,id=8e50c43f-5c99-4e86-ab1f-f90ed2a390ac,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e50c43f-5c') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d77c407-b30e-5267-8bb1-2fbd6389322d', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e50c43f-5c, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e50c43f-5c, col_values=(('qos', UUID('fac5e0a1-26f3-4e5d-9a23-67934520a1af')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e50c43f-5c, col_values=(('external_ids', {'iface-id': '8e50c43f-5c99-4e86-ab1f-f90ed2a390ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:4b:24', 'vm-uuid': 'a8e82f38-ad86-4592-988f-a2bd5f917172'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:47 user nova-compute[75247]: INFO os_vif [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:4b:24,bridge_name='br-int',has_traffic_filtering=True,id=8e50c43f-5c99-4e86-ab1f-f90ed2a390ac,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e50c43f-5c')
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:14:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] No VIF found with MAC fa:16:3e:55:4b:24, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 13:14:48 user nova-compute[75247]: DEBUG nova.network.neutron [req-1447d6e2-a8fb-46bd-b0e7-8e8a7191d149 req-80139469-2a40-4c6d-8e0b-c954041f7b4c service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Updated VIF entry in instance network info cache for port 8e50c43f-5c99-4e86-ab1f-f90ed2a390ac. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:14:48 user nova-compute[75247]: DEBUG nova.network.neutron [req-1447d6e2-a8fb-46bd-b0e7-8e8a7191d149 req-80139469-2a40-4c6d-8e0b-c954041f7b4c service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Updating instance_info_cache with network_info: [{"id": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "address": "fa:16:3e:55:4b:24", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e50c43f-5c", "ovs_interfaceid": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:14:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1447d6e2-a8fb-46bd-b0e7-8e8a7191d149 req-80139469-2a40-4c6d-8e0b-c954041f7b4c service nova] Releasing lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:14:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-75ec35b4-4c14-479d-ba05-19145f5cfb77 req-6e0cc3fb-1457-4de9-9a49-0aca6b388fc9 service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Received event network-vif-plugged-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:14:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-75ec35b4-4c14-479d-ba05-19145f5cfb77 req-6e0cc3fb-1457-4de9-9a49-0aca6b388fc9 service nova] Acquiring lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:14:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-75ec35b4-4c14-479d-ba05-19145f5cfb77 req-6e0cc3fb-1457-4de9-9a49-0aca6b388fc9 service nova] Lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:14:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-75ec35b4-4c14-479d-ba05-19145f5cfb77 req-6e0cc3fb-1457-4de9-9a49-0aca6b388fc9 service nova] Lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:14:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-75ec35b4-4c14-479d-ba05-19145f5cfb77 req-6e0cc3fb-1457-4de9-9a49-0aca6b388fc9 service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] No waiting events found dispatching network-vif-plugged-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:14:49 user nova-compute[75247]: WARNING nova.compute.manager [req-75ec35b4-4c14-479d-ba05-19145f5cfb77 req-6e0cc3fb-1457-4de9-9a49-0aca6b388fc9 service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Received unexpected event network-vif-plugged-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac for instance with vm_state building and task_state spawning.
Dec 06 13:14:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:51 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 13:14:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 13:14:51 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Instance spawned successfully.
Dec 06 13:14:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 13:14:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:14:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:14:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:14:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:14:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:14:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:14:51 user nova-compute[75247]: INFO nova.compute.manager [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Took 5.07 seconds to spawn the instance on the hypervisor.
Dec 06 13:14:51 user nova-compute[75247]: DEBUG nova.compute.manager [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 13:14:51 user nova-compute[75247]: INFO nova.compute.manager [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Took 5.64 seconds to build instance.
Dec 06 13:14:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-7da7f792-4c74-44b0-b871-6765874df64d tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "a8e82f38-ad86-4592-988f-a2bd5f917172" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.737s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:14:51 user nova-compute[75247]: DEBUG nova.compute.manager [req-39ae6984-7b09-406f-8e1e-66ed8fb1bd3e req-c3007fae-0cfd-4962-a6ba-41cb29fe632a service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Received event network-vif-plugged-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:14:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-39ae6984-7b09-406f-8e1e-66ed8fb1bd3e req-c3007fae-0cfd-4962-a6ba-41cb29fe632a service nova] Acquiring lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:14:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-39ae6984-7b09-406f-8e1e-66ed8fb1bd3e req-c3007fae-0cfd-4962-a6ba-41cb29fe632a service nova] Lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:14:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-39ae6984-7b09-406f-8e1e-66ed8fb1bd3e req-c3007fae-0cfd-4962-a6ba-41cb29fe632a service nova] Lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:14:51 user nova-compute[75247]: DEBUG nova.compute.manager [req-39ae6984-7b09-406f-8e1e-66ed8fb1bd3e req-c3007fae-0cfd-4962-a6ba-41cb29fe632a service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] No waiting events found dispatching network-vif-plugged-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:14:51 user nova-compute[75247]: WARNING nova.compute.manager [req-39ae6984-7b09-406f-8e1e-66ed8fb1bd3e req-c3007fae-0cfd-4962-a6ba-41cb29fe632a service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Received unexpected event network-vif-plugged-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac for instance with vm_state active and task_state None.
Dec 06 13:14:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:14:57 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:15:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:15:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:15:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:15:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:15:02 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:12 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:17 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:18 user nova-compute[75247]: DEBUG nova.compute.manager [req-5b16a139-74c2-48c2-ac17-aa727f7af953 req-c42e25ab-3fa2-40e0-9d5c-5d9ca242404a service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Received event network-changed-774027f4-84e8-46cd-8d40-4cdb269c4591 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:15:18 user nova-compute[75247]: DEBUG nova.compute.manager [req-5b16a139-74c2-48c2-ac17-aa727f7af953 req-c42e25ab-3fa2-40e0-9d5c-5d9ca242404a service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Refreshing instance network info cache due to event network-changed-774027f4-84e8-46cd-8d40-4cdb269c4591. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:15:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5b16a139-74c2-48c2-ac17-aa727f7af953 req-c42e25ab-3fa2-40e0-9d5c-5d9ca242404a service nova] Acquiring lock "refresh_cache-c15d3c59-c91a-4b67-bd8a-731751a2fa6c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:15:18 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5b16a139-74c2-48c2-ac17-aa727f7af953 req-c42e25ab-3fa2-40e0-9d5c-5d9ca242404a service nova] Acquired lock "refresh_cache-c15d3c59-c91a-4b67-bd8a-731751a2fa6c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:15:18 user nova-compute[75247]: DEBUG nova.network.neutron [req-5b16a139-74c2-48c2-ac17-aa727f7af953 req-c42e25ab-3fa2-40e0-9d5c-5d9ca242404a service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Refreshing network info cache for port 774027f4-84e8-46cd-8d40-4cdb269c4591 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:15:19 user nova-compute[75247]: DEBUG nova.network.neutron [req-5b16a139-74c2-48c2-ac17-aa727f7af953 req-c42e25ab-3fa2-40e0-9d5c-5d9ca242404a service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Updated VIF entry in instance network info cache for port 774027f4-84e8-46cd-8d40-4cdb269c4591. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:15:19 user nova-compute[75247]: DEBUG nova.network.neutron [req-5b16a139-74c2-48c2-ac17-aa727f7af953 req-c42e25ab-3fa2-40e0-9d5c-5d9ca242404a service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Updating instance_info_cache with network_info: [{"id": "774027f4-84e8-46cd-8d40-4cdb269c4591", "address": "fa:16:3e:75:aa:77", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774027f4-84", "ovs_interfaceid": "774027f4-84e8-46cd-8d40-4cdb269c4591", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:15:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-5b16a139-74c2-48c2-ac17-aa727f7af953 req-c42e25ab-3fa2-40e0-9d5c-5d9ca242404a service nova] Releasing lock "refresh_cache-c15d3c59-c91a-4b67-bd8a-731751a2fa6c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:15:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:22 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "240226d1-c92f-4286-81a9-783577fb194c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "240226d1-c92f-4286-81a9-783577fb194c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG nova.compute.manager [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 13:15:27 user nova-compute[75247]: INFO nova.compute.claims [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Claim successful on node user
Dec 06 13:15:27 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.227s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG nova.compute.manager [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG nova.compute.manager [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG nova.network.neutron [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 13:15:27 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 13:15:27 user nova-compute[75247]: DEBUG nova.compute.manager [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG nova.policy [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '016714f7502b4a8fa12ed0ce6644c5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9493d9b0b1024cea9a550e2a42c1e6a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 13:15:27 user nova-compute[75247]: INFO nova.virt.block_device [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Booting with volume f0c179e9-bca5-454b-9dc0-61315a5363b2 at /dev/vda
Dec 06 13:15:27 user nova-compute[75247]: DEBUG os_brick.utils [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[babdd588-49f0-4c07-b9c4-d2d5eb14637c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a94b0c3-f508-4696-80d0-5162f3612edc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dfb49b-c496-4a8d-86cf-c4908e0fcdda]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[33376c90-4b5c-4186-8f55-74cfaef4da2a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 13:15:27 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:15:28 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:15:28 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 13:15:28 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[691be751-40a9-416f-9b57-be00c7cc6b77]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:15:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 13:15:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 13:15:28 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 13:15:28 user nova-compute[75247]: DEBUG os_brick.utils [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:15:28 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Updating existing volume attachment record: 951582b5-2888-4160-b194-37de5dedfe86 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 13:15:28 user nova-compute[75247]: DEBUG nova.network.neutron [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Successfully created port: b7afc02f-f620-499f-bae1-d8674398b769 {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 13:15:29 user nova-compute[75247]: DEBUG nova.network.neutron [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Successfully updated port: b7afc02f-f620-499f-bae1-d8674398b769 {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 13:15:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "refresh_cache-240226d1-c92f-4286-81a9-783577fb194c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:15:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquired lock "refresh_cache-240226d1-c92f-4286-81a9-783577fb194c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:15:29 user nova-compute[75247]: DEBUG nova.network.neutron [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 13:15:29 user nova-compute[75247]: DEBUG nova.compute.manager [req-0f14396e-0702-408a-88e3-9cbb6eb2c3a6 req-183b95a2-fc2e-4f63-a46b-50933cf17203 service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Received event network-changed-b7afc02f-f620-499f-bae1-d8674398b769 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:15:29 user nova-compute[75247]: DEBUG nova.compute.manager [req-0f14396e-0702-408a-88e3-9cbb6eb2c3a6 req-183b95a2-fc2e-4f63-a46b-50933cf17203 service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Refreshing instance network info cache due to event network-changed-b7afc02f-f620-499f-bae1-d8674398b769. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:15:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0f14396e-0702-408a-88e3-9cbb6eb2c3a6 req-183b95a2-fc2e-4f63-a46b-50933cf17203 service nova] Acquiring lock "refresh_cache-240226d1-c92f-4286-81a9-783577fb194c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:15:29 user nova-compute[75247]: DEBUG nova.network.neutron [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 13:15:29 user nova-compute[75247]: DEBUG nova.network.neutron [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Updating instance_info_cache with network_info: [{"id": "b7afc02f-f620-499f-bae1-d8674398b769", "address": "fa:16:3e:03:55:46", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7afc02f-f6", "ovs_interfaceid": "b7afc02f-f620-499f-bae1-d8674398b769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:15:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Releasing lock "refresh_cache-240226d1-c92f-4286-81a9-783577fb194c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:15:29 user nova-compute[75247]: DEBUG nova.compute.manager [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Instance network_info: |[{"id": "b7afc02f-f620-499f-bae1-d8674398b769", "address": "fa:16:3e:03:55:46", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7afc02f-f6", "ovs_interfaceid": "b7afc02f-f620-499f-bae1-d8674398b769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 13:15:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0f14396e-0702-408a-88e3-9cbb6eb2c3a6 req-183b95a2-fc2e-4f63-a46b-50933cf17203 service nova] Acquired lock "refresh_cache-240226d1-c92f-4286-81a9-783577fb194c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:15:29 user nova-compute[75247]: DEBUG nova.network.neutron [req-0f14396e-0702-408a-88e3-9cbb6eb2c3a6 req-183b95a2-fc2e-4f63-a46b-50933cf17203 service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Refreshing network info cache for port b7afc02f-f620-499f-bae1-d8674398b769 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:15:29 user nova-compute[75247]: DEBUG nova.network.neutron [req-0f14396e-0702-408a-88e3-9cbb6eb2c3a6 req-183b95a2-fc2e-4f63-a46b-50933cf17203 service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Updated VIF entry in instance network info cache for port b7afc02f-f620-499f-bae1-d8674398b769. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:15:29 user nova-compute[75247]: DEBUG nova.network.neutron [req-0f14396e-0702-408a-88e3-9cbb6eb2c3a6 req-183b95a2-fc2e-4f63-a46b-50933cf17203 service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Updating instance_info_cache with network_info: [{"id": "b7afc02f-f620-499f-bae1-d8674398b769", "address": "fa:16:3e:03:55:46", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7afc02f-f6", "ovs_interfaceid": "b7afc02f-f620-499f-bae1-d8674398b769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:15:29 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-0f14396e-0702-408a-88e3-9cbb6eb2c3a6 req-183b95a2-fc2e-4f63-a46b-50933cf17203 service nova] Releasing lock "refresh_cache-240226d1-c92f-4286-81a9-783577fb194c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:15:30 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:15:31 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:15:32 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:15:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:15:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:15:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:15:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:15:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:15:32 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:34 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:15:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:36 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG nova.compute.manager [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 13:15:37 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Creating image(s)
Dec 06 13:15:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Did not create local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Ensure instance console log exists: /opt/stack/data/nova/instances/240226d1-c92f-4286-81a9-783577fb194c/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Start _get_guest_xml network_info=[{"id": "b7afc02f-f620-499f-bae1-d8674398b769", "address": "fa:16:3e:03:55:46", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7afc02f-f6", "ovs_interfaceid": "b7afc02f-f620-499f-bae1-d8674398b769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '951582b5-2888-4160-b194-37de5dedfe86', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFoVzmQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '240226d1-c92f-4286-81a9-783577fb194c', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0c179e9-bca5-454b-9dc0-61315a5363b2', 'serial': 'f0c179e9-bca5-454b-9dc0-61315a5363b2'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 13:15:37 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:15:37 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:15:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFoVzmQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:15:37 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:15:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:15:37 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:15:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:15:37 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7010bc7-7cd7-4791-a64c-4b1add073b4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 13:15:37 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[efebbc22-4170-4fed-b537-534d15686413]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2] added
Dec 06 13:15:37 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2726d6-1ba9-4693-8478-5a5cb7740d75]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9cb5c7-9e8b-4bb4-a965-6ec2b0382695]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KFoVzmQh {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KFoVzmQh" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2fd15c-97a0-4e64-b66e-300794ba3b63]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KFoVzmQh'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd1a9c3-7272-43d0-a194-f217fe56e466]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[022ac434-8ce3-4bd5-ba5d-5e2311d5ee3d]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:15:37 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:15:37 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc16e94-2dbf-4d42-936b-f89027d3a483]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2, portal: 172.16.0.220,3260]
Dec 06 13:15:37 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2, portal: 172.16.0.220,3260] successful.
Dec 06 13:15:37 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74510f7-743d-4f4a-a42b-477a364a5d07]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a27186-7a89-417e-965b-66058bc9ee62]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:15:37 user nova-compute[75247]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 (non-flash)
Dec 06 13:15:37 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:15:37 user nova-compute[75247]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 (non-flash)
Dec 06 13:15:37 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] HCTL ('34', '-', '-', 0) found on session 62 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dc901f-f4c0-462b-8d96-e2ae091abfc6]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFoVzmQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:15:37 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.620s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] <== connect_volume: return (1622ms) {'type': 'block', 'scsi_wwn': '23066643164313536', 'path': '/dev/sdc'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066643164313536', 'path': '/dev/sdc'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 13:15:38 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:15:38 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:15:38 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=8796MB free_disk=25.053714752197266GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-101312041',display_name='tempest-TestVolumeBootPattern-server-101312041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-101312041',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+e3XTLfVN8C3itmblwy09HtnE6ODmf3LMeZLWfbnBfl5D2ms/C+dYrJrc6lCBYNrZ/pLuupAxLsGv6ZOwhXojQ4RlmELXbFB3bv70Zc31yz9kRGkDkIlpeboSBmcUYgg==',key_name='tempest-TestVolumeBootPattern-1199968839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9493d9b0b1024cea9a550e2a42c1e6a1',ramdisk_id='',reservation_id='r-ynby2hq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2088852773',owner_user_name='tempest-TestVolumeBootPattern-2088852773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:15:28Z,user_data=None,user_id='016714f7502b4a8fa12ed0ce6644c5fc',uuid=240226d1-c92f-4286-81a9-783577fb194c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7afc02f-f620-499f-bae1-d8674398b769", "address": "fa:16:3e:03:55:46", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7afc02f-f6", "ovs_interfaceid": "b7afc02f-f620-499f-bae1-d8674398b769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converting VIF {"id": "b7afc02f-f620-499f-bae1-d8674398b769", "address": "fa:16:3e:03:55:46", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7afc02f-f6", "ovs_interfaceid": "b7afc02f-f620-499f-bae1-d8674398b769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:55:46,bridge_name='br-int',has_traffic_filtering=True,id=b7afc02f-f620-499f-bae1-d8674398b769,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7afc02f-f6') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG nova.objects.instance [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lazy-loading 'pci_devices' on Instance uuid 240226d1-c92f-4286-81a9-783577fb194c {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] End _get_guest_xml xml=<domain type="kvm">
Dec 06 13:15:38 user nova-compute[75247]:   <uuid>240226d1-c92f-4286-81a9-783577fb194c</uuid>
Dec 06 13:15:38 user nova-compute[75247]:   <name>instance-00000034</name>
Dec 06 13:15:38 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 13:15:38 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 13:15:38 user nova-compute[75247]:   <metadata>
Dec 06 13:15:38 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 13:15:38 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 13:15:38 user nova-compute[75247]:       <nova:name>tempest-TestVolumeBootPattern-server-101312041</nova:name>
Dec 06 13:15:38 user nova-compute[75247]:       <nova:creationTime>2023-12-06 13:15:37</nova:creationTime>
Dec 06 13:15:38 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 13:15:38 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 13:15:38 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 13:15:38 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 13:15:38 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 13:15:38 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 13:15:38 user nova-compute[75247]:       </nova:flavor>
Dec 06 13:15:38 user nova-compute[75247]:       <nova:owner>
Dec 06 13:15:38 user nova-compute[75247]:         <nova:user uuid="016714f7502b4a8fa12ed0ce6644c5fc">tempest-TestVolumeBootPattern-2088852773-project-member</nova:user>
Dec 06 13:15:38 user nova-compute[75247]:         <nova:project uuid="9493d9b0b1024cea9a550e2a42c1e6a1">tempest-TestVolumeBootPattern-2088852773</nova:project>
Dec 06 13:15:38 user nova-compute[75247]:       </nova:owner>
Dec 06 13:15:38 user nova-compute[75247]:       <nova:ports>
Dec 06 13:15:38 user nova-compute[75247]:         <nova:port uuid="b7afc02f-f620-499f-bae1-d8674398b769">
Dec 06 13:15:38 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 06 13:15:38 user nova-compute[75247]:         </nova:port>
Dec 06 13:15:38 user nova-compute[75247]:       </nova:ports>
Dec 06 13:15:38 user nova-compute[75247]:     </nova:instance>
Dec 06 13:15:38 user nova-compute[75247]:   </metadata>
Dec 06 13:15:38 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 13:15:38 user nova-compute[75247]:     <system>
Dec 06 13:15:38 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 13:15:38 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 13:15:38 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 13:15:38 user nova-compute[75247]:       <entry name="serial">240226d1-c92f-4286-81a9-783577fb194c</entry>
Dec 06 13:15:38 user nova-compute[75247]:       <entry name="uuid">240226d1-c92f-4286-81a9-783577fb194c</entry>
Dec 06 13:15:38 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 13:15:38 user nova-compute[75247]:     </system>
Dec 06 13:15:38 user nova-compute[75247]:   </sysinfo>
Dec 06 13:15:38 user nova-compute[75247]:   <os>
Dec 06 13:15:38 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 13:15:38 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 13:15:38 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 13:15:38 user nova-compute[75247]:   </os>
Dec 06 13:15:38 user nova-compute[75247]:   <features>
Dec 06 13:15:38 user nova-compute[75247]:     <acpi/>
Dec 06 13:15:38 user nova-compute[75247]:     <apic/>
Dec 06 13:15:38 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 13:15:38 user nova-compute[75247]:   </features>
Dec 06 13:15:38 user nova-compute[75247]:   <clock offset="utc">
Dec 06 13:15:38 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 13:15:38 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 13:15:38 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 13:15:38 user nova-compute[75247]:   </clock>
Dec 06 13:15:38 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 13:15:38 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 13:15:38 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 13:15:38 user nova-compute[75247]:   </cpu>
Dec 06 13:15:38 user nova-compute[75247]:   <devices>
Dec 06 13:15:38 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 13:15:38 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:15:38 user nova-compute[75247]:       <source dev="/dev/sdc"/>
Dec 06 13:15:38 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 13:15:38 user nova-compute[75247]:       <serial>f0c179e9-bca5-454b-9dc0-61315a5363b2</serial>
Dec 06 13:15:38 user nova-compute[75247]:     </disk>
Dec 06 13:15:38 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 13:15:38 user nova-compute[75247]:       <mac address="fa:16:3e:03:55:46"/>
Dec 06 13:15:38 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:15:38 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 13:15:38 user nova-compute[75247]:       <target dev="tapb7afc02f-f6"/>
Dec 06 13:15:38 user nova-compute[75247]:     </interface>
Dec 06 13:15:38 user nova-compute[75247]:     <serial type="pty">
Dec 06 13:15:38 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/240226d1-c92f-4286-81a9-783577fb194c/console.log" append="off"/>
Dec 06 13:15:38 user nova-compute[75247]:     </serial>
Dec 06 13:15:38 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 13:15:38 user nova-compute[75247]:     <video>
Dec 06 13:15:38 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:15:38 user nova-compute[75247]:     </video>
Dec 06 13:15:38 user nova-compute[75247]:     <rng model="virtio">
Dec 06 13:15:38 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 13:15:38 user nova-compute[75247]:     </rng>
Dec 06 13:15:38 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 13:15:38 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 13:15:38 user nova-compute[75247]:       <stats period="10"/>
Dec 06 13:15:38 user nova-compute[75247]:     </memballoon>
Dec 06 13:15:38 user nova-compute[75247]:   </devices>
Dec 06 13:15:38 user nova-compute[75247]: </domain>
Dec 06 13:15:38 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-101312041',display_name='tempest-TestVolumeBootPattern-server-101312041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-101312041',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+e3XTLfVN8C3itmblwy09HtnE6ODmf3LMeZLWfbnBfl5D2ms/C+dYrJrc6lCBYNrZ/pLuupAxLsGv6ZOwhXojQ4RlmELXbFB3bv70Zc31yz9kRGkDkIlpeboSBmcUYgg==',key_name='tempest-TestVolumeBootPattern-1199968839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9493d9b0b1024cea9a550e2a42c1e6a1',ramdisk_id='',reservation_id='r-ynby2hq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2088852773',owner_user_name='tempest-TestVolumeBootPattern-2088852773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:15:28Z,user_data=None,user_id='016714f7502b4a8fa12ed0ce6644c5fc',uuid=240226d1-c92f-4286-81a9-783577fb194c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7afc02f-f620-499f-bae1-d8674398b769", "address": "fa:16:3e:03:55:46", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7afc02f-f6", "ovs_interfaceid": "b7afc02f-f620-499f-bae1-d8674398b769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converting VIF {"id": "b7afc02f-f620-499f-bae1-d8674398b769", "address": "fa:16:3e:03:55:46", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7afc02f-f6", "ovs_interfaceid": "b7afc02f-f620-499f-bae1-d8674398b769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:55:46,bridge_name='br-int',has_traffic_filtering=True,id=b7afc02f-f620-499f-bae1-d8674398b769,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7afc02f-f6') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG os_vif [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:55:46,bridge_name='br-int',has_traffic_filtering=True,id=b7afc02f-f620-499f-bae1-d8674398b769,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7afc02f-f6') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab938747-2ef4-513a-a720-b87aab47b92c', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7afc02f-f6, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7afc02f-f6, col_values=(('qos', UUID('2f57a373-0080-43fd-9755-48164c4a2da4')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7afc02f-f6, col_values=(('external_ids', {'iface-id': 'b7afc02f-f620-499f-bae1-d8674398b769', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:55:46', 'vm-uuid': '240226d1-c92f-4286-81a9-783577fb194c'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:15:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:38 user nova-compute[75247]: INFO os_vif [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:55:46,bridge_name='br-int',has_traffic_filtering=True,id=b7afc02f-f620-499f-bae1-d8674398b769,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7afc02f-f6')
Dec 06 13:15:39 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance c15d3c59-c91a-4b67-bd8a-731751a2fa6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:15:39 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance a8e82f38-ad86-4592-988f-a2bd5f917172 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:15:39 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 240226d1-c92f-4286-81a9-783577fb194c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:15:39 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:15:39 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:15:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:15:39 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] No VIF found with MAC fa:16:3e:03:55:46, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 13:15:39 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:15:39 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:15:39 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:15:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:15:40 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:15:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:40 user nova-compute[75247]: DEBUG nova.compute.manager [req-b9581794-2dc9-454c-a06b-81aa6407fe56 req-de086ba7-08cc-4676-9c28-22be807e07b4 service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Received event network-vif-plugged-b7afc02f-f620-499f-bae1-d8674398b769 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:15:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b9581794-2dc9-454c-a06b-81aa6407fe56 req-de086ba7-08cc-4676-9c28-22be807e07b4 service nova] Acquiring lock "240226d1-c92f-4286-81a9-783577fb194c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:15:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b9581794-2dc9-454c-a06b-81aa6407fe56 req-de086ba7-08cc-4676-9c28-22be807e07b4 service nova] Lock "240226d1-c92f-4286-81a9-783577fb194c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:15:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b9581794-2dc9-454c-a06b-81aa6407fe56 req-de086ba7-08cc-4676-9c28-22be807e07b4 service nova] Lock "240226d1-c92f-4286-81a9-783577fb194c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:15:40 user nova-compute[75247]: DEBUG nova.compute.manager [req-b9581794-2dc9-454c-a06b-81aa6407fe56 req-de086ba7-08cc-4676-9c28-22be807e07b4 service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] No waiting events found dispatching network-vif-plugged-b7afc02f-f620-499f-bae1-d8674398b769 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:15:40 user nova-compute[75247]: WARNING nova.compute.manager [req-b9581794-2dc9-454c-a06b-81aa6407fe56 req-de086ba7-08cc-4676-9c28-22be807e07b4 service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Received unexpected event network-vif-plugged-b7afc02f-f620-499f-bae1-d8674398b769 for instance with vm_state building and task_state spawning.
Dec 06 13:15:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:40 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:15:40 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:15:41 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:15:41 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:15:41 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 13:15:41 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Skipping network cache update for instance because it is Building. {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Dec 06 13:15:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-c15d3c59-c91a-4b67-bd8a-731751a2fa6c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:15:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-c15d3c59-c91a-4b67-bd8a-731751a2fa6c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:15:42 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 13:15:42 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lazy-loading 'info_cache' on Instance uuid c15d3c59-c91a-4b67-bd8a-731751a2fa6c {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:15:42 user nova-compute[75247]: DEBUG nova.compute.manager [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 13:15:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 13:15:42 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Instance spawned successfully.
Dec 06 13:15:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 13:15:42 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Updating instance_info_cache with network_info: [{"id": "774027f4-84e8-46cd-8d40-4cdb269c4591", "address": "fa:16:3e:75:aa:77", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774027f4-84", "ovs_interfaceid": "774027f4-84e8-46cd-8d40-4cdb269c4591", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:15:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:15:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:15:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:15:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:15:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:15:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:15:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-c15d3c59-c91a-4b67-bd8a-731751a2fa6c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:15:42 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 13:15:42 user nova-compute[75247]: DEBUG nova.compute.manager [req-988f0263-0476-4fbf-938f-7c4b4e354676 req-cbab3b05-771f-472c-aac1-3f184f3ecb4d service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Received event network-vif-plugged-b7afc02f-f620-499f-bae1-d8674398b769 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:15:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-988f0263-0476-4fbf-938f-7c4b4e354676 req-cbab3b05-771f-472c-aac1-3f184f3ecb4d service nova] Acquiring lock "240226d1-c92f-4286-81a9-783577fb194c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:15:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-988f0263-0476-4fbf-938f-7c4b4e354676 req-cbab3b05-771f-472c-aac1-3f184f3ecb4d service nova] Lock "240226d1-c92f-4286-81a9-783577fb194c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:15:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-988f0263-0476-4fbf-938f-7c4b4e354676 req-cbab3b05-771f-472c-aac1-3f184f3ecb4d service nova] Lock "240226d1-c92f-4286-81a9-783577fb194c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:15:42 user nova-compute[75247]: DEBUG nova.compute.manager [req-988f0263-0476-4fbf-938f-7c4b4e354676 req-cbab3b05-771f-472c-aac1-3f184f3ecb4d service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] No waiting events found dispatching network-vif-plugged-b7afc02f-f620-499f-bae1-d8674398b769 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:15:42 user nova-compute[75247]: WARNING nova.compute.manager [req-988f0263-0476-4fbf-938f-7c4b4e354676 req-cbab3b05-771f-472c-aac1-3f184f3ecb4d service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Received unexpected event network-vif-plugged-b7afc02f-f620-499f-bae1-d8674398b769 for instance with vm_state building and task_state spawning.
Dec 06 13:15:42 user nova-compute[75247]: INFO nova.compute.manager [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Took 5.29 seconds to spawn the instance on the hypervisor.
Dec 06 13:15:42 user nova-compute[75247]: DEBUG nova.compute.manager [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 13:15:42 user nova-compute[75247]: INFO nova.compute.manager [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Took 15.18 seconds to build instance.
Dec 06 13:15:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-5eed6e4c-d29c-4a35-bc8d-12bf0b3c5ac8 tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "240226d1-c92f-4286-81a9-783577fb194c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.270s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:15:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Acquiring lock "637e64f2-3377-47ce-9891-ea9d9f3b6729" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:15:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:15:53 user nova-compute[75247]: INFO nova.compute.manager [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Unshelving
Dec 06 13:15:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:54 user nova-compute[75247]: INFO nova.virt.block_device [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Booting with volume 710dc4b0-99e7-4bd7-8695-2ac4eddf322c at /dev/vda
Dec 06 13:15:54 user nova-compute[75247]: DEBUG os_brick.utils [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:15:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:15:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:15:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d6ac66-f73c-4e3a-a7e8-7822d4c99b2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:15:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:15:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:15:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5bfdd9-c9ee-43df-acde-7b77fad05263]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:15:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:15:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:15:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[79029e21-553d-4125-892d-9c434032ee72]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:15:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf78f7b3-4c91-444b-b605-faa029a37491]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:15:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:15:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:15:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 13:15:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:15:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:15:54 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 13:15:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6e28d0-b03d-490c-a6ea-0d80f4637b85]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:15:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 13:15:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 13:15:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 13:15:54 user nova-compute[75247]: DEBUG os_brick.utils [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:15:54 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Updating existing volume attachment record: e4b9e7dd-6a51-410d-b8bd-1c318c7d4720 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 13:15:58 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:15:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:15:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:15:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:15:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:15:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:15:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:15:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:15:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:15:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:15:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:15:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Verify base images {{(pid=75247) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Dec 06 13:15:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75247) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Dec 06 13:15:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Image id 8242af4f-c2f6-4990-9385-f1348e8ff114 yields fingerprint 91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec {{(pid=75247) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Dec 06 13:15:59 user nova-compute[75247]: INFO nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] image 8242af4f-c2f6-4990-9385-f1348e8ff114 at (/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec): checking
Dec 06 13:15:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] image 8242af4f-c2f6-4990-9385-f1348e8ff114 at (/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec): image is in use {{(pid=75247) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Dec 06 13:15:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:15:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] 240226d1-c92f-4286-81a9-783577fb194c is a valid instance name {{(pid=75247) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Dec 06 13:15:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] c15d3c59-c91a-4b67-bd8a-731751a2fa6c is a valid instance name {{(pid=75247) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Dec 06 13:15:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] a8e82f38-ad86-4592-988f-a2bd5f917172 is a valid instance name {{(pid=75247) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Dec 06 13:15:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] a8e82f38-ad86-4592-988f-a2bd5f917172 has a disk file {{(pid=75247) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Dec 06 13:15:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:15:59 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:15:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance a8e82f38-ad86-4592-988f-a2bd5f917172 is backed by 91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec {{(pid=75247) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Dec 06 13:15:59 user nova-compute[75247]: WARNING nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/85498f59af7f998ff24c965b648b4eeb513cfda5
Dec 06 13:15:59 user nova-compute[75247]: WARNING nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7c941b32398ee88229c0e87f8be54f88cfc5e12e
Dec 06 13:15:59 user nova-compute[75247]: WARNING nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/31370a97735489de76e43b0fac097e99f9a2965d
Dec 06 13:15:59 user nova-compute[75247]: WARNING nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1fcebc9900475945aad86b0df6a6f74e3252032d
Dec 06 13:15:59 user nova-compute[75247]: WARNING nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e3f3f9a696008e1d0eaa103372004faea3dc15ac
Dec 06 13:15:59 user nova-compute[75247]: WARNING nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f8fe714629c0306419dd2e75262b1e2b9b7272f2
Dec 06 13:15:59 user nova-compute[75247]: WARNING nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0ab9a4e95586e925c511739ede48d6c97c1e178e
Dec 06 13:15:59 user nova-compute[75247]: WARNING nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9d46650896f9d747b9b763e9025ff6d0988cc343
Dec 06 13:15:59 user nova-compute[75247]: INFO nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Active base files: /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec
Dec 06 13:15:59 user nova-compute[75247]: INFO nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Removable base files: /opt/stack/data/nova/instances/_base/85498f59af7f998ff24c965b648b4eeb513cfda5 /opt/stack/data/nova/instances/_base/7c941b32398ee88229c0e87f8be54f88cfc5e12e /opt/stack/data/nova/instances/_base/31370a97735489de76e43b0fac097e99f9a2965d /opt/stack/data/nova/instances/_base/1fcebc9900475945aad86b0df6a6f74e3252032d /opt/stack/data/nova/instances/_base/e3f3f9a696008e1d0eaa103372004faea3dc15ac /opt/stack/data/nova/instances/_base/f8fe714629c0306419dd2e75262b1e2b9b7272f2 /opt/stack/data/nova/instances/_base/0ab9a4e95586e925c511739ede48d6c97c1e178e /opt/stack/data/nova/instances/_base/9d46650896f9d747b9b763e9025ff6d0988cc343
Dec 06 13:15:59 user nova-compute[75247]: INFO nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/85498f59af7f998ff24c965b648b4eeb513cfda5
Dec 06 13:15:59 user nova-compute[75247]: INFO nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7c941b32398ee88229c0e87f8be54f88cfc5e12e
Dec 06 13:15:59 user nova-compute[75247]: INFO nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/31370a97735489de76e43b0fac097e99f9a2965d
Dec 06 13:15:59 user nova-compute[75247]: INFO nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1fcebc9900475945aad86b0df6a6f74e3252032d
Dec 06 13:15:59 user nova-compute[75247]: INFO nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e3f3f9a696008e1d0eaa103372004faea3dc15ac
Dec 06 13:15:59 user nova-compute[75247]: INFO nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f8fe714629c0306419dd2e75262b1e2b9b7272f2
Dec 06 13:15:59 user nova-compute[75247]: INFO nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0ab9a4e95586e925c511739ede48d6c97c1e178e
Dec 06 13:15:59 user nova-compute[75247]: INFO nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9d46650896f9d747b9b763e9025ff6d0988cc343
Dec 06 13:15:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Verification complete {{(pid=75247) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Dec 06 13:15:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Verify swap images {{(pid=75247) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Dec 06 13:15:59 user nova-compute[75247]: DEBUG nova.virt.libvirt.imagecache [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Verify ephemeral images {{(pid=75247) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Dec 06 13:16:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:16:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:16:03 user nova-compute[75247]: DEBUG nova.objects.instance [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lazy-loading 'pci_requests' on Instance uuid 637e64f2-3377-47ce-9891-ea9d9f3b6729 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:16:03 user nova-compute[75247]: DEBUG nova.objects.instance [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lazy-loading 'numa_topology' on Instance uuid 637e64f2-3377-47ce-9891-ea9d9f3b6729 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:16:03 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 13:16:03 user nova-compute[75247]: INFO nova.compute.claims [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Claim successful on node user
Dec 06 13:16:03 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:16:03 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:16:03 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.280s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:16:03 user nova-compute[75247]: INFO nova.network.neutron [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Updating port 7110c508-ba09-4d19-bf5f-e2d73c988c28 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Acquiring lock "refresh_cache-637e64f2-3377-47ce-9891-ea9d9f3b6729" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Acquired lock "refresh_cache-637e64f2-3377-47ce-9891-ea9d9f3b6729" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.network.neutron [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.compute.manager [req-b30d9080-6d96-4c1f-aed1-2afa0052759f req-bb384e61-8441-46f6-9695-af32e2c57308 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Received event network-changed-7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.compute.manager [req-b30d9080-6d96-4c1f-aed1-2afa0052759f req-bb384e61-8441-46f6-9695-af32e2c57308 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Refreshing instance network info cache due to event network-changed-7110c508-ba09-4d19-bf5f-e2d73c988c28. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b30d9080-6d96-4c1f-aed1-2afa0052759f req-bb384e61-8441-46f6-9695-af32e2c57308 service nova] Acquiring lock "refresh_cache-637e64f2-3377-47ce-9891-ea9d9f3b6729" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.network.neutron [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Updating instance_info_cache with network_info: [{"id": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "address": "fa:16:3e:dd:1a:11", "network": {"id": "7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1998461599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c05e39382f114be6a2c762890523f4b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7110c508-ba", "ovs_interfaceid": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Releasing lock "refresh_cache-637e64f2-3377-47ce-9891-ea9d9f3b6729" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 13:16:04 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Creating image(s)
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Did not create local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Ensure instance console log exists: /opt/stack/data/nova/instances/637e64f2-3377-47ce-9891-ea9d9f3b6729/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Start _get_guest_xml network_info=[{"id": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "address": "fa:16:3e:dd:1a:11", "network": {"id": "7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1998461599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c05e39382f114be6a2c762890523f4b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7110c508-ba", "ovs_interfaceid": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'e4b9e7dd-6a51-410d-b8bd-1c318c7d4720', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDgEaVNI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '637e64f2-3377-47ce-9891-ea9d9f3b6729', 'attached_at': '', 'detached_at': '', 'volume_id': '710dc4b0-99e7-4bd7-8695-2ac4eddf322c', 'serial': '710dc4b0-99e7-4bd7-8695-2ac4eddf322c'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b30d9080-6d96-4c1f-aed1-2afa0052759f req-bb384e61-8441-46f6-9695-af32e2c57308 service nova] Acquired lock "refresh_cache-637e64f2-3377-47ce-9891-ea9d9f3b6729" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.network.neutron [req-b30d9080-6d96-4c1f-aed1-2afa0052759f req-bb384e61-8441-46f6-9695-af32e2c57308 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Refreshing network info cache for port 7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:16:04 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:16:04 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.objects.instance [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lazy-loading 'vcpu_model' on Instance uuid 637e64f2-3377-47ce-9891-ea9d9f3b6729 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.objects.base [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Object Instance<637e64f2-3377-47ce-9891-ea9d9f3b6729> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDgEaVNI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:16:04 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:16:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:16:04 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:16:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:16:04 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 13:16:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[39822678-d39c-4688-bae9-2e979057c760]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 13:16:04 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[70de02c2-684e-43c3-a4e6-dfc175ef35ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c] added
Dec 06 13:16:04 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[246c7f9f-a210-4467-ad71-8e7266710b4c]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:16:04 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[55634e28-61bf-4122-8450-9fc57c8051fb]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cDgEaVNI {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cDgEaVNI" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ad66ff-3154-4aec-a185-70baf8268349]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cDgEaVNI'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3ecc9d-74d1-42a3-bc95-370ed058d9c5]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0417eb7-e63d-47bd-ab1b-752ea0ab4ed2]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:16:05 user nova-compute[75247]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 (non-flash)
Dec 06 13:16:05 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:16:05 user nova-compute[75247]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 (non-flash)
Dec 06 13:16:05 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[28356b8a-b3fc-43e8-85fd-a4e826d5b9c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c, portal: 172.16.0.220,3260]
Dec 06 13:16:05 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c, portal: 172.16.0.220,3260] successful.
Dec 06 13:16:05 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e010f7e1-03e6-423a-8c21-805b5042d31e]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[08742ffd-0c88-45ac-8bcd-ef64c1be6546]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:16:05 user nova-compute[75247]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 (non-flash)
Dec 06 13:16:05 user nova-compute[75247]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)
Dec 06 13:16:05 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:16:05 user nova-compute[75247]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 (non-flash)
Dec 06 13:16:05 user nova-compute[75247]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)
Dec 06 13:16:05 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] HCTL ('35', '-', '-', 0) found on session 63 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[acab926b-bae3-4962-88a7-303d6cead4db]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Searching for a device in session 63 and hctl ['35', '*', '*', 0] yield: None {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG nova.network.neutron [req-b30d9080-6d96-4c1f-aed1-2afa0052759f req-bb384e61-8441-46f6-9695-af32e2c57308 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Updated VIF entry in instance network info cache for port 7110c508-ba09-4d19-bf5f-e2d73c988c28. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG nova.network.neutron [req-b30d9080-6d96-4c1f-aed1-2afa0052759f req-bb384e61-8441-46f6-9695-af32e2c57308 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Updating instance_info_cache with network_info: [{"id": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "address": "fa:16:3e:dd:1a:11", "network": {"id": "7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1998461599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c05e39382f114be6a2c762890523f4b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7110c508-ba", "ovs_interfaceid": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:16:05 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-b30d9080-6d96-4c1f-aed1-2afa0052759f req-bb384e61-8441-46f6-9695-af32e2c57308 service nova] Releasing lock "refresh_cache-637e64f2-3377-47ce-9891-ea9d9f3b6729" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Searching for a device in session 63 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDgEaVNI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26632653938313666', 'path': '/dev/sdd'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632653938313666', 'path': '/dev/sdd'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T13:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-585733721',display_name='tempest-TestShelveInstance-server-585733721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-585733721',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-816568645',keypairs=<?>,launch_index=0,launched_at=2023-12-06T13:12:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c05e39382f114be6a2c762890523f4b1',ramdisk_id='',reservation_id='r-nnlrt39q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1636467499',owner_user_name='tempest-TestShelveInstance-1636467499-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T13:15:54Z,user_data=None,user_id='830024d5b05e4b5aa6d6d9674cf661e2',uuid=637e64f2-3377-47ce-9891-ea9d9f3b6729,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "address": "fa:16:3e:dd:1a:11", "network": {"id": "7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1998461599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c05e39382f114be6a2c762890523f4b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7110c508-ba", "ovs_interfaceid": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Converting VIF {"id": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "address": "fa:16:3e:dd:1a:11", "network": {"id": "7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1998461599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c05e39382f114be6a2c762890523f4b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7110c508-ba", "ovs_interfaceid": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=7110c508-ba09-4d19-bf5f-e2d73c988c28,network=Network(7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7110c508-ba') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG nova.objects.instance [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lazy-loading 'pci_devices' on Instance uuid 637e64f2-3377-47ce-9891-ea9d9f3b6729 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG nova.objects.base [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Object Instance<637e64f2-3377-47ce-9891-ea9d9f3b6729> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] End _get_guest_xml xml=<domain type="kvm">
Dec 06 13:16:06 user nova-compute[75247]:   <uuid>637e64f2-3377-47ce-9891-ea9d9f3b6729</uuid>
Dec 06 13:16:06 user nova-compute[75247]:   <name>instance-00000031</name>
Dec 06 13:16:06 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 13:16:06 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 13:16:06 user nova-compute[75247]:   <metadata>
Dec 06 13:16:06 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 13:16:06 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 13:16:06 user nova-compute[75247]:       <nova:name>tempest-TestShelveInstance-server-585733721</nova:name>
Dec 06 13:16:06 user nova-compute[75247]:       <nova:creationTime>2023-12-06 13:16:04</nova:creationTime>
Dec 06 13:16:06 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 13:16:06 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 13:16:06 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 13:16:06 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 13:16:06 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 13:16:06 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 13:16:06 user nova-compute[75247]:       </nova:flavor>
Dec 06 13:16:06 user nova-compute[75247]:       <nova:owner>
Dec 06 13:16:06 user nova-compute[75247]:         <nova:user uuid="830024d5b05e4b5aa6d6d9674cf661e2">tempest-TestShelveInstance-1636467499-project-member</nova:user>
Dec 06 13:16:06 user nova-compute[75247]:         <nova:project uuid="c05e39382f114be6a2c762890523f4b1">tempest-TestShelveInstance-1636467499</nova:project>
Dec 06 13:16:06 user nova-compute[75247]:       </nova:owner>
Dec 06 13:16:06 user nova-compute[75247]:       <nova:ports>
Dec 06 13:16:06 user nova-compute[75247]:         <nova:port uuid="7110c508-ba09-4d19-bf5f-e2d73c988c28">
Dec 06 13:16:06 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 13:16:06 user nova-compute[75247]:         </nova:port>
Dec 06 13:16:06 user nova-compute[75247]:       </nova:ports>
Dec 06 13:16:06 user nova-compute[75247]:     </nova:instance>
Dec 06 13:16:06 user nova-compute[75247]:   </metadata>
Dec 06 13:16:06 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 13:16:06 user nova-compute[75247]:     <system>
Dec 06 13:16:06 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 13:16:06 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 13:16:06 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 13:16:06 user nova-compute[75247]:       <entry name="serial">637e64f2-3377-47ce-9891-ea9d9f3b6729</entry>
Dec 06 13:16:06 user nova-compute[75247]:       <entry name="uuid">637e64f2-3377-47ce-9891-ea9d9f3b6729</entry>
Dec 06 13:16:06 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 13:16:06 user nova-compute[75247]:     </system>
Dec 06 13:16:06 user nova-compute[75247]:   </sysinfo>
Dec 06 13:16:06 user nova-compute[75247]:   <os>
Dec 06 13:16:06 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 13:16:06 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 13:16:06 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 13:16:06 user nova-compute[75247]:   </os>
Dec 06 13:16:06 user nova-compute[75247]:   <features>
Dec 06 13:16:06 user nova-compute[75247]:     <acpi/>
Dec 06 13:16:06 user nova-compute[75247]:     <apic/>
Dec 06 13:16:06 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 13:16:06 user nova-compute[75247]:   </features>
Dec 06 13:16:06 user nova-compute[75247]:   <clock offset="utc">
Dec 06 13:16:06 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 13:16:06 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 13:16:06 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 13:16:06 user nova-compute[75247]:   </clock>
Dec 06 13:16:06 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 13:16:06 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 13:16:06 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 13:16:06 user nova-compute[75247]:   </cpu>
Dec 06 13:16:06 user nova-compute[75247]:   <devices>
Dec 06 13:16:06 user nova-compute[75247]:     <disk type="block" device="disk">
Dec 06 13:16:06 user nova-compute[75247]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:16:06 user nova-compute[75247]:       <source dev="/dev/sdd"/>
Dec 06 13:16:06 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 13:16:06 user nova-compute[75247]:       <serial>710dc4b0-99e7-4bd7-8695-2ac4eddf322c</serial>
Dec 06 13:16:06 user nova-compute[75247]:     </disk>
Dec 06 13:16:06 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 13:16:06 user nova-compute[75247]:       <mac address="fa:16:3e:dd:1a:11"/>
Dec 06 13:16:06 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:16:06 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 13:16:06 user nova-compute[75247]:       <target dev="tap7110c508-ba"/>
Dec 06 13:16:06 user nova-compute[75247]:     </interface>
Dec 06 13:16:06 user nova-compute[75247]:     <serial type="pty">
Dec 06 13:16:06 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/637e64f2-3377-47ce-9891-ea9d9f3b6729/console.log" append="off"/>
Dec 06 13:16:06 user nova-compute[75247]:     </serial>
Dec 06 13:16:06 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 13:16:06 user nova-compute[75247]:     <video>
Dec 06 13:16:06 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:16:06 user nova-compute[75247]:     </video>
Dec 06 13:16:06 user nova-compute[75247]:     <rng model="virtio">
Dec 06 13:16:06 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 13:16:06 user nova-compute[75247]:     </rng>
Dec 06 13:16:06 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 13:16:06 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 13:16:06 user nova-compute[75247]:       <stats period="10"/>
Dec 06 13:16:06 user nova-compute[75247]:     </memballoon>
Dec 06 13:16:06 user nova-compute[75247]:   </devices>
Dec 06 13:16:06 user nova-compute[75247]: </domain>
Dec 06 13:16:06 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T13:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-585733721',display_name='tempest-TestShelveInstance-server-585733721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-585733721',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-816568645',keypairs=<?>,launch_index=0,launched_at=2023-12-06T13:12:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c05e39382f114be6a2c762890523f4b1',ramdisk_id='',reservation_id='r-nnlrt39q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1636467499',owner_user_name='tempest-TestShelveInstance-1636467499-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T13:15:54Z,user_data=None,user_id='830024d5b05e4b5aa6d6d9674cf661e2',uuid=637e64f2-3377-47ce-9891-ea9d9f3b6729,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "address": "fa:16:3e:dd:1a:11", "network": {"id": "7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1998461599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c05e39382f114be6a2c762890523f4b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7110c508-ba", "ovs_interfaceid": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Converting VIF {"id": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "address": "fa:16:3e:dd:1a:11", "network": {"id": "7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1998461599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c05e39382f114be6a2c762890523f4b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7110c508-ba", "ovs_interfaceid": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=7110c508-ba09-4d19-bf5f-e2d73c988c28,network=Network(7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7110c508-ba') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG os_vif [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=7110c508-ba09-4d19-bf5f-e2d73c988c28,network=Network(7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7110c508-ba') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0adbc3d0-74ff-5175-82f4-2409125fcc5d', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7110c508-ba, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7110c508-ba, col_values=(('qos', UUID('d54efcc3-bdbf-49c4-8bed-384b9e8e948d')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7110c508-ba, col_values=(('external_ids', {'iface-id': '7110c508-ba09-4d19-bf5f-e2d73c988c28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:1a:11', 'vm-uuid': '637e64f2-3377-47ce-9891-ea9d9f3b6729'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:06 user nova-compute[75247]: INFO os_vif [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=7110c508-ba09-4d19-bf5f-e2d73c988c28,network=Network(7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7110c508-ba')
Dec 06 13:16:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:16:06 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] No VIF found with MAC fa:16:3e:dd:1a:11, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 13:16:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:07 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:07 user nova-compute[75247]: DEBUG nova.compute.manager [req-577b3d08-65ca-41dc-9d50-b71da9ee4855 req-59d43bd7-d9d9-4ed1-9b1e-30a0ba6a5cde service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Received event network-vif-plugged-7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:16:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-577b3d08-65ca-41dc-9d50-b71da9ee4855 req-59d43bd7-d9d9-4ed1-9b1e-30a0ba6a5cde service nova] Acquiring lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:16:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-577b3d08-65ca-41dc-9d50-b71da9ee4855 req-59d43bd7-d9d9-4ed1-9b1e-30a0ba6a5cde service nova] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:16:07 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-577b3d08-65ca-41dc-9d50-b71da9ee4855 req-59d43bd7-d9d9-4ed1-9b1e-30a0ba6a5cde service nova] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:16:07 user nova-compute[75247]: DEBUG nova.compute.manager [req-577b3d08-65ca-41dc-9d50-b71da9ee4855 req-59d43bd7-d9d9-4ed1-9b1e-30a0ba6a5cde service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] No waiting events found dispatching network-vif-plugged-7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:16:07 user nova-compute[75247]: WARNING nova.compute.manager [req-577b3d08-65ca-41dc-9d50-b71da9ee4855 req-59d43bd7-d9d9-4ed1-9b1e-30a0ba6a5cde service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Received unexpected event network-vif-plugged-7110c508-ba09-4d19-bf5f-e2d73c988c28 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 06 13:16:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:09 user nova-compute[75247]: DEBUG nova.compute.manager [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 13:16:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 13:16:09 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Instance spawned successfully.
Dec 06 13:16:09 user nova-compute[75247]: DEBUG nova.compute.manager [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 13:16:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-015dd022-15b2-4d3f-b32c-06da40f74f8a tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.889s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:16:09 user nova-compute[75247]: DEBUG nova.compute.manager [req-cfb2d464-cebc-448d-bdae-acd213ac2d6e req-a9845b39-3b82-4686-b25a-a12dd38e438a service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Received event network-vif-plugged-7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:16:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-cfb2d464-cebc-448d-bdae-acd213ac2d6e req-a9845b39-3b82-4686-b25a-a12dd38e438a service nova] Acquiring lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:16:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-cfb2d464-cebc-448d-bdae-acd213ac2d6e req-a9845b39-3b82-4686-b25a-a12dd38e438a service nova] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:16:09 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-cfb2d464-cebc-448d-bdae-acd213ac2d6e req-a9845b39-3b82-4686-b25a-a12dd38e438a service nova] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:16:09 user nova-compute[75247]: DEBUG nova.compute.manager [req-cfb2d464-cebc-448d-bdae-acd213ac2d6e req-a9845b39-3b82-4686-b25a-a12dd38e438a service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] No waiting events found dispatching network-vif-plugged-7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:16:09 user nova-compute[75247]: WARNING nova.compute.manager [req-cfb2d464-cebc-448d-bdae-acd213ac2d6e req-a9845b39-3b82-4686-b25a-a12dd38e438a service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Received unexpected event network-vif-plugged-7110c508-ba09-4d19-bf5f-e2d73c988c28 for instance with vm_state active and task_state None.
Dec 06 13:16:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:16:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:16:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:16:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:16:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:32 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:16:32 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:16:32 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:16:34 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:16:34 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:16:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:36 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:36 user nova-compute[75247]: DEBUG nova.compute.manager [req-a45b6201-ac37-4744-9fd5-03e8b1aeac17 req-a0b49834-faaf-4b6c-8ae8-80b38cce5d6b service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Received event network-changed-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:16:36 user nova-compute[75247]: DEBUG nova.compute.manager [req-a45b6201-ac37-4744-9fd5-03e8b1aeac17 req-a0b49834-faaf-4b6c-8ae8-80b38cce5d6b service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Refreshing instance network info cache due to event network-changed-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:16:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a45b6201-ac37-4744-9fd5-03e8b1aeac17 req-a0b49834-faaf-4b6c-8ae8-80b38cce5d6b service nova] Acquiring lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:16:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a45b6201-ac37-4744-9fd5-03e8b1aeac17 req-a0b49834-faaf-4b6c-8ae8-80b38cce5d6b service nova] Acquired lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:16:36 user nova-compute[75247]: DEBUG nova.network.neutron [req-a45b6201-ac37-4744-9fd5-03e8b1aeac17 req-a0b49834-faaf-4b6c-8ae8-80b38cce5d6b service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Refreshing network info cache for port 8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:16:36 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:16:37 user nova-compute[75247]: DEBUG nova.network.neutron [req-a45b6201-ac37-4744-9fd5-03e8b1aeac17 req-a0b49834-faaf-4b6c-8ae8-80b38cce5d6b service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Updated VIF entry in instance network info cache for port 8e50c43f-5c99-4e86-ab1f-f90ed2a390ac. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:16:37 user nova-compute[75247]: DEBUG nova.network.neutron [req-a45b6201-ac37-4744-9fd5-03e8b1aeac17 req-a0b49834-faaf-4b6c-8ae8-80b38cce5d6b service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Updating instance_info_cache with network_info: [{"id": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "address": "fa:16:3e:55:4b:24", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e50c43f-5c", "ovs_interfaceid": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:16:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a45b6201-ac37-4744-9fd5-03e8b1aeac17 req-a0b49834-faaf-4b6c-8ae8-80b38cce5d6b service nova] Releasing lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:16:38 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:16:39 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:16:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:16:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:16:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:16:39 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:16:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:16:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:16:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:16:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:16:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:16:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:16:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:16:40 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:16:40 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:16:40 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=8572MB free_disk=25.051288604736328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:16:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:16:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:16:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "a8e82f38-ad86-4592-988f-a2bd5f917172" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:16:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "a8e82f38-ad86-4592-988f-a2bd5f917172" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:16:40 user nova-compute[75247]: INFO nova.compute.manager [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Shelving
Dec 06 13:16:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance c15d3c59-c91a-4b67-bd8a-731751a2fa6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance a8e82f38-ad86-4592-988f-a2bd5f917172 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 240226d1-c92f-4286-81a9-783577fb194c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 637e64f2-3377-47ce-9891-ea9d9f3b6729 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Refreshing inventories for resource provider d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Updating ProviderTree inventory for provider d326b140-3450-4409-964c-9eafc6cc025d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Updating inventory in ProviderTree for provider d326b140-3450-4409-964c-9eafc6cc025d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Refreshing aggregate associations for resource provider d326b140-3450-4409-964c-9eafc6cc025d, aggregates: None {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Refreshing trait associations for resource provider d326b140-3450-4409-964c-9eafc6cc025d, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG nova.compute.manager [req-30e490a8-1044-4742-b8f5-1903c83d9be4 req-8cd0517d-5e39-4e9c-a661-f0a29c3eca5c service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Received event network-vif-unplugged-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-30e490a8-1044-4742-b8f5-1903c83d9be4 req-8cd0517d-5e39-4e9c-a661-f0a29c3eca5c service nova] Acquiring lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-30e490a8-1044-4742-b8f5-1903c83d9be4 req-8cd0517d-5e39-4e9c-a661-f0a29c3eca5c service nova] Lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-30e490a8-1044-4742-b8f5-1903c83d9be4 req-8cd0517d-5e39-4e9c-a661-f0a29c3eca5c service nova] Lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG nova.compute.manager [req-30e490a8-1044-4742-b8f5-1903c83d9be4 req-8cd0517d-5e39-4e9c-a661-f0a29c3eca5c service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] No waiting events found dispatching network-vif-unplugged-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:16:41 user nova-compute[75247]: WARNING nova.compute.manager [req-30e490a8-1044-4742-b8f5-1903c83d9be4 req-8cd0517d-5e39-4e9c-a661-f0a29c3eca5c service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Received unexpected event network-vif-unplugged-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac for instance with vm_state active and task_state shelving.
Dec 06 13:16:41 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.587s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:16:41 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Instance destroyed successfully.
Dec 06 13:16:41 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Beginning cold snapshot process
Dec 06 13:16:41 user nova-compute[75247]: DEBUG nova.privsep.utils [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 13:16:41 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk /opt/stack/data/nova/instances/snapshots/tmpil1lmnny/7aed4c478ecf4a89b42a1dff268f2668 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:16:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk /opt/stack/data/nova/instances/snapshots/tmpil1lmnny/7aed4c478ecf4a89b42a1dff268f2668" returned: 0 in 0.571s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:16:42 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Snapshot extracted, beginning image upload
Dec 06 13:16:42 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:16:42 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:16:42 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:16:42 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75247) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 13:16:43 user nova-compute[75247]: DEBUG nova.compute.manager [req-841a4681-da2c-4849-9802-b147252afccd req-4bc88c63-2412-4c48-a241-252357212e2b service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Received event network-vif-plugged-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:16:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-841a4681-da2c-4849-9802-b147252afccd req-4bc88c63-2412-4c48-a241-252357212e2b service nova] Acquiring lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:16:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-841a4681-da2c-4849-9802-b147252afccd req-4bc88c63-2412-4c48-a241-252357212e2b service nova] Lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:16:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-841a4681-da2c-4849-9802-b147252afccd req-4bc88c63-2412-4c48-a241-252357212e2b service nova] Lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:16:43 user nova-compute[75247]: DEBUG nova.compute.manager [req-841a4681-da2c-4849-9802-b147252afccd req-4bc88c63-2412-4c48-a241-252357212e2b service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] No waiting events found dispatching network-vif-plugged-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:16:43 user nova-compute[75247]: WARNING nova.compute.manager [req-841a4681-da2c-4849-9802-b147252afccd req-4bc88c63-2412-4c48-a241-252357212e2b service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Received unexpected event network-vif-plugged-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac for instance with vm_state active and task_state shelving_image_uploading.
Dec 06 13:16:43 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:16:43 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:16:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:16:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:16:43 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 13:16:44 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Snapshot image upload complete
Dec 06 13:16:44 user nova-compute[75247]: DEBUG nova.compute.manager [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 13:16:44 user nova-compute[75247]: INFO nova.compute.manager [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Shelve offloading
Dec 06 13:16:44 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Instance destroyed successfully.
Dec 06 13:16:44 user nova-compute[75247]: DEBUG nova.compute.manager [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 13:16:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:16:44 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Updating instance_info_cache with network_info: [{"id": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "address": "fa:16:3e:55:4b:24", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e50c43f-5c", "ovs_interfaceid": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:16:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:16:44 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 13:16:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquired lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:16:44 user nova-compute[75247]: DEBUG nova.network.neutron [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 13:16:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:45 user nova-compute[75247]: DEBUG nova.network.neutron [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Updating instance_info_cache with network_info: [{"id": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "address": "fa:16:3e:55:4b:24", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e50c43f-5c", "ovs_interfaceid": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:16:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Releasing lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:16:45 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Instance destroyed successfully.
Dec 06 13:16:45 user nova-compute[75247]: DEBUG nova.objects.instance [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lazy-loading 'resources' on Instance uuid a8e82f38-ad86-4592-988f-a2bd5f917172 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:14:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-568751134',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-568751134',id=51,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDirUm2nl+6xaUZ6Yxi+egbsaNJRnA3LShnM84PDKd17/Zx/JnnPkY/xZcoDkfexZcEbGFZHezj44E5uV1v3R4USebgCgWihz36GwGfRzTF2yDzBboC/1ieEBOvIi4v3OQ==',key_name='tempest-keypair-476765996',keypairs=<?>,launch_index=0,launched_at=2023-12-06T13:14:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9f58adbd4d004a44b37a0e0922da5aa3',ramdisk_id='',reservation_id='r-xzfpgnx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2058750591',owner_user_name='tempest-AttachVolumeShelveTestJSON-2058750591-project-member',shelved_at='2023-12-06T13:16:44.747972',shelved_host='user',shelved_image_id='2864642f-ccc8-4fd7-9ca7-5a4ba791ae82'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T13:16:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e50e8cc91ca4ff88ebfa0b2888699d5',uuid=a8e82f38-ad86-4592-988f-a2bd5f917172,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "address": "fa:16:3e:55:4b:24", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e50c43f-5c", "ovs_interfaceid": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Converting VIF {"id": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "address": "fa:16:3e:55:4b:24", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e50c43f-5c", "ovs_interfaceid": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:4b:24,bridge_name='br-int',has_traffic_filtering=True,id=8e50c43f-5c99-4e86-ab1f-f90ed2a390ac,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e50c43f-5c') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG os_vif [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:4b:24,bridge_name='br-int',has_traffic_filtering=True,id=8e50c43f-5c99-4e86-ab1f-f90ed2a390ac,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e50c43f-5c') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e50c43f-5c, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fac5e0a1-26f3-4e5d-9a23-67934520a1af) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG nova.compute.manager [req-1074bc95-b278-44f4-a8ad-8ddd7284c69b req-7f27fafc-c491-41c0-896c-5187df0f4c5b service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Received event network-changed-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG nova.compute.manager [req-1074bc95-b278-44f4-a8ad-8ddd7284c69b req-7f27fafc-c491-41c0-896c-5187df0f4c5b service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Refreshing instance network info cache due to event network-changed-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1074bc95-b278-44f4-a8ad-8ddd7284c69b req-7f27fafc-c491-41c0-896c-5187df0f4c5b service nova] Acquiring lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1074bc95-b278-44f4-a8ad-8ddd7284c69b req-7f27fafc-c491-41c0-896c-5187df0f4c5b service nova] Acquired lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG nova.network.neutron [req-1074bc95-b278-44f4-a8ad-8ddd7284c69b req-7f27fafc-c491-41c0-896c-5187df0f4c5b service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Refreshing network info cache for port 8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:16:46 user nova-compute[75247]: INFO os_vif [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:4b:24,bridge_name='br-int',has_traffic_filtering=True,id=8e50c43f-5c99-4e86-ab1f-f90ed2a390ac,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e50c43f-5c')
Dec 06 13:16:46 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Deleting instance files /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172_del
Dec 06 13:16:46 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Deletion of /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172_del complete
Dec 06 13:16:46 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Deleted allocations for instance a8e82f38-ad86-4592-988f-a2bd5f917172
Dec 06 13:16:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG nova.objects.instance [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lazy-loading 'numa_topology' on Instance uuid a8e82f38-ad86-4592-988f-a2bd5f917172 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG nova.objects.base [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Object Instance<a8e82f38-ad86-4592-988f-a2bd5f917172> lazy-loaded attributes: resources,numa_topology {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG nova.network.neutron [req-1074bc95-b278-44f4-a8ad-8ddd7284c69b req-7f27fafc-c491-41c0-896c-5187df0f4c5b service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Updated VIF entry in instance network info cache for port 8e50c43f-5c99-4e86-ab1f-f90ed2a390ac. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG nova.network.neutron [req-1074bc95-b278-44f4-a8ad-8ddd7284c69b req-7f27fafc-c491-41c0-896c-5187df0f4c5b service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Updating instance_info_cache with network_info: [{"id": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "address": "fa:16:3e:55:4b:24", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8e50c43f-5c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-1074bc95-b278-44f4-a8ad-8ddd7284c69b req-7f27fafc-c491-41c0-896c-5187df0f4c5b service nova] Releasing lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:16:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-22fd4324-d593-41f7-8b53-6e82cd405628 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "a8e82f38-ad86-4592-988f-a2bd5f917172" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.604s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:16:47 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:16:47 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Cleaning up deleted instances {{(pid=75247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 13:16:47 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] There are 0 instances to clean {{(pid=75247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 13:16:48 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:16:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:16:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:17:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:17:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:17:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:17:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:17:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:17:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:19 user nova-compute[75247]: DEBUG nova.compute.manager [req-78694da2-76f3-4573-9062-3f1eb5428561 req-f70bda8b-bbb5-4e0c-ae2b-647162da5143 service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Received event network-changed-b7afc02f-f620-499f-bae1-d8674398b769 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:17:19 user nova-compute[75247]: DEBUG nova.compute.manager [req-78694da2-76f3-4573-9062-3f1eb5428561 req-f70bda8b-bbb5-4e0c-ae2b-647162da5143 service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Refreshing instance network info cache due to event network-changed-b7afc02f-f620-499f-bae1-d8674398b769. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:17:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-78694da2-76f3-4573-9062-3f1eb5428561 req-f70bda8b-bbb5-4e0c-ae2b-647162da5143 service nova] Acquiring lock "refresh_cache-240226d1-c92f-4286-81a9-783577fb194c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:17:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-78694da2-76f3-4573-9062-3f1eb5428561 req-f70bda8b-bbb5-4e0c-ae2b-647162da5143 service nova] Acquired lock "refresh_cache-240226d1-c92f-4286-81a9-783577fb194c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:17:19 user nova-compute[75247]: DEBUG nova.network.neutron [req-78694da2-76f3-4573-9062-3f1eb5428561 req-f70bda8b-bbb5-4e0c-ae2b-647162da5143 service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Refreshing network info cache for port b7afc02f-f620-499f-bae1-d8674398b769 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:17:19 user nova-compute[75247]: DEBUG nova.network.neutron [req-78694da2-76f3-4573-9062-3f1eb5428561 req-f70bda8b-bbb5-4e0c-ae2b-647162da5143 service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Updated VIF entry in instance network info cache for port b7afc02f-f620-499f-bae1-d8674398b769. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:17:19 user nova-compute[75247]: DEBUG nova.network.neutron [req-78694da2-76f3-4573-9062-3f1eb5428561 req-f70bda8b-bbb5-4e0c-ae2b-647162da5143 service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Updating instance_info_cache with network_info: [{"id": "b7afc02f-f620-499f-bae1-d8674398b769", "address": "fa:16:3e:03:55:46", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7afc02f-f6", "ovs_interfaceid": "b7afc02f-f620-499f-bae1-d8674398b769", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:17:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-78694da2-76f3-4573-9062-3f1eb5428561 req-f70bda8b-bbb5-4e0c-ae2b-647162da5143 service nova] Releasing lock "refresh_cache-240226d1-c92f-4286-81a9-783577fb194c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "240226d1-c92f-4286-81a9-783577fb194c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "240226d1-c92f-4286-81a9-783577fb194c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "240226d1-c92f-4286-81a9-783577fb194c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "240226d1-c92f-4286-81a9-783577fb194c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "240226d1-c92f-4286-81a9-783577fb194c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:17:20 user nova-compute[75247]: INFO nova.compute.manager [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Terminating instance
Dec 06 13:17:20 user nova-compute[75247]: DEBUG nova.compute.manager [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-ca8be649-5dd6-47b2-9ee1-4eda4df64392 req-349eb24e-db3d-4077-975c-293e481f1f91 service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Received event network-vif-unplugged-b7afc02f-f620-499f-bae1-d8674398b769 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ca8be649-5dd6-47b2-9ee1-4eda4df64392 req-349eb24e-db3d-4077-975c-293e481f1f91 service nova] Acquiring lock "240226d1-c92f-4286-81a9-783577fb194c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ca8be649-5dd6-47b2-9ee1-4eda4df64392 req-349eb24e-db3d-4077-975c-293e481f1f91 service nova] Lock "240226d1-c92f-4286-81a9-783577fb194c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-ca8be649-5dd6-47b2-9ee1-4eda4df64392 req-349eb24e-db3d-4077-975c-293e481f1f91 service nova] Lock "240226d1-c92f-4286-81a9-783577fb194c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-ca8be649-5dd6-47b2-9ee1-4eda4df64392 req-349eb24e-db3d-4077-975c-293e481f1f91 service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] No waiting events found dispatching network-vif-unplugged-b7afc02f-f620-499f-bae1-d8674398b769 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG nova.compute.manager [req-ca8be649-5dd6-47b2-9ee1-4eda4df64392 req-349eb24e-db3d-4077-975c-293e481f1f91 service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Received event network-vif-unplugged-b7afc02f-f620-499f-bae1-d8674398b769 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:20 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Instance destroyed successfully.
Dec 06 13:17:20 user nova-compute[75247]: DEBUG nova.objects.instance [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lazy-loading 'resources' on Instance uuid 240226d1-c92f-4286-81a9-783577fb194c {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-101312041',display_name='tempest-TestVolumeBootPattern-server-101312041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-101312041',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+e3XTLfVN8C3itmblwy09HtnE6ODmf3LMeZLWfbnBfl5D2ms/C+dYrJrc6lCBYNrZ/pLuupAxLsGv6ZOwhXojQ4RlmELXbFB3bv70Zc31yz9kRGkDkIlpeboSBmcUYgg==',key_name='tempest-TestVolumeBootPattern-1199968839',keypairs=<?>,launch_index=0,launched_at=2023-12-06T13:15:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9493d9b0b1024cea9a550e2a42c1e6a1',ramdisk_id='',reservation_id='r-ynby2hq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2088852773',owner_user_name='tempest-TestVolumeBootPattern-2088852773-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T13:15:43Z,user_data=None,user_id='016714f7502b4a8fa12ed0ce6644c5fc',uuid=240226d1-c92f-4286-81a9-783577fb194c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7afc02f-f620-499f-bae1-d8674398b769", "address": "fa:16:3e:03:55:46", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7afc02f-f6", "ovs_interfaceid": "b7afc02f-f620-499f-bae1-d8674398b769", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converting VIF {"id": "b7afc02f-f620-499f-bae1-d8674398b769", "address": "fa:16:3e:03:55:46", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7afc02f-f6", "ovs_interfaceid": "b7afc02f-f620-499f-bae1-d8674398b769", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:55:46,bridge_name='br-int',has_traffic_filtering=True,id=b7afc02f-f620-499f-bae1-d8674398b769,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7afc02f-f6') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG os_vif [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:55:46,bridge_name='br-int',has_traffic_filtering=True,id=b7afc02f-f620-499f-bae1-d8674398b769,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7afc02f-f6') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7afc02f-f6, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f57a373-0080-43fd-9755-48164c4a2da4) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:20 user nova-compute[75247]: INFO os_vif [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:55:46,bridge_name='br-int',has_traffic_filtering=True,id=b7afc02f-f620-499f-bae1-d8674398b769,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7afc02f-f6')
Dec 06 13:17:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFoVzmQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:17:20 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:17:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[44373220-a3a3-4038-91a0-a85de5f25c90]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 13:17:20 user nova-compute[75247]: No targets found.
Dec 06 13:17:20 user nova-compute[75247]: iSNS:
Dec 06 13:17:20 user nova-compute[75247]: No targets found.
Dec 06 13:17:20 user nova-compute[75247]: STATIC:
Dec 06 13:17:20 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68
Dec 06 13:17:20 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:17:20 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:17:20 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2
Dec 06 13:17:20 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:17:20 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:17:20 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c
Dec 06 13:17:20 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:17:20 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:17:20 user nova-compute[75247]: FIRMWARE:
Dec 06 13:17:20 user nova-compute[75247]: No targets found.
Dec 06 13:17:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 13:17:20 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 13:17:20 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a572fa-dce2-4b54-a469-9879fcc501ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[babb4622-76a5-4d8f-a165-b9b6ccb01791]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:17:20 user nova-compute[75247]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 (non-flash)
Dec 06 13:17:20 user nova-compute[75247]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)
Dec 06 13:17:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:17:20 user nova-compute[75247]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 (non-flash)
Dec 06 13:17:20 user nova-compute[75247]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)
Dec 06 13:17:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd730192170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2'): ({'sdc'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Removing single pathed devices sdc {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bede9155-7edd-4a56-8a8d-d6baf5fcbed7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2818c2-6922-4772-9365-bf6ab232e57f]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Flushing IO for device /dev/sdc {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e651b8db-0d89-4b74-9c7f-afd7f21b7934]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[022b8048-9a4b-45d3-8581-50780f049a30]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] SCSI volumes sdc have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 13:17:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:17:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:17:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8872f4d-ad5a-4253-9280-e57615e76df9]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:17:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:17:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:17:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:17:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7236111e-2512-402b-b8c2-8caa89bc54fd]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:17:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2, portal: 172.16.0.220,3260]
Dec 06 13:17:21 user nova-compute[75247]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2, portal: 172.16.0.220,3260] successful.
Dec 06 13:17:21 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:17:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:17:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0c179e9-bca5-454b-9dc0-61315a5363b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:17:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2282f350-e780-4a2b-8a62-3c982fc87bdd]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:17:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:17:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:17:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] <== disconnect_volume: return (327ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:17:21 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 13:17:21 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Deleting instance files /opt/stack/data/nova/instances/240226d1-c92f-4286-81a9-783577fb194c_del
Dec 06 13:17:21 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Deletion of /opt/stack/data/nova/instances/240226d1-c92f-4286-81a9-783577fb194c_del complete
Dec 06 13:17:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-d7db500b-2631-4104-ac72-5fa054d24685 req-c50ffb43-7502-4c56-acbd-ee676341c562 service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Received event network-changed-b7afc02f-f620-499f-bae1-d8674398b769 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:17:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-d7db500b-2631-4104-ac72-5fa054d24685 req-c50ffb43-7502-4c56-acbd-ee676341c562 service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Refreshing instance network info cache due to event network-changed-b7afc02f-f620-499f-bae1-d8674398b769. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:17:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d7db500b-2631-4104-ac72-5fa054d24685 req-c50ffb43-7502-4c56-acbd-ee676341c562 service nova] Acquiring lock "refresh_cache-240226d1-c92f-4286-81a9-783577fb194c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:17:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d7db500b-2631-4104-ac72-5fa054d24685 req-c50ffb43-7502-4c56-acbd-ee676341c562 service nova] Acquired lock "refresh_cache-240226d1-c92f-4286-81a9-783577fb194c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:17:21 user nova-compute[75247]: DEBUG nova.network.neutron [req-d7db500b-2631-4104-ac72-5fa054d24685 req-c50ffb43-7502-4c56-acbd-ee676341c562 service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Refreshing network info cache for port b7afc02f-f620-499f-bae1-d8674398b769 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:17:21 user nova-compute[75247]: INFO nova.compute.manager [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Took 1.20 seconds to destroy the instance on the hypervisor.
Dec 06 13:17:21 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 13:17:21 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 13:17:21 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 240226d1-c92f-4286-81a9-783577fb194c] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 13:17:21 user nova-compute[75247]: DEBUG nova.network.neutron [req-d7db500b-2631-4104-ac72-5fa054d24685 req-c50ffb43-7502-4c56-acbd-ee676341c562 service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Updated VIF entry in instance network info cache for port b7afc02f-f620-499f-bae1-d8674398b769. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:17:21 user nova-compute[75247]: DEBUG nova.network.neutron [req-d7db500b-2631-4104-ac72-5fa054d24685 req-c50ffb43-7502-4c56-acbd-ee676341c562 service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Updating instance_info_cache with network_info: [{"id": "b7afc02f-f620-499f-bae1-d8674398b769", "address": "fa:16:3e:03:55:46", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7afc02f-f6", "ovs_interfaceid": "b7afc02f-f620-499f-bae1-d8674398b769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:17:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d7db500b-2631-4104-ac72-5fa054d24685 req-c50ffb43-7502-4c56-acbd-ee676341c562 service nova] Releasing lock "refresh_cache-240226d1-c92f-4286-81a9-783577fb194c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:17:21 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:17:21 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Took 0.66 seconds to deallocate network for instance.
Dec 06 13:17:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-3ed6b376-17ac-419a-8ba5-5cc0e7b7e017 req-b9c8e6c4-d880-4986-98ac-2298c82cf595 service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Received event network-vif-plugged-b7afc02f-f620-499f-bae1-d8674398b769 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:17:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ed6b376-17ac-419a-8ba5-5cc0e7b7e017 req-b9c8e6c4-d880-4986-98ac-2298c82cf595 service nova] Acquiring lock "240226d1-c92f-4286-81a9-783577fb194c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:17:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ed6b376-17ac-419a-8ba5-5cc0e7b7e017 req-b9c8e6c4-d880-4986-98ac-2298c82cf595 service nova] Lock "240226d1-c92f-4286-81a9-783577fb194c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:17:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3ed6b376-17ac-419a-8ba5-5cc0e7b7e017 req-b9c8e6c4-d880-4986-98ac-2298c82cf595 service nova] Lock "240226d1-c92f-4286-81a9-783577fb194c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:17:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-3ed6b376-17ac-419a-8ba5-5cc0e7b7e017 req-b9c8e6c4-d880-4986-98ac-2298c82cf595 service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] No waiting events found dispatching network-vif-plugged-b7afc02f-f620-499f-bae1-d8674398b769 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:17:22 user nova-compute[75247]: WARNING nova.compute.manager [req-3ed6b376-17ac-419a-8ba5-5cc0e7b7e017 req-b9c8e6c4-d880-4986-98ac-2298c82cf595 service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Received unexpected event network-vif-plugged-b7afc02f-f620-499f-bae1-d8674398b769 for instance with vm_state active and task_state deleting.
Dec 06 13:17:22 user nova-compute[75247]: DEBUG nova.compute.manager [req-3ed6b376-17ac-419a-8ba5-5cc0e7b7e017 req-b9c8e6c4-d880-4986-98ac-2298c82cf595 service nova] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Received event network-vif-deleted-b7afc02f-f620-499f-bae1-d8674398b769 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:17:22 user nova-compute[75247]: INFO nova.compute.manager [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: 240226d1-c92f-4286-81a9-783577fb194c] Took 0.77 seconds to detach 1 volumes for instance.
Dec 06 13:17:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:17:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:17:22 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:17:22 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:17:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:17:22 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Deleted allocations for instance 240226d1-c92f-4286-81a9-783577fb194c
Dec 06 13:17:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-46fed679-d347-4cee-a71e-5d3f9342d83c tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "240226d1-c92f-4286-81a9-783577fb194c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.962s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:17:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:31 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:17:31 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:17:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:35 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:17:35 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:17:37 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:17:37 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid c15d3c59-c91a-4b67-bd8a-731751a2fa6c {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 13:17:37 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid 637e64f2-3377-47ce-9891-ea9d9f3b6729 {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 13:17:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "c15d3c59-c91a-4b67-bd8a-731751a2fa6c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:17:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "c15d3c59-c91a-4b67-bd8a-731751a2fa6c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:17:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "637e64f2-3377-47ce-9891-ea9d9f3b6729" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:17:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:17:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "c15d3c59-c91a-4b67-bd8a-731751a2fa6c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:17:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:17:37 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:17:39 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:17:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:40 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:17:40 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:17:41 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:17:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:17:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:17:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:17:41 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:17:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:17:42 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:17:42 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:17:42 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:17:42 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=8843MB free_disk=25.029296875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:17:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:17:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:17:42 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance c15d3c59-c91a-4b67-bd8a-731751a2fa6c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:17:42 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 637e64f2-3377-47ce-9891-ea9d9f3b6729 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:17:42 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:17:42 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:17:42 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:17:42 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:17:42 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:17:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:17:44 user nova-compute[75247]: DEBUG nova.compute.manager [req-a82e4e07-d1a5-435b-9e4e-b20b7601c2d9 req-f5becdb9-b71b-40e7-b6c9-93b73c018175 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Received event network-changed-7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:17:44 user nova-compute[75247]: DEBUG nova.compute.manager [req-a82e4e07-d1a5-435b-9e4e-b20b7601c2d9 req-f5becdb9-b71b-40e7-b6c9-93b73c018175 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Refreshing instance network info cache due to event network-changed-7110c508-ba09-4d19-bf5f-e2d73c988c28. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:17:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a82e4e07-d1a5-435b-9e4e-b20b7601c2d9 req-f5becdb9-b71b-40e7-b6c9-93b73c018175 service nova] Acquiring lock "refresh_cache-637e64f2-3377-47ce-9891-ea9d9f3b6729" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:17:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a82e4e07-d1a5-435b-9e4e-b20b7601c2d9 req-f5becdb9-b71b-40e7-b6c9-93b73c018175 service nova] Acquired lock "refresh_cache-637e64f2-3377-47ce-9891-ea9d9f3b6729" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:17:44 user nova-compute[75247]: DEBUG nova.network.neutron [req-a82e4e07-d1a5-435b-9e4e-b20b7601c2d9 req-f5becdb9-b71b-40e7-b6c9-93b73c018175 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Refreshing network info cache for port 7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:17:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Acquiring lock "637e64f2-3377-47ce-9891-ea9d9f3b6729" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:17:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:17:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Acquiring lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:17:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:17:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:17:44 user nova-compute[75247]: INFO nova.compute.manager [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Terminating instance
Dec 06 13:17:44 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 13:17:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:44 user nova-compute[75247]: DEBUG nova.compute.manager [req-d9f09665-3e07-42c0-8a53-b035d0be603d req-0d4908d7-47d1-45f9-83de-c3d87e11b14a service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Received event network-vif-unplugged-7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:17:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d9f09665-3e07-42c0-8a53-b035d0be603d req-0d4908d7-47d1-45f9-83de-c3d87e11b14a service nova] Acquiring lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:17:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d9f09665-3e07-42c0-8a53-b035d0be603d req-0d4908d7-47d1-45f9-83de-c3d87e11b14a service nova] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:17:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-d9f09665-3e07-42c0-8a53-b035d0be603d req-0d4908d7-47d1-45f9-83de-c3d87e11b14a service nova] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:17:44 user nova-compute[75247]: DEBUG nova.compute.manager [req-d9f09665-3e07-42c0-8a53-b035d0be603d req-0d4908d7-47d1-45f9-83de-c3d87e11b14a service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] No waiting events found dispatching network-vif-unplugged-7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:17:44 user nova-compute[75247]: DEBUG nova.compute.manager [req-d9f09665-3e07-42c0-8a53-b035d0be603d req-0d4908d7-47d1-45f9-83de-c3d87e11b14a service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Received event network-vif-unplugged-7110c508-ba09-4d19-bf5f-e2d73c988c28 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG nova.network.neutron [req-a82e4e07-d1a5-435b-9e4e-b20b7601c2d9 req-f5becdb9-b71b-40e7-b6c9-93b73c018175 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Updated VIF entry in instance network info cache for port 7110c508-ba09-4d19-bf5f-e2d73c988c28. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG nova.network.neutron [req-a82e4e07-d1a5-435b-9e4e-b20b7601c2d9 req-f5becdb9-b71b-40e7-b6c9-93b73c018175 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Updating instance_info_cache with network_info: [{"id": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "address": "fa:16:3e:dd:1a:11", "network": {"id": "7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1998461599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c05e39382f114be6a2c762890523f4b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7110c508-ba", "ovs_interfaceid": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a82e4e07-d1a5-435b-9e4e-b20b7601c2d9 req-f5becdb9-b71b-40e7-b6c9-93b73c018175 service nova] Releasing lock "refresh_cache-637e64f2-3377-47ce-9891-ea9d9f3b6729" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:17:45 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Instance destroyed successfully.
Dec 06 13:17:45 user nova-compute[75247]: DEBUG nova.objects.instance [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lazy-loading 'resources' on Instance uuid 637e64f2-3377-47ce-9891-ea9d9f3b6729 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T13:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-585733721',display_name='tempest-TestShelveInstance-server-585733721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-585733721',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6bCNIz5q4P0bc7HSiL9tc3LJpv7C6/FKkLh94ST7t6mQK9UVwAkT4qnr/0qZdIPWPutLB+0ikdlsUQLbRuaqB4YyYQlbU4kFnfiRHSFeOt/3VIAmpE/aFHmv7lchH0vQ==',key_name='tempest-TestShelveInstance-816568645',keypairs=<?>,launch_index=0,launched_at=2023-12-06T13:16:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c05e39382f114be6a2c762890523f4b1',ramdisk_id='',reservation_id='r-nnlrt39q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1636467499',owner_user_name='tempest-TestShelveInstance-1636467499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T13:16:10Z,user_data=None,user_id='830024d5b05e4b5aa6d6d9674cf661e2',uuid=637e64f2-3377-47ce-9891-ea9d9f3b6729,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "address": "fa:16:3e:dd:1a:11", "network": {"id": "7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1998461599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c05e39382f114be6a2c762890523f4b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7110c508-ba", "ovs_interfaceid": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Converting VIF {"id": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "address": "fa:16:3e:dd:1a:11", "network": {"id": "7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1998461599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c05e39382f114be6a2c762890523f4b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7110c508-ba", "ovs_interfaceid": "7110c508-ba09-4d19-bf5f-e2d73c988c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=7110c508-ba09-4d19-bf5f-e2d73c988c28,network=Network(7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7110c508-ba') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG os_vif [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=7110c508-ba09-4d19-bf5f-e2d73c988c28,network=Network(7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7110c508-ba') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7110c508-ba, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d54efcc3-bdbf-49c4-8bed-384b9e8e948d) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:17:45 user nova-compute[75247]: INFO os_vif [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=7110c508-ba09-4d19-bf5f-e2d73c988c28,network=Network(7ffae31f-0e72-4c72-b777-a4b4ddfdc6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7110c508-ba')
Dec 06 13:17:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDgEaVNI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:17:45 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:17:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[535e9104-44ee-40d2-b964-8e813a525fa5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 13:17:45 user nova-compute[75247]: No targets found.
Dec 06 13:17:45 user nova-compute[75247]: iSNS:
Dec 06 13:17:45 user nova-compute[75247]: No targets found.
Dec 06 13:17:45 user nova-compute[75247]: STATIC:
Dec 06 13:17:45 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68
Dec 06 13:17:45 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:17:45 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:17:45 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c
Dec 06 13:17:45 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:17:45 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:17:45 user nova-compute[75247]: FIRMWARE:
Dec 06 13:17:45 user nova-compute[75247]: No targets found.
Dec 06 13:17:45 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 13:17:45 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 13:17:45 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f14abe-248d-41fe-b188-48b93d29187e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b235016-33d3-4d36-94f7-acdc24809e8e]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:17:45 user nova-compute[75247]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)
Dec 06 13:17:45 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:17:45 user nova-compute[75247]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c (non-flash)
Dec 06 13:17:45 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd7301904c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c'): ({'sdd'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Removing single pathed devices sdd {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b4cd5f-4601-4cc0-b9a7-2c08cc836354]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfe83e2-6ef3-4290-84f8-5c0d6a6eb476]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Flushing IO for device /dev/sdd {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4312c0f4-8476-468f-a310-354f750755fd]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb03911-bac6-42ef-8b8e-ca22869799bf]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] SCSI volumes sdd have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26632653938313666', '/dev/disk/by-id/scsi-1SCST_BIOe27082d7-f2e9816f0762b0fa', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e27082d7') {{(pid=86354) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1bf7ec-c1fc-4471-8c19-e71dbc0f7d1c]: (4, None) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd7f62e-e0cd-46e9-9ac7-cf83445cb1f0]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f782bbda-f7a8-4f2c-919c-b4b0870633c4]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c, portal: 172.16.0.220,3260]
Dec 06 13:17:45 user nova-compute[75247]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c, portal: 172.16.0.220,3260] successful.
Dec 06 13:17:45 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710dc4b0-99e7-4bd7-8695-2ac4eddf322c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[87371329-109a-4900-836e-991f81c0c075]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] <== disconnect_volume: return (297ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 13:17:45 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Deleting instance files /opt/stack/data/nova/instances/637e64f2-3377-47ce-9891-ea9d9f3b6729_del
Dec 06 13:17:45 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Deletion of /opt/stack/data/nova/instances/637e64f2-3377-47ce-9891-ea9d9f3b6729_del complete
Dec 06 13:17:45 user nova-compute[75247]: INFO nova.compute.manager [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Took 1.12 seconds to destroy the instance on the hypervisor.
Dec 06 13:17:45 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 13:17:45 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 13:17:46 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:17:46 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Took 0.37 seconds to deallocate network for instance.
Dec 06 13:17:46 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:17:46 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:17:46 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 13:17:46 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Skipping network cache update for instance because it is being deleted. {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Dec 06 13:17:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-c15d3c59-c91a-4b67-bd8a-731751a2fa6c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:17:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-c15d3c59-c91a-4b67-bd8a-731751a2fa6c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:17:46 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 13:17:46 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lazy-loading 'info_cache' on Instance uuid c15d3c59-c91a-4b67-bd8a-731751a2fa6c {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:17:46 user nova-compute[75247]: DEBUG nova.compute.manager [req-439f73aa-da9d-4699-8c19-60e29bfe26db req-ce04e633-632d-445a-80de-39e84fcfd3c5 service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Received event network-vif-deleted-7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:17:47 user nova-compute[75247]: INFO nova.compute.manager [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Took 0.81 seconds to detach 1 volumes for instance.
Dec 06 13:17:47 user nova-compute[75247]: DEBUG nova.compute.manager [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Deleting volume: 710dc4b0-99e7-4bd7-8695-2ac4eddf322c {{(pid=75247) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 06 13:17:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-044362d3-879b-4ff3-b7b8-b57c9253ee8e req-f1e1b343-a940-4b4a-8c21-8e7db5aacdcd service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Received event network-vif-plugged-7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:17:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-044362d3-879b-4ff3-b7b8-b57c9253ee8e req-f1e1b343-a940-4b4a-8c21-8e7db5aacdcd service nova] Acquiring lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:17:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-044362d3-879b-4ff3-b7b8-b57c9253ee8e req-f1e1b343-a940-4b4a-8c21-8e7db5aacdcd service nova] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:17:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-044362d3-879b-4ff3-b7b8-b57c9253ee8e req-f1e1b343-a940-4b4a-8c21-8e7db5aacdcd service nova] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:17:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-044362d3-879b-4ff3-b7b8-b57c9253ee8e req-f1e1b343-a940-4b4a-8c21-8e7db5aacdcd service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] No waiting events found dispatching network-vif-plugged-7110c508-ba09-4d19-bf5f-e2d73c988c28 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:17:47 user nova-compute[75247]: WARNING nova.compute.manager [req-044362d3-879b-4ff3-b7b8-b57c9253ee8e req-f1e1b343-a940-4b4a-8c21-8e7db5aacdcd service nova] [instance: 637e64f2-3377-47ce-9891-ea9d9f3b6729] Received unexpected event network-vif-plugged-7110c508-ba09-4d19-bf5f-e2d73c988c28 for instance with vm_state active and task_state deleting.
Dec 06 13:17:47 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Updating instance_info_cache with network_info: [{"id": "774027f4-84e8-46cd-8d40-4cdb269c4591", "address": "fa:16:3e:75:aa:77", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774027f4-84", "ovs_interfaceid": "774027f4-84e8-46cd-8d40-4cdb269c4591", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:17:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-c15d3c59-c91a-4b67-bd8a-731751a2fa6c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:17:47 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 13:17:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:17:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:17:47 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:17:47 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:17:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:17:47 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Deleted allocations for instance 637e64f2-3377-47ce-9891-ea9d9f3b6729
Dec 06 13:17:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-ac83967e-4306-4035-8153-f7351f4bfa01 tempest-TestShelveInstance-1636467499 tempest-TestShelveInstance-1636467499-project-member] Lock "637e64f2-3377-47ce-9891-ea9d9f3b6729" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.730s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:17:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:17:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:18:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:18:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:18:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:18:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:19 user nova-compute[75247]: DEBUG nova.compute.manager [req-323f9035-8664-4b35-acbc-1d3b6885b910 req-6ee09cd6-59fc-44e2-ad4e-0c8049a778b5 service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Received event network-changed-774027f4-84e8-46cd-8d40-4cdb269c4591 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:18:19 user nova-compute[75247]: DEBUG nova.compute.manager [req-323f9035-8664-4b35-acbc-1d3b6885b910 req-6ee09cd6-59fc-44e2-ad4e-0c8049a778b5 service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Refreshing instance network info cache due to event network-changed-774027f4-84e8-46cd-8d40-4cdb269c4591. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:18:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-323f9035-8664-4b35-acbc-1d3b6885b910 req-6ee09cd6-59fc-44e2-ad4e-0c8049a778b5 service nova] Acquiring lock "refresh_cache-c15d3c59-c91a-4b67-bd8a-731751a2fa6c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:18:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-323f9035-8664-4b35-acbc-1d3b6885b910 req-6ee09cd6-59fc-44e2-ad4e-0c8049a778b5 service nova] Acquired lock "refresh_cache-c15d3c59-c91a-4b67-bd8a-731751a2fa6c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:18:19 user nova-compute[75247]: DEBUG nova.network.neutron [req-323f9035-8664-4b35-acbc-1d3b6885b910 req-6ee09cd6-59fc-44e2-ad4e-0c8049a778b5 service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Refreshing network info cache for port 774027f4-84e8-46cd-8d40-4cdb269c4591 {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:18:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "c15d3c59-c91a-4b67-bd8a-731751a2fa6c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:18:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "c15d3c59-c91a-4b67-bd8a-731751a2fa6c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:18:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "c15d3c59-c91a-4b67-bd8a-731751a2fa6c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:18:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "c15d3c59-c91a-4b67-bd8a-731751a2fa6c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:18:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "c15d3c59-c91a-4b67-bd8a-731751a2fa6c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:18:19 user nova-compute[75247]: INFO nova.compute.manager [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Terminating instance
Dec 06 13:18:19 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 13:18:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG nova.network.neutron [req-323f9035-8664-4b35-acbc-1d3b6885b910 req-6ee09cd6-59fc-44e2-ad4e-0c8049a778b5 service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Updated VIF entry in instance network info cache for port 774027f4-84e8-46cd-8d40-4cdb269c4591. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG nova.network.neutron [req-323f9035-8664-4b35-acbc-1d3b6885b910 req-6ee09cd6-59fc-44e2-ad4e-0c8049a778b5 service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Updating instance_info_cache with network_info: [{"id": "774027f4-84e8-46cd-8d40-4cdb269c4591", "address": "fa:16:3e:75:aa:77", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774027f4-84", "ovs_interfaceid": "774027f4-84e8-46cd-8d40-4cdb269c4591", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-323f9035-8664-4b35-acbc-1d3b6885b910 req-6ee09cd6-59fc-44e2-ad4e-0c8049a778b5 service nova] Releasing lock "refresh_cache-c15d3c59-c91a-4b67-bd8a-731751a2fa6c" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:20 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Instance destroyed successfully.
Dec 06 13:18:20 user nova-compute[75247]: DEBUG nova.objects.instance [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lazy-loading 'resources' on Instance uuid c15d3c59-c91a-4b67-bd8a-731751a2fa6c {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:13:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-337727585',display_name='tempest-TestVolumeBootPattern-server-337727585',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-337727585',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+e3XTLfVN8C3itmblwy09HtnE6ODmf3LMeZLWfbnBfl5D2ms/C+dYrJrc6lCBYNrZ/pLuupAxLsGv6ZOwhXojQ4RlmELXbFB3bv70Zc31yz9kRGkDkIlpeboSBmcUYgg==',key_name='tempest-TestVolumeBootPattern-1199968839',keypairs=<?>,launch_index=0,launched_at=2023-12-06T13:13:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9493d9b0b1024cea9a550e2a42c1e6a1',ramdisk_id='',reservation_id='r-48vdobs5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2088852773',owner_user_name='tempest-TestVolumeBootPattern-2088852773-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T13:13:41Z,user_data=None,user_id='016714f7502b4a8fa12ed0ce6644c5fc',uuid=c15d3c59-c91a-4b67-bd8a-731751a2fa6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "774027f4-84e8-46cd-8d40-4cdb269c4591", "address": "fa:16:3e:75:aa:77", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774027f4-84", "ovs_interfaceid": "774027f4-84e8-46cd-8d40-4cdb269c4591", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converting VIF {"id": "774027f4-84e8-46cd-8d40-4cdb269c4591", "address": "fa:16:3e:75:aa:77", "network": {"id": "57556906-b1e4-4b55-81be-b63341acc722", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1227815187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9493d9b0b1024cea9a550e2a42c1e6a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774027f4-84", "ovs_interfaceid": "774027f4-84e8-46cd-8d40-4cdb269c4591", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:aa:77,bridge_name='br-int',has_traffic_filtering=True,id=774027f4-84e8-46cd-8d40-4cdb269c4591,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap774027f4-84') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG os_vif [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:aa:77,bridge_name='br-int',has_traffic_filtering=True,id=774027f4-84e8-46cd-8d40-4cdb269c4591,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap774027f4-84') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap774027f4-84, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ae2334f-54a3-4c65-ab19-6bae284c3af5) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:18:20 user nova-compute[75247]: INFO os_vif [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:aa:77,bridge_name='br-int',has_traffic_filtering=True,id=774027f4-84e8-46cd-8d40-4cdb269c4591,network=Network(57556906-b1e4-4b55-81be-b63341acc722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap774027f4-84')
Dec 06 13:18:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zldIYVrk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:18:20 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:18:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab526cd6-d8a2-4dc3-9856-f97708ab2269]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 13:18:20 user nova-compute[75247]: No targets found.
Dec 06 13:18:20 user nova-compute[75247]: iSNS:
Dec 06 13:18:20 user nova-compute[75247]: No targets found.
Dec 06 13:18:20 user nova-compute[75247]: STATIC:
Dec 06 13:18:20 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68
Dec 06 13:18:20 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:18:20 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:18:20 user nova-compute[75247]: FIRMWARE:
Dec 06 13:18:20 user nova-compute[75247]: No targets found.
Dec 06 13:18:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 13:18:20 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 13:18:20 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[22574dc1-b9f4-4611-aaff-4fca13f88d38]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd99520f-f55d-4352-9e31-d683af604bcd]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:18:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 (non-flash)
Dec 06 13:18:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd7307e1480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68'): ({'sdb'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Removing single pathed devices sdb {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b6f33d-8cc7-44a2-8b7f-2a23c8cd023f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53660fe-5d37-4c6f-899d-6cb65aa5bfba]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Flushing IO for device /dev/sdb {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8f7e33-0eb2-4af5-a362-1c35f8b82633]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ff0c4c-9ad3-4b57-a336-23b7581758cc]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO79777a29-9def9c8a80d215aa', '/dev/disk/by-id/scsi-23964656639633861', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_79777a29') {{(pid=86354) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[602bc1bb-f31b-4fa6-92dd-6766cdbe9dd4]: (4, None) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[69571d8d-85e2-4ef5-b8d3-aeaf89dd622d]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b1cc44-1b3d-4418-bea8-dd16b104aea2]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68, portal: 172.16.0.220,3260]
Dec 06 13:18:20 user nova-compute[75247]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68, portal: 172.16.0.220,3260] successful.
Dec 06 13:18:20 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984f8ea6-7058-4b3c-8e61-fa4a45712e68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2844ad08-2e73-4466-b079-5184e605ab3a]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] <== disconnect_volume: return (276ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 13:18:20 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Deleting instance files /opt/stack/data/nova/instances/c15d3c59-c91a-4b67-bd8a-731751a2fa6c_del
Dec 06 13:18:20 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Deletion of /opt/stack/data/nova/instances/c15d3c59-c91a-4b67-bd8a-731751a2fa6c_del complete
Dec 06 13:18:20 user nova-compute[75247]: INFO nova.compute.manager [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Took 1.14 seconds to destroy the instance on the hypervisor.
Dec 06 13:18:20 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 13:18:20 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 13:18:21 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:18:21 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Took 0.40 seconds to deallocate network for instance.
Dec 06 13:18:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-2fc7f93c-1587-421a-9537-697deea8a8f4 req-7acf95ca-6739-410d-a44b-65f0402f4fbd service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Received event network-vif-deleted-774027f4-84e8-46cd-8d40-4cdb269c4591 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:18:21 user nova-compute[75247]: INFO nova.compute.manager [req-2fc7f93c-1587-421a-9537-697deea8a8f4 req-7acf95ca-6739-410d-a44b-65f0402f4fbd service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Neutron deleted interface 774027f4-84e8-46cd-8d40-4cdb269c4591; detaching it from the instance and deleting it from the info cache
Dec 06 13:18:21 user nova-compute[75247]: DEBUG nova.network.neutron [req-2fc7f93c-1587-421a-9537-697deea8a8f4 req-7acf95ca-6739-410d-a44b-65f0402f4fbd service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:18:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-2fc7f93c-1587-421a-9537-697deea8a8f4 req-7acf95ca-6739-410d-a44b-65f0402f4fbd service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Detach interface failed, port_id=774027f4-84e8-46cd-8d40-4cdb269c4591, reason: Instance c15d3c59-c91a-4b67-bd8a-731751a2fa6c could not be found. {{(pid=75247) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 13:18:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-df855a7a-e636-4cea-b851-8789a2ae6b34 req-e79ff713-b3c5-4c2f-9076-879194a364d7 service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Received event network-vif-unplugged-774027f4-84e8-46cd-8d40-4cdb269c4591 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:18:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-df855a7a-e636-4cea-b851-8789a2ae6b34 req-e79ff713-b3c5-4c2f-9076-879194a364d7 service nova] Acquiring lock "c15d3c59-c91a-4b67-bd8a-731751a2fa6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:18:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-df855a7a-e636-4cea-b851-8789a2ae6b34 req-e79ff713-b3c5-4c2f-9076-879194a364d7 service nova] Lock "c15d3c59-c91a-4b67-bd8a-731751a2fa6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:18:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-df855a7a-e636-4cea-b851-8789a2ae6b34 req-e79ff713-b3c5-4c2f-9076-879194a364d7 service nova] Lock "c15d3c59-c91a-4b67-bd8a-731751a2fa6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:18:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-df855a7a-e636-4cea-b851-8789a2ae6b34 req-e79ff713-b3c5-4c2f-9076-879194a364d7 service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] No waiting events found dispatching network-vif-unplugged-774027f4-84e8-46cd-8d40-4cdb269c4591 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:18:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-df855a7a-e636-4cea-b851-8789a2ae6b34 req-e79ff713-b3c5-4c2f-9076-879194a364d7 service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Received event network-vif-unplugged-774027f4-84e8-46cd-8d40-4cdb269c4591 for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 13:18:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-df855a7a-e636-4cea-b851-8789a2ae6b34 req-e79ff713-b3c5-4c2f-9076-879194a364d7 service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Received event network-vif-plugged-774027f4-84e8-46cd-8d40-4cdb269c4591 {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:18:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-df855a7a-e636-4cea-b851-8789a2ae6b34 req-e79ff713-b3c5-4c2f-9076-879194a364d7 service nova] Acquiring lock "c15d3c59-c91a-4b67-bd8a-731751a2fa6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:18:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-df855a7a-e636-4cea-b851-8789a2ae6b34 req-e79ff713-b3c5-4c2f-9076-879194a364d7 service nova] Lock "c15d3c59-c91a-4b67-bd8a-731751a2fa6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:18:21 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-df855a7a-e636-4cea-b851-8789a2ae6b34 req-e79ff713-b3c5-4c2f-9076-879194a364d7 service nova] Lock "c15d3c59-c91a-4b67-bd8a-731751a2fa6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:18:21 user nova-compute[75247]: DEBUG nova.compute.manager [req-df855a7a-e636-4cea-b851-8789a2ae6b34 req-e79ff713-b3c5-4c2f-9076-879194a364d7 service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] No waiting events found dispatching network-vif-plugged-774027f4-84e8-46cd-8d40-4cdb269c4591 {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:18:21 user nova-compute[75247]: WARNING nova.compute.manager [req-df855a7a-e636-4cea-b851-8789a2ae6b34 req-e79ff713-b3c5-4c2f-9076-879194a364d7 service nova] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Received unexpected event network-vif-plugged-774027f4-84e8-46cd-8d40-4cdb269c4591 for instance with vm_state active and task_state deleting.
Dec 06 13:18:21 user nova-compute[75247]: INFO nova.compute.manager [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] [instance: c15d3c59-c91a-4b67-bd8a-731751a2fa6c] Took 0.78 seconds to detach 1 volumes for instance.
Dec 06 13:18:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:18:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:18:22 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:18:22 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:18:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.123s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:18:22 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Deleted allocations for instance c15d3c59-c91a-4b67-bd8a-731751a2fa6c
Dec 06 13:18:22 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6a428451-b629-4437-b867-237f5c64dabb tempest-TestVolumeBootPattern-2088852773 tempest-TestVolumeBootPattern-2088852773-project-member] Lock "c15d3c59-c91a-4b67-bd8a-731751a2fa6c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.623s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:18:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:18:32 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:18:32 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:18:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "a8e82f38-ad86-4592-988f-a2bd5f917172" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:18:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "a8e82f38-ad86-4592-988f-a2bd5f917172" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:18:33 user nova-compute[75247]: INFO nova.compute.manager [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Unshelving
Dec 06 13:18:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:18:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:18:33 user nova-compute[75247]: DEBUG nova.objects.instance [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lazy-loading 'pci_requests' on Instance uuid a8e82f38-ad86-4592-988f-a2bd5f917172 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:18:33 user nova-compute[75247]: DEBUG nova.objects.instance [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lazy-loading 'numa_topology' on Instance uuid a8e82f38-ad86-4592-988f-a2bd5f917172 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:18:33 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 13:18:33 user nova-compute[75247]: INFO nova.compute.claims [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Claim successful on node user
Dec 06 13:18:33 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:18:33 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:18:33 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.231s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:18:33 user nova-compute[75247]: INFO nova.network.neutron [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Updating port 8e50c43f-5c99-4e86-ab1f-f90ed2a390ac with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Dec 06 13:18:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:18:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquired lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:18:34 user nova-compute[75247]: DEBUG nova.network.neutron [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 13:18:34 user nova-compute[75247]: DEBUG nova.compute.manager [req-2e911b67-1690-4d85-9334-eb9eaeef4c98 req-3fda1825-81c3-44dc-b203-1456e501e15b service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Received event network-changed-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:18:34 user nova-compute[75247]: DEBUG nova.compute.manager [req-2e911b67-1690-4d85-9334-eb9eaeef4c98 req-3fda1825-81c3-44dc-b203-1456e501e15b service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Refreshing instance network info cache due to event network-changed-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:18:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2e911b67-1690-4d85-9334-eb9eaeef4c98 req-3fda1825-81c3-44dc-b203-1456e501e15b service nova] Acquiring lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:18:34 user nova-compute[75247]: DEBUG nova.network.neutron [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Updating instance_info_cache with network_info: [{"id": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "address": "fa:16:3e:55:4b:24", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e50c43f-5c", "ovs_interfaceid": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:18:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Releasing lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:18:34 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 13:18:34 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Creating image(s)
Dec 06 13:18:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:18:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "/opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:18:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "/opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:18:34 user nova-compute[75247]: DEBUG nova.objects.instance [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lazy-loading 'trusted_certs' on Instance uuid a8e82f38-ad86-4592-988f-a2bd5f917172 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:18:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2e911b67-1690-4d85-9334-eb9eaeef4c98 req-3fda1825-81c3-44dc-b203-1456e501e15b service nova] Acquired lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:18:34 user nova-compute[75247]: DEBUG nova.network.neutron [req-2e911b67-1690-4d85-9334-eb9eaeef4c98 req-3fda1825-81c3-44dc-b203-1456e501e15b service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Refreshing network info cache for port 8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:18:34 user nova-compute[75247]: DEBUG nova.objects.base [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Object Instance<a8e82f38-ad86-4592-988f-a2bd5f917172> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 13:18:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "b9cbafca791b246e8bcf7f21e0a94ee6f8f1bdee" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:18:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "b9cbafca791b246e8bcf7f21e0a94ee6f8f1bdee" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:18:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9cbafca791b246e8bcf7f21e0a94ee6f8f1bdee.part --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:18:36 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:18:36 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9cbafca791b246e8bcf7f21e0a94ee6f8f1bdee.part --force-share --output=json" returned: 0 in 0.183s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:18:36 user nova-compute[75247]: DEBUG nova.virt.images [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] 2864642f-ccc8-4fd7-9ca7-5a4ba791ae82 was qcow2, converting to raw {{(pid=75247) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 13:18:36 user nova-compute[75247]: DEBUG nova.privsep.utils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75247) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 13:18:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b9cbafca791b246e8bcf7f21e0a94ee6f8f1bdee.part /opt/stack/data/nova/instances/_base/b9cbafca791b246e8bcf7f21e0a94ee6f8f1bdee.converted {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:18:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b9cbafca791b246e8bcf7f21e0a94ee6f8f1bdee.part /opt/stack/data/nova/instances/_base/b9cbafca791b246e8bcf7f21e0a94ee6f8f1bdee.converted" returned: 0 in 0.511s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:18:36 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9cbafca791b246e8bcf7f21e0a94ee6f8f1bdee.converted --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:18:36 user nova-compute[75247]: DEBUG nova.network.neutron [req-2e911b67-1690-4d85-9334-eb9eaeef4c98 req-3fda1825-81c3-44dc-b203-1456e501e15b service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Updated VIF entry in instance network info cache for port 8e50c43f-5c99-4e86-ab1f-f90ed2a390ac. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:18:36 user nova-compute[75247]: DEBUG nova.network.neutron [req-2e911b67-1690-4d85-9334-eb9eaeef4c98 req-3fda1825-81c3-44dc-b203-1456e501e15b service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Updating instance_info_cache with network_info: [{"id": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "address": "fa:16:3e:55:4b:24", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e50c43f-5c", "ovs_interfaceid": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:18:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-2e911b67-1690-4d85-9334-eb9eaeef4c98 req-3fda1825-81c3-44dc-b203-1456e501e15b service nova] Releasing lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:18:36 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:18:36 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:18:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9cbafca791b246e8bcf7f21e0a94ee6f8f1bdee.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:18:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "b9cbafca791b246e8bcf7f21e0a94ee6f8f1bdee" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.171s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:18:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9cbafca791b246e8bcf7f21e0a94ee6f8f1bdee --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:18:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9cbafca791b246e8bcf7f21e0a94ee6f8f1bdee --force-share --output=json" returned: 0 in 0.167s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:18:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "b9cbafca791b246e8bcf7f21e0a94ee6f8f1bdee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:18:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "b9cbafca791b246e8bcf7f21e0a94ee6f8f1bdee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:18:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9cbafca791b246e8bcf7f21e0a94ee6f8f1bdee --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:18:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9cbafca791b246e8bcf7f21e0a94ee6f8f1bdee --force-share --output=json" returned: 0 in 0.167s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:18:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9cbafca791b246e8bcf7f21e0a94ee6f8f1bdee,backing_fmt=raw /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:18:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9cbafca791b246e8bcf7f21e0a94ee6f8f1bdee,backing_fmt=raw /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk 1073741824" returned: 0 in 0.048s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:18:37 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "b9cbafca791b246e8bcf7f21e0a94ee6f8f1bdee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:18:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9cbafca791b246e8bcf7f21e0a94ee6f8f1bdee --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:18:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9cbafca791b246e8bcf7f21e0a94ee6f8f1bdee --force-share --output=json" returned: 0 in 0.183s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:18:37 user nova-compute[75247]: DEBUG nova.objects.instance [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lazy-loading 'migration_context' on Instance uuid a8e82f38-ad86-4592-988f-a2bd5f917172 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:18:37 user nova-compute[75247]: DEBUG nova.objects.base [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Object Instance<a8e82f38-ad86-4592-988f-a2bd5f917172> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 13:18:37 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Rebasing disk image.
Dec 06 13:18:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:18:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.172s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:18:37 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec -F raw /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:18:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:39 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec -F raw /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk" returned: 0 in 2.547s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Ensure instance console log exists: /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Start _get_guest_xml network_info=[{"id": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "address": "fa:16:3e:55:4b:24", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e50c43f-5c", "ovs_interfaceid": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='209ea2f76e04038605fb01bf8d03d2df',container_format='bare',created_at=2023-12-06T13:16:40Z,direct_url=<?>,disk_format='qcow2',id=2864642f-ccc8-4fd7-9ca7-5a4ba791ae82,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-568751134-shelved',owner='9f58adbd4d004a44b37a0e0922da5aa3',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-06T13:16:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 13:18:40 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:18:40 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='209ea2f76e04038605fb01bf8d03d2df',container_format='bare',created_at=2023-12-06T13:16:40Z,direct_url=<?>,disk_format='qcow2',id=2864642f-ccc8-4fd7-9ca7-5a4ba791ae82,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-568751134-shelved',owner='9f58adbd4d004a44b37a0e0922da5aa3',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-06T13:16:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.objects.instance [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lazy-loading 'vcpu_model' on Instance uuid a8e82f38-ad86-4592-988f-a2bd5f917172 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.objects.base [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Object Instance<a8e82f38-ad86-4592-988f-a2bd5f917172> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T13:14:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-568751134',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-568751134',id=51,image_ref='2864642f-ccc8-4fd7-9ca7-5a4ba791ae82',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-476765996',keypairs=<?>,launch_index=0,launched_at=2023-12-06T13:14:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9f58adbd4d004a44b37a0e0922da5aa3',ramdisk_id='',reservation_id='r-xzfpgnx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2058750591',owner_user_name='tempest-AttachVolumeShelveTestJSON-2058750591-project-member',shelved_at='2023-12-06T13:16:44.747972',shelved_host='user',shelved_image_id='2864642f-ccc8-4fd7-9ca7-5a4ba791ae82'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:18:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e50e8cc91ca4ff88ebfa0b2888699d5',uuid=a8e82f38-ad86-4592-988f-a2bd5f917172,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "address": "fa:16:3e:55:4b:24", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e50c43f-5c", "ovs_interfaceid": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Converting VIF {"id": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "address": "fa:16:3e:55:4b:24", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e50c43f-5c", "ovs_interfaceid": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:4b:24,bridge_name='br-int',has_traffic_filtering=True,id=8e50c43f-5c99-4e86-ab1f-f90ed2a390ac,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e50c43f-5c') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.objects.instance [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lazy-loading 'pci_devices' on Instance uuid a8e82f38-ad86-4592-988f-a2bd5f917172 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.objects.base [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Object Instance<a8e82f38-ad86-4592-988f-a2bd5f917172> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75247) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] End _get_guest_xml xml=<domain type="kvm">
Dec 06 13:18:40 user nova-compute[75247]:   <uuid>a8e82f38-ad86-4592-988f-a2bd5f917172</uuid>
Dec 06 13:18:40 user nova-compute[75247]:   <name>instance-00000033</name>
Dec 06 13:18:40 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 13:18:40 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 13:18:40 user nova-compute[75247]:   <metadata>
Dec 06 13:18:40 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 13:18:40 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 13:18:40 user nova-compute[75247]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-568751134</nova:name>
Dec 06 13:18:40 user nova-compute[75247]:       <nova:creationTime>2023-12-06 13:18:40</nova:creationTime>
Dec 06 13:18:40 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 13:18:40 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 13:18:40 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 13:18:40 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 13:18:40 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 13:18:40 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 13:18:40 user nova-compute[75247]:       </nova:flavor>
Dec 06 13:18:40 user nova-compute[75247]:       <nova:owner>
Dec 06 13:18:40 user nova-compute[75247]:         <nova:user uuid="6e50e8cc91ca4ff88ebfa0b2888699d5">tempest-AttachVolumeShelveTestJSON-2058750591-project-member</nova:user>
Dec 06 13:18:40 user nova-compute[75247]:         <nova:project uuid="9f58adbd4d004a44b37a0e0922da5aa3">tempest-AttachVolumeShelveTestJSON-2058750591</nova:project>
Dec 06 13:18:40 user nova-compute[75247]:       </nova:owner>
Dec 06 13:18:40 user nova-compute[75247]:       <nova:root type="image" uuid="2864642f-ccc8-4fd7-9ca7-5a4ba791ae82"/>
Dec 06 13:18:40 user nova-compute[75247]:       <nova:ports>
Dec 06 13:18:40 user nova-compute[75247]:         <nova:port uuid="8e50c43f-5c99-4e86-ab1f-f90ed2a390ac">
Dec 06 13:18:40 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 06 13:18:40 user nova-compute[75247]:         </nova:port>
Dec 06 13:18:40 user nova-compute[75247]:       </nova:ports>
Dec 06 13:18:40 user nova-compute[75247]:     </nova:instance>
Dec 06 13:18:40 user nova-compute[75247]:   </metadata>
Dec 06 13:18:40 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 13:18:40 user nova-compute[75247]:     <system>
Dec 06 13:18:40 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 13:18:40 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 13:18:40 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 13:18:40 user nova-compute[75247]:       <entry name="serial">a8e82f38-ad86-4592-988f-a2bd5f917172</entry>
Dec 06 13:18:40 user nova-compute[75247]:       <entry name="uuid">a8e82f38-ad86-4592-988f-a2bd5f917172</entry>
Dec 06 13:18:40 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 13:18:40 user nova-compute[75247]:     </system>
Dec 06 13:18:40 user nova-compute[75247]:   </sysinfo>
Dec 06 13:18:40 user nova-compute[75247]:   <os>
Dec 06 13:18:40 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 13:18:40 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 13:18:40 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 13:18:40 user nova-compute[75247]:   </os>
Dec 06 13:18:40 user nova-compute[75247]:   <features>
Dec 06 13:18:40 user nova-compute[75247]:     <acpi/>
Dec 06 13:18:40 user nova-compute[75247]:     <apic/>
Dec 06 13:18:40 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 13:18:40 user nova-compute[75247]:   </features>
Dec 06 13:18:40 user nova-compute[75247]:   <clock offset="utc">
Dec 06 13:18:40 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 13:18:40 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 13:18:40 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 13:18:40 user nova-compute[75247]:   </clock>
Dec 06 13:18:40 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 13:18:40 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 13:18:40 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 13:18:40 user nova-compute[75247]:   </cpu>
Dec 06 13:18:40 user nova-compute[75247]:   <devices>
Dec 06 13:18:40 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 13:18:40 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 13:18:40 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk"/>
Dec 06 13:18:40 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 13:18:40 user nova-compute[75247]:     </disk>
Dec 06 13:18:40 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 13:18:40 user nova-compute[75247]:       <mac address="fa:16:3e:55:4b:24"/>
Dec 06 13:18:40 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:18:40 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 13:18:40 user nova-compute[75247]:       <target dev="tap8e50c43f-5c"/>
Dec 06 13:18:40 user nova-compute[75247]:     </interface>
Dec 06 13:18:40 user nova-compute[75247]:     <serial type="pty">
Dec 06 13:18:40 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/console.log" append="off"/>
Dec 06 13:18:40 user nova-compute[75247]:     </serial>
Dec 06 13:18:40 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 13:18:40 user nova-compute[75247]:     <video>
Dec 06 13:18:40 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:18:40 user nova-compute[75247]:     </video>
Dec 06 13:18:40 user nova-compute[75247]:     <rng model="virtio">
Dec 06 13:18:40 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 13:18:40 user nova-compute[75247]:     </rng>
Dec 06 13:18:40 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 13:18:40 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 13:18:40 user nova-compute[75247]:       <stats period="10"/>
Dec 06 13:18:40 user nova-compute[75247]:     </memballoon>
Dec 06 13:18:40 user nova-compute[75247]:   </devices>
Dec 06 13:18:40 user nova-compute[75247]: </domain>
Dec 06 13:18:40 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T13:14:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-568751134',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-568751134',id=51,image_ref='2864642f-ccc8-4fd7-9ca7-5a4ba791ae82',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-476765996',keypairs=<?>,launch_index=0,launched_at=2023-12-06T13:14:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9f58adbd4d004a44b37a0e0922da5aa3',ramdisk_id='',reservation_id='r-xzfpgnx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2058750591',owner_user_name='tempest-AttachVolumeShelveTestJSON-2058750591-project-member',shelved_at='2023-12-06T13:16:44.747972',shelved_host='user',shelved_image_id='2864642f-ccc8-4fd7-9ca7-5a4ba791ae82'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:18:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e50e8cc91ca4ff88ebfa0b2888699d5',uuid=a8e82f38-ad86-4592-988f-a2bd5f917172,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "address": "fa:16:3e:55:4b:24", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e50c43f-5c", "ovs_interfaceid": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Converting VIF {"id": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "address": "fa:16:3e:55:4b:24", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e50c43f-5c", "ovs_interfaceid": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:4b:24,bridge_name='br-int',has_traffic_filtering=True,id=8e50c43f-5c99-4e86-ab1f-f90ed2a390ac,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e50c43f-5c') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG os_vif [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:4b:24,bridge_name='br-int',has_traffic_filtering=True,id=8e50c43f-5c99-4e86-ab1f-f90ed2a390ac,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e50c43f-5c') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d77c407-b30e-5267-8bb1-2fbd6389322d', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e50c43f-5c, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e50c43f-5c, col_values=(('qos', UUID('9c4b34aa-245b-4af2-8b83-f622d7e7fadf')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e50c43f-5c, col_values=(('external_ids', {'iface-id': '8e50c43f-5c99-4e86-ab1f-f90ed2a390ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:4b:24', 'vm-uuid': 'a8e82f38-ad86-4592-988f-a2bd5f917172'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:40 user nova-compute[75247]: INFO os_vif [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:4b:24,bridge_name='br-int',has_traffic_filtering=True,id=8e50c43f-5c99-4e86-ab1f-f90ed2a390ac,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e50c43f-5c')
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:18:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] No VIF found with MAC fa:16:3e:55:4b:24, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 13:18:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:41 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:18:41 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:18:41 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:18:41 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:18:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:18:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:18:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:18:41 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:18:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:42 user nova-compute[75247]: DEBUG nova.compute.manager [req-4523792c-e459-479f-9aee-3bf06fa12428 req-e33897ad-858c-412a-b5d1-031f0339d8ac service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Received event network-vif-plugged-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:18:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4523792c-e459-479f-9aee-3bf06fa12428 req-e33897ad-858c-412a-b5d1-031f0339d8ac service nova] Acquiring lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:18:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4523792c-e459-479f-9aee-3bf06fa12428 req-e33897ad-858c-412a-b5d1-031f0339d8ac service nova] Lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:18:42 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-4523792c-e459-479f-9aee-3bf06fa12428 req-e33897ad-858c-412a-b5d1-031f0339d8ac service nova] Lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:18:42 user nova-compute[75247]: DEBUG nova.compute.manager [req-4523792c-e459-479f-9aee-3bf06fa12428 req-e33897ad-858c-412a-b5d1-031f0339d8ac service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] No waiting events found dispatching network-vif-plugged-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:18:42 user nova-compute[75247]: WARNING nova.compute.manager [req-4523792c-e459-479f-9aee-3bf06fa12428 req-e33897ad-858c-412a-b5d1-031f0339d8ac service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Received unexpected event network-vif-plugged-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac for instance with vm_state shelved_offloaded and task_state spawning.
Dec 06 13:18:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:18:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:42 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:18:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:18:42 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:18:43 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:18:43 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:18:43 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=9033MB free_disk=24.905418395996094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:18:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:18:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:18:43 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance a8e82f38-ad86-4592-988f-a2bd5f917172 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:18:43 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:18:43 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:18:43 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:18:43 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:18:43 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:18:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:18:44 user nova-compute[75247]: DEBUG nova.compute.manager [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 13:18:44 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 13:18:44 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Instance spawned successfully.
Dec 06 13:18:44 user nova-compute[75247]: DEBUG nova.compute.manager [req-3f9e6d94-0bf4-41b6-a317-cc9e790b7164 req-d28da615-6f98-435a-be0b-68e42ce729c7 service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Received event network-vif-plugged-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:18:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3f9e6d94-0bf4-41b6-a317-cc9e790b7164 req-d28da615-6f98-435a-be0b-68e42ce729c7 service nova] Acquiring lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:18:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3f9e6d94-0bf4-41b6-a317-cc9e790b7164 req-d28da615-6f98-435a-be0b-68e42ce729c7 service nova] Lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:18:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-3f9e6d94-0bf4-41b6-a317-cc9e790b7164 req-d28da615-6f98-435a-be0b-68e42ce729c7 service nova] Lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:18:44 user nova-compute[75247]: DEBUG nova.compute.manager [req-3f9e6d94-0bf4-41b6-a317-cc9e790b7164 req-d28da615-6f98-435a-be0b-68e42ce729c7 service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] No waiting events found dispatching network-vif-plugged-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:18:44 user nova-compute[75247]: WARNING nova.compute.manager [req-3f9e6d94-0bf4-41b6-a317-cc9e790b7164 req-d28da615-6f98-435a-be0b-68e42ce729c7 service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Received unexpected event network-vif-plugged-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac for instance with vm_state shelved_offloaded and task_state spawning.
Dec 06 13:18:44 user nova-compute[75247]: DEBUG nova.compute.manager [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 13:18:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d63f0274-bc81-4f0d-9592-5e579b6f05c4 tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "a8e82f38-ad86-4592-988f-a2bd5f917172" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.426s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:18:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:49 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:18:49 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:18:49 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 13:18:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:18:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:18:49 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 13:18:49 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lazy-loading 'info_cache' on Instance uuid a8e82f38-ad86-4592-988f-a2bd5f917172 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:18:50 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Updating instance_info_cache with network_info: [{"id": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "address": "fa:16:3e:55:4b:24", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e50c43f-5c", "ovs_interfaceid": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:18:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:18:50 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 13:18:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:18:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:19:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:19:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:19:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:19:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:19:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:19:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:19:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:19:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:19:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:19:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:19:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:19:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:19:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:19:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:19:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:19:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:19:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:19:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:19:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:19:32 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:19:34 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:19:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:19:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:19:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:19:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:19:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:19:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:19:35 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:19:38 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:19:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:19:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:19:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:19:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:19:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:19:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:19:41 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:19:42 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:19:42 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:19:42 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:19:43 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:19:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:19:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:19:43 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:19:43 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:19:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:19:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:19:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:19:44 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:19:44 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:19:44 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:19:44 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=8985MB free_disk=24.991729736328125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:19:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:19:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:19:44 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance a8e82f38-ad86-4592-988f-a2bd5f917172 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:19:44 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:19:44 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:19:44 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:19:44 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:19:45 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:19:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:19:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:19:49 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:19:49 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:19:49 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 13:19:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:19:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:19:49 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 13:19:49 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lazy-loading 'info_cache' on Instance uuid a8e82f38-ad86-4592-988f-a2bd5f917172 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:19:49 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Updating instance_info_cache with network_info: [{"id": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "address": "fa:16:3e:55:4b:24", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e50c43f-5c", "ovs_interfaceid": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:19:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-a8e82f38-ad86-4592-988f-a2bd5f917172" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:19:49 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 13:19:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:19:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:19:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:19:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:19:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:19:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:19:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:20:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:20:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:20:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:20:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:20:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:20:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:20:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:20:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:20:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:20:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:20:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6fa4d827-afd9-4d47-97e1-8b0da1aff44a tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "a8e82f38-ad86-4592-988f-a2bd5f917172" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:20:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6fa4d827-afd9-4d47-97e1-8b0da1aff44a tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "a8e82f38-ad86-4592-988f-a2bd5f917172" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:20:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6fa4d827-afd9-4d47-97e1-8b0da1aff44a tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:20:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6fa4d827-afd9-4d47-97e1-8b0da1aff44a tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:20:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6fa4d827-afd9-4d47-97e1-8b0da1aff44a tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:20:23 user nova-compute[75247]: INFO nova.compute.manager [None req-6fa4d827-afd9-4d47-97e1-8b0da1aff44a tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Terminating instance
Dec 06 13:20:23 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6fa4d827-afd9-4d47-97e1-8b0da1aff44a tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 13:20:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:20:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:20:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:20:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:20:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-a7dd15cf-6a6e-4fe5-97cc-314311eeafb3 req-cc4a83f9-c44f-4051-aeaa-18dd75c8fbbd service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Received event network-vif-unplugged-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:20:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a7dd15cf-6a6e-4fe5-97cc-314311eeafb3 req-cc4a83f9-c44f-4051-aeaa-18dd75c8fbbd service nova] Acquiring lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:20:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a7dd15cf-6a6e-4fe5-97cc-314311eeafb3 req-cc4a83f9-c44f-4051-aeaa-18dd75c8fbbd service nova] Lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:20:23 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a7dd15cf-6a6e-4fe5-97cc-314311eeafb3 req-cc4a83f9-c44f-4051-aeaa-18dd75c8fbbd service nova] Lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:20:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-a7dd15cf-6a6e-4fe5-97cc-314311eeafb3 req-cc4a83f9-c44f-4051-aeaa-18dd75c8fbbd service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] No waiting events found dispatching network-vif-unplugged-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:20:23 user nova-compute[75247]: DEBUG nova.compute.manager [req-a7dd15cf-6a6e-4fe5-97cc-314311eeafb3 req-cc4a83f9-c44f-4051-aeaa-18dd75c8fbbd service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Received event network-vif-unplugged-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 13:20:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:20:24 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Instance destroyed successfully.
Dec 06 13:20:24 user nova-compute[75247]: DEBUG nova.objects.instance [None req-6fa4d827-afd9-4d47-97e1-8b0da1aff44a tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lazy-loading 'resources' on Instance uuid a8e82f38-ad86-4592-988f-a2bd5f917172 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:20:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-6fa4d827-afd9-4d47-97e1-8b0da1aff44a tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T13:14:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-568751134',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-568751134',id=51,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDirUm2nl+6xaUZ6Yxi+egbsaNJRnA3LShnM84PDKd17/Zx/JnnPkY/xZcoDkfexZcEbGFZHezj44E5uV1v3R4USebgCgWihz36GwGfRzTF2yDzBboC/1ieEBOvIi4v3OQ==',key_name='tempest-keypair-476765996',keypairs=<?>,launch_index=0,launched_at=2023-12-06T13:18:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f58adbd4d004a44b37a0e0922da5aa3',ramdisk_id='',reservation_id='r-xzfpgnx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2058750591',owner_user_name='tempest-AttachVolumeShelveTestJSON-2058750591-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T13:18:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e50e8cc91ca4ff88ebfa0b2888699d5',uuid=a8e82f38-ad86-4592-988f-a2bd5f917172,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "address": "fa:16:3e:55:4b:24", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e50c43f-5c", "ovs_interfaceid": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 13:20:24 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-6fa4d827-afd9-4d47-97e1-8b0da1aff44a tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Converting VIF {"id": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "address": "fa:16:3e:55:4b:24", "network": {"id": "013772b1-0e2a-4d72-ae5f-65c4ad50ae4c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495418179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f58adbd4d004a44b37a0e0922da5aa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e50c43f-5c", "ovs_interfaceid": "8e50c43f-5c99-4e86-ab1f-f90ed2a390ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:20:24 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-6fa4d827-afd9-4d47-97e1-8b0da1aff44a tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:4b:24,bridge_name='br-int',has_traffic_filtering=True,id=8e50c43f-5c99-4e86-ab1f-f90ed2a390ac,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e50c43f-5c') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:20:24 user nova-compute[75247]: DEBUG os_vif [None req-6fa4d827-afd9-4d47-97e1-8b0da1aff44a tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:4b:24,bridge_name='br-int',has_traffic_filtering=True,id=8e50c43f-5c99-4e86-ab1f-f90ed2a390ac,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e50c43f-5c') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 13:20:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:20:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e50c43f-5c, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:20:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:20:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:20:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:20:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c4b34aa-245b-4af2-8b83-f622d7e7fadf) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:20:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:20:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:20:24 user nova-compute[75247]: INFO os_vif [None req-6fa4d827-afd9-4d47-97e1-8b0da1aff44a tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:4b:24,bridge_name='br-int',has_traffic_filtering=True,id=8e50c43f-5c99-4e86-ab1f-f90ed2a390ac,network=Network(013772b1-0e2a-4d72-ae5f-65c4ad50ae4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e50c43f-5c')
Dec 06 13:20:24 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6fa4d827-afd9-4d47-97e1-8b0da1aff44a tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Deleting instance files /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172_del
Dec 06 13:20:24 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6fa4d827-afd9-4d47-97e1-8b0da1aff44a tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Deletion of /opt/stack/data/nova/instances/a8e82f38-ad86-4592-988f-a2bd5f917172_del complete
Dec 06 13:20:24 user nova-compute[75247]: INFO nova.compute.manager [None req-6fa4d827-afd9-4d47-97e1-8b0da1aff44a tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Took 0.88 seconds to destroy the instance on the hypervisor.
Dec 06 13:20:24 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-6fa4d827-afd9-4d47-97e1-8b0da1aff44a tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 13:20:24 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 13:20:24 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 13:20:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:20:25 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:20:25 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Took 1.10 seconds to deallocate network for instance.
Dec 06 13:20:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6fa4d827-afd9-4d47-97e1-8b0da1aff44a tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:20:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6fa4d827-afd9-4d47-97e1-8b0da1aff44a tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:20:25 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-6fa4d827-afd9-4d47-97e1-8b0da1aff44a tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:20:25 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-6fa4d827-afd9-4d47-97e1-8b0da1aff44a tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:20:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6fa4d827-afd9-4d47-97e1-8b0da1aff44a tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.107s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:20:25 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-6fa4d827-afd9-4d47-97e1-8b0da1aff44a tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Deleted allocations for instance a8e82f38-ad86-4592-988f-a2bd5f917172
Dec 06 13:20:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6fa4d827-afd9-4d47-97e1-8b0da1aff44a tempest-AttachVolumeShelveTestJSON-2058750591 tempest-AttachVolumeShelveTestJSON-2058750591-project-member] Lock "a8e82f38-ad86-4592-988f-a2bd5f917172" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.262s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:20:25 user nova-compute[75247]: DEBUG nova.compute.manager [req-e6f4cb7c-2e84-4ce2-b5d7-40ec3c3c27bf req-53e38627-003e-4997-bc44-4d288a413c42 service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Received event network-vif-plugged-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:20:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e6f4cb7c-2e84-4ce2-b5d7-40ec3c3c27bf req-53e38627-003e-4997-bc44-4d288a413c42 service nova] Acquiring lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:20:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e6f4cb7c-2e84-4ce2-b5d7-40ec3c3c27bf req-53e38627-003e-4997-bc44-4d288a413c42 service nova] Lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:20:25 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e6f4cb7c-2e84-4ce2-b5d7-40ec3c3c27bf req-53e38627-003e-4997-bc44-4d288a413c42 service nova] Lock "a8e82f38-ad86-4592-988f-a2bd5f917172-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:20:25 user nova-compute[75247]: DEBUG nova.compute.manager [req-e6f4cb7c-2e84-4ce2-b5d7-40ec3c3c27bf req-53e38627-003e-4997-bc44-4d288a413c42 service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] No waiting events found dispatching network-vif-plugged-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:20:25 user nova-compute[75247]: WARNING nova.compute.manager [req-e6f4cb7c-2e84-4ce2-b5d7-40ec3c3c27bf req-53e38627-003e-4997-bc44-4d288a413c42 service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Received unexpected event network-vif-plugged-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac for instance with vm_state deleted and task_state None.
Dec 06 13:20:25 user nova-compute[75247]: DEBUG nova.compute.manager [req-e6f4cb7c-2e84-4ce2-b5d7-40ec3c3c27bf req-53e38627-003e-4997-bc44-4d288a413c42 service nova] [instance: a8e82f38-ad86-4592-988f-a2bd5f917172] Received event network-vif-deleted-8e50c43f-5c99-4e86-ab1f-f90ed2a390ac {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:20:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:20:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:20:32 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:20:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:20:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:20:36 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:20:37 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:20:38 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:20:38 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:20:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:20:41 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:20:42 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:20:43 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:20:43 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:20:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:20:44 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:20:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:20:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:20:44 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:20:44 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:20:45 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:20:45 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:20:45 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=9188MB free_disk=25.018917083740234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:20:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:20:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:20:45 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:20:45 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:20:45 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:20:45 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:20:45 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:20:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:20:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:20:50 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:20:50 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:20:50 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 13:20:50 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Didn't find any instances for network info cache update. {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 13:20:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:20:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:20:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:20:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:20:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:20:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:20:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:20:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:20:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:20:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:20:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:20:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:21:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:21:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:21:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:21:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:21:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:21:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:21:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:21:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:21:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:21:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:21:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:21:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:21:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:21:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:21:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:21:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:21:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:21:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:21:32 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:21:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:21:38 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:21:38 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:21:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:21:39 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:21:43 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:21:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:21:44 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:21:45 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:21:45 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:21:46 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:21:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:21:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:21:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:21:46 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:21:47 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:21:47 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:21:47 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=9187MB free_disk=25.01732635498047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:21:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:21:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:21:47 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:21:47 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:21:47 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Refreshing inventories for resource provider d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 13:21:47 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Updating ProviderTree inventory for provider d326b140-3450-4409-964c-9eafc6cc025d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 13:21:47 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Updating inventory in ProviderTree for provider d326b140-3450-4409-964c-9eafc6cc025d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 13:21:47 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Refreshing aggregate associations for resource provider d326b140-3450-4409-964c-9eafc6cc025d, aggregates: None {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 13:21:47 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Refreshing trait associations for resource provider d326b140-3450-4409-964c-9eafc6cc025d, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 13:21:47 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:21:47 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:21:47 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:21:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:21:47 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:21:47 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75247) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 13:21:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:21:50 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:21:50 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:21:50 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 13:21:50 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Didn't find any instances for network info cache update. {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 13:21:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:21:54 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:21:54 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Cleaning up deleted instances {{(pid=75247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 13:21:54 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] There are 0 instances to clean {{(pid=75247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 13:21:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:22:01 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:22:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:22:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:22:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:22:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:22:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:22:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:22:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:22:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:22:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:22:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:22:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:22:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:22:34 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:22:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:22:39 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:22:40 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:22:40 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:22:41 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:22:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:22:44 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:22:44 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:22:46 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:22:46 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:22:46 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:22:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:22:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:22:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:22:46 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:22:47 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:22:47 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:22:47 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=9208MB free_disk=25.015522003173828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:22:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:22:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:22:47 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:22:47 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:22:47 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:22:47 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:22:47 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:22:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.131s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:22:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:22:50 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:22:50 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:22:50 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 13:22:50 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Didn't find any instances for network info cache update. {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 13:22:54 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:22:59 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:04 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:09 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:14 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:23:19 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:23:24 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:29 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:23:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:34 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:36 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:23:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:39 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:40 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:23:40 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:23:41 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:23:44 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "78189385-2dd6-4b2b-82ca-ec776308ce06" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:23:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:23:45 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Starting instance... {{(pid=75247) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 13:23:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:23:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:23:45 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75247) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 13:23:45 user nova-compute[75247]: INFO nova.compute.claims [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Claim successful on node user
Dec 06 13:23:45 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:23:45 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:23:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.235s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:23:45 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Start building networks asynchronously for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 13:23:45 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Allocating IP information in the background. {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 13:23:45 user nova-compute[75247]: DEBUG nova.network.neutron [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] allocate_for_instance() {{(pid=75247) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 13:23:45 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 13:23:45 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Start building block device mappings for instance. {{(pid=75247) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 13:23:45 user nova-compute[75247]: DEBUG nova.policy [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8d20096e03c4dfd8ddb044d1db84ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccfc3a405224228b91f6f38dbb6c6c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75247) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 13:23:45 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Start spawning the instance on the hypervisor. {{(pid=75247) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 13:23:45 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Creating instance directory {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 13:23:45 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Creating image(s)
Dec 06 13:23:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "/opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:23:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "/opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:23:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "/opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:23:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:23:45 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:23:45 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:23:45 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.169s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:23:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:23:45 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:23:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:23:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.175s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:23:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk 1073741824 {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:23:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec,backing_fmt=raw /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk 1073741824" returned: 0 in 0.052s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:23:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:23:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:23:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d6f50e7ff301d53e6ee9ce8ed7937e070ca3ec --force-share --output=json" returned: 0 in 0.192s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:23:46 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Checking if we can resize image /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk. size=1073741824 {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 13:23:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:23:46 user nova-compute[75247]: DEBUG nova.network.neutron [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Successfully created port: daeb3775-21ed-4375-9510-e617331e744a {{(pid=75247) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 13:23:46 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:23:46 user nova-compute[75247]: DEBUG nova.virt.disk.api [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Cannot resize image /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk to a smaller size. {{(pid=75247) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 13:23:46 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Created local disks {{(pid=75247) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 13:23:46 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Ensure instance console log exists: /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/console.log {{(pid=75247) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 13:23:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:23:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:23:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:23:46 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:23:46 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:23:46 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:23:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:23:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:23:46 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:23:46 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:23:47 user nova-compute[75247]: DEBUG nova.network.neutron [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Successfully updated port: daeb3775-21ed-4375-9510-e617331e744a {{(pid=75247) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 13:23:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-e522ce21-d79c-4043-b2c5-8aa07be9f9c5 req-8ef7bcc7-50a2-4ed8-b727-e06766e4bcb6 service nova] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Received event network-changed-daeb3775-21ed-4375-9510-e617331e744a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:23:47 user nova-compute[75247]: DEBUG nova.compute.manager [req-e522ce21-d79c-4043-b2c5-8aa07be9f9c5 req-8ef7bcc7-50a2-4ed8-b727-e06766e4bcb6 service nova] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Refreshing instance network info cache due to event network-changed-daeb3775-21ed-4375-9510-e617331e744a. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:23:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e522ce21-d79c-4043-b2c5-8aa07be9f9c5 req-8ef7bcc7-50a2-4ed8-b727-e06766e4bcb6 service nova] Acquiring lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:23:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e522ce21-d79c-4043-b2c5-8aa07be9f9c5 req-8ef7bcc7-50a2-4ed8-b727-e06766e4bcb6 service nova] Acquired lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:23:47 user nova-compute[75247]: DEBUG nova.network.neutron [req-e522ce21-d79c-4043-b2c5-8aa07be9f9c5 req-8ef7bcc7-50a2-4ed8-b727-e06766e4bcb6 service nova] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Refreshing network info cache for port daeb3775-21ed-4375-9510-e617331e744a {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:23:47 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:23:47 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:23:47 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=8867MB free_disk=25.001689910888672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:23:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:23:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:23:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:23:47 user nova-compute[75247]: DEBUG nova.network.neutron [req-e522ce21-d79c-4043-b2c5-8aa07be9f9c5 req-8ef7bcc7-50a2-4ed8-b727-e06766e4bcb6 service nova] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 13:23:47 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 78189385-2dd6-4b2b-82ca-ec776308ce06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:23:47 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:23:47 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:23:47 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:23:47 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:23:47 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:23:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:23:47 user nova-compute[75247]: DEBUG nova.network.neutron [req-e522ce21-d79c-4043-b2c5-8aa07be9f9c5 req-8ef7bcc7-50a2-4ed8-b727-e06766e4bcb6 service nova] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:23:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e522ce21-d79c-4043-b2c5-8aa07be9f9c5 req-8ef7bcc7-50a2-4ed8-b727-e06766e4bcb6 service nova] Releasing lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:23:47 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquired lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:23:47 user nova-compute[75247]: DEBUG nova.network.neutron [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Building network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 13:23:47 user nova-compute[75247]: DEBUG nova.network.neutron [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Instance cache missing network info. {{(pid=75247) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 13:23:47 user nova-compute[75247]: DEBUG nova.network.neutron [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Updating instance_info_cache with network_info: [{"id": "daeb3775-21ed-4375-9510-e617331e744a", "address": "fa:16:3e:48:b5:b8", "network": {"id": "f95aee4a-5149-48bb-ab5d-356e48794bd9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-861632372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ccfc3a405224228b91f6f38dbb6c6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb3775-21", "ovs_interfaceid": "daeb3775-21ed-4375-9510-e617331e744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Releasing lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Instance network_info: |[{"id": "daeb3775-21ed-4375-9510-e617331e744a", "address": "fa:16:3e:48:b5:b8", "network": {"id": "f95aee4a-5149-48bb-ab5d-356e48794bd9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-861632372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ccfc3a405224228b91f6f38dbb6c6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb3775-21", "ovs_interfaceid": "daeb3775-21ed-4375-9510-e617331e744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75247) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Start _get_guest_xml network_info=[{"id": "daeb3775-21ed-4375-9510-e617331e744a", "address": "fa:16:3e:48:b5:b8", "network": {"id": "f95aee4a-5149-48bb-ab5d-356e48794bd9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-861632372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ccfc3a405224228b91f6f38dbb6c6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb3775-21", "ovs_interfaceid": "daeb3775-21ed-4375-9510-e617331e744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '8242af4f-c2f6-4990-9385-f1348e8ff114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 13:23:48 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:23:48 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] CPU controller missing on host. {{(pid=75247) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.host [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] CPU controller found on host. {{(pid=75247) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75247) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T12:36:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T12:36:28Z,direct_url=<?>,disk_format='qcow2',id=8242af4f-c2f6-4990-9385-f1348e8ff114,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cdd9b7fb5eaf469d885ee225099128e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T12:36:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Flavor limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Image limits 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Flavor pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Image pref 0:0:0 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Got 1 possible topologies {{(pid=75247) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.virt.hardware [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75247) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:23:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-338472318',display_name='tempest-SnapshotDataIntegrityTests-server-338472318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-338472318',id=53,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSPHIipmQPAjSnzkIjbBNUd0iQxVHIhXcOseodYCCgKuhrGIQpN8j3qnK/mV8v0CqO+KLx5RcFU4qTTK6blFNjyiW3jZToYhUjCd+psBIRuBZMnjNyVlVJ2B72J82fXAw==',key_name='tempest-keypair-1614072218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ccfc3a405224228b91f6f38dbb6c6c5',ramdisk_id='',reservation_id='r-3kyflhen',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1305509829',owner_user_name='tempest-SnapshotDataIntegrityTests-1305509829-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:23:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8d20096e03c4dfd8ddb044d1db84ff4',uuid=78189385-2dd6-4b2b-82ca-ec776308ce06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daeb3775-21ed-4375-9510-e617331e744a", "address": "fa:16:3e:48:b5:b8", "network": {"id": "f95aee4a-5149-48bb-ab5d-356e48794bd9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-861632372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ccfc3a405224228b91f6f38dbb6c6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb3775-21", "ovs_interfaceid": "daeb3775-21ed-4375-9510-e617331e744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75247) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Converting VIF {"id": "daeb3775-21ed-4375-9510-e617331e744a", "address": "fa:16:3e:48:b5:b8", "network": {"id": "f95aee4a-5149-48bb-ab5d-356e48794bd9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-861632372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ccfc3a405224228b91f6f38dbb6c6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb3775-21", "ovs_interfaceid": "daeb3775-21ed-4375-9510-e617331e744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:b5:b8,bridge_name='br-int',has_traffic_filtering=True,id=daeb3775-21ed-4375-9510-e617331e744a,network=Network(f95aee4a-5149-48bb-ab5d-356e48794bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaeb3775-21') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.objects.instance [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lazy-loading 'pci_devices' on Instance uuid 78189385-2dd6-4b2b-82ca-ec776308ce06 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] End _get_guest_xml xml=<domain type="kvm">
Dec 06 13:23:48 user nova-compute[75247]:   <uuid>78189385-2dd6-4b2b-82ca-ec776308ce06</uuid>
Dec 06 13:23:48 user nova-compute[75247]:   <name>instance-00000035</name>
Dec 06 13:23:48 user nova-compute[75247]:   <memory>524288</memory>
Dec 06 13:23:48 user nova-compute[75247]:   <vcpu>1</vcpu>
Dec 06 13:23:48 user nova-compute[75247]:   <metadata>
Dec 06 13:23:48 user nova-compute[75247]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 13:23:48 user nova-compute[75247]:       <nova:package version="0.0.0"/>
Dec 06 13:23:48 user nova-compute[75247]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-338472318</nova:name>
Dec 06 13:23:48 user nova-compute[75247]:       <nova:creationTime>2023-12-06 13:23:48</nova:creationTime>
Dec 06 13:23:48 user nova-compute[75247]:       <nova:flavor name="m1.tiny">
Dec 06 13:23:48 user nova-compute[75247]:         <nova:memory>512</nova:memory>
Dec 06 13:23:48 user nova-compute[75247]:         <nova:disk>1</nova:disk>
Dec 06 13:23:48 user nova-compute[75247]:         <nova:swap>0</nova:swap>
Dec 06 13:23:48 user nova-compute[75247]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 13:23:48 user nova-compute[75247]:         <nova:vcpus>1</nova:vcpus>
Dec 06 13:23:48 user nova-compute[75247]:       </nova:flavor>
Dec 06 13:23:48 user nova-compute[75247]:       <nova:owner>
Dec 06 13:23:48 user nova-compute[75247]:         <nova:user uuid="c8d20096e03c4dfd8ddb044d1db84ff4">tempest-SnapshotDataIntegrityTests-1305509829-project-member</nova:user>
Dec 06 13:23:48 user nova-compute[75247]:         <nova:project uuid="9ccfc3a405224228b91f6f38dbb6c6c5">tempest-SnapshotDataIntegrityTests-1305509829</nova:project>
Dec 06 13:23:48 user nova-compute[75247]:       </nova:owner>
Dec 06 13:23:48 user nova-compute[75247]:       <nova:root type="image" uuid="8242af4f-c2f6-4990-9385-f1348e8ff114"/>
Dec 06 13:23:48 user nova-compute[75247]:       <nova:ports>
Dec 06 13:23:48 user nova-compute[75247]:         <nova:port uuid="daeb3775-21ed-4375-9510-e617331e744a">
Dec 06 13:23:48 user nova-compute[75247]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 06 13:23:48 user nova-compute[75247]:         </nova:port>
Dec 06 13:23:48 user nova-compute[75247]:       </nova:ports>
Dec 06 13:23:48 user nova-compute[75247]:     </nova:instance>
Dec 06 13:23:48 user nova-compute[75247]:   </metadata>
Dec 06 13:23:48 user nova-compute[75247]:   <sysinfo type="smbios">
Dec 06 13:23:48 user nova-compute[75247]:     <system>
Dec 06 13:23:48 user nova-compute[75247]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 13:23:48 user nova-compute[75247]:       <entry name="product">OpenStack Nova</entry>
Dec 06 13:23:48 user nova-compute[75247]:       <entry name="version">0.0.0</entry>
Dec 06 13:23:48 user nova-compute[75247]:       <entry name="serial">78189385-2dd6-4b2b-82ca-ec776308ce06</entry>
Dec 06 13:23:48 user nova-compute[75247]:       <entry name="uuid">78189385-2dd6-4b2b-82ca-ec776308ce06</entry>
Dec 06 13:23:48 user nova-compute[75247]:       <entry name="family">Virtual Machine</entry>
Dec 06 13:23:48 user nova-compute[75247]:     </system>
Dec 06 13:23:48 user nova-compute[75247]:   </sysinfo>
Dec 06 13:23:48 user nova-compute[75247]:   <os>
Dec 06 13:23:48 user nova-compute[75247]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 13:23:48 user nova-compute[75247]:     <boot dev="hd"/>
Dec 06 13:23:48 user nova-compute[75247]:     <smbios mode="sysinfo"/>
Dec 06 13:23:48 user nova-compute[75247]:   </os>
Dec 06 13:23:48 user nova-compute[75247]:   <features>
Dec 06 13:23:48 user nova-compute[75247]:     <acpi/>
Dec 06 13:23:48 user nova-compute[75247]:     <apic/>
Dec 06 13:23:48 user nova-compute[75247]:     <vmcoreinfo/>
Dec 06 13:23:48 user nova-compute[75247]:   </features>
Dec 06 13:23:48 user nova-compute[75247]:   <clock offset="utc">
Dec 06 13:23:48 user nova-compute[75247]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 13:23:48 user nova-compute[75247]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 13:23:48 user nova-compute[75247]:     <timer name="hpet" present="no"/>
Dec 06 13:23:48 user nova-compute[75247]:   </clock>
Dec 06 13:23:48 user nova-compute[75247]:   <cpu mode="custom" match="exact">
Dec 06 13:23:48 user nova-compute[75247]:     <model>Nehalem</model>
Dec 06 13:23:48 user nova-compute[75247]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 13:23:48 user nova-compute[75247]:   </cpu>
Dec 06 13:23:48 user nova-compute[75247]:   <devices>
Dec 06 13:23:48 user nova-compute[75247]:     <disk type="file" device="disk">
Dec 06 13:23:48 user nova-compute[75247]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 13:23:48 user nova-compute[75247]:       <source file="/opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk"/>
Dec 06 13:23:48 user nova-compute[75247]:       <target dev="vda" bus="virtio"/>
Dec 06 13:23:48 user nova-compute[75247]:     </disk>
Dec 06 13:23:48 user nova-compute[75247]:     <interface type="ethernet">
Dec 06 13:23:48 user nova-compute[75247]:       <mac address="fa:16:3e:48:b5:b8"/>
Dec 06 13:23:48 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:23:48 user nova-compute[75247]:       <mtu size="1442"/>
Dec 06 13:23:48 user nova-compute[75247]:       <target dev="tapdaeb3775-21"/>
Dec 06 13:23:48 user nova-compute[75247]:     </interface>
Dec 06 13:23:48 user nova-compute[75247]:     <serial type="pty">
Dec 06 13:23:48 user nova-compute[75247]:       <log file="/opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/console.log" append="off"/>
Dec 06 13:23:48 user nova-compute[75247]:     </serial>
Dec 06 13:23:48 user nova-compute[75247]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 13:23:48 user nova-compute[75247]:     <video>
Dec 06 13:23:48 user nova-compute[75247]:       <model type="virtio"/>
Dec 06 13:23:48 user nova-compute[75247]:     </video>
Dec 06 13:23:48 user nova-compute[75247]:     <rng model="virtio">
Dec 06 13:23:48 user nova-compute[75247]:       <backend model="random">/dev/urandom</backend>
Dec 06 13:23:48 user nova-compute[75247]:     </rng>
Dec 06 13:23:48 user nova-compute[75247]:     <controller type="usb" index="0" model="none"/>
Dec 06 13:23:48 user nova-compute[75247]:     <memballoon model="virtio">
Dec 06 13:23:48 user nova-compute[75247]:       <stats period="10"/>
Dec 06 13:23:48 user nova-compute[75247]:     </memballoon>
Dec 06 13:23:48 user nova-compute[75247]:   </devices>
Dec 06 13:23:48 user nova-compute[75247]: </domain>
Dec 06 13:23:48 user nova-compute[75247]:  {{(pid=75247) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:23:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-338472318',display_name='tempest-SnapshotDataIntegrityTests-server-338472318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-338472318',id=53,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSPHIipmQPAjSnzkIjbBNUd0iQxVHIhXcOseodYCCgKuhrGIQpN8j3qnK/mV8v0CqO+KLx5RcFU4qTTK6blFNjyiW3jZToYhUjCd+psBIRuBZMnjNyVlVJ2B72J82fXAw==',key_name='tempest-keypair-1614072218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ccfc3a405224228b91f6f38dbb6c6c5',ramdisk_id='',reservation_id='r-3kyflhen',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1305509829',owner_user_name='tempest-SnapshotDataIntegrityTests-1305509829-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T13:23:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8d20096e03c4dfd8ddb044d1db84ff4',uuid=78189385-2dd6-4b2b-82ca-ec776308ce06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daeb3775-21ed-4375-9510-e617331e744a", "address": "fa:16:3e:48:b5:b8", "network": {"id": "f95aee4a-5149-48bb-ab5d-356e48794bd9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-861632372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ccfc3a405224228b91f6f38dbb6c6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb3775-21", "ovs_interfaceid": "daeb3775-21ed-4375-9510-e617331e744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Converting VIF {"id": "daeb3775-21ed-4375-9510-e617331e744a", "address": "fa:16:3e:48:b5:b8", "network": {"id": "f95aee4a-5149-48bb-ab5d-356e48794bd9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-861632372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ccfc3a405224228b91f6f38dbb6c6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb3775-21", "ovs_interfaceid": "daeb3775-21ed-4375-9510-e617331e744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:b5:b8,bridge_name='br-int',has_traffic_filtering=True,id=daeb3775-21ed-4375-9510-e617331e744a,network=Network(f95aee4a-5149-48bb-ab5d-356e48794bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaeb3775-21') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG os_vif [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:b5:b8,bridge_name='br-int',has_traffic_filtering=True,id=daeb3775-21ed-4375-9510-e617331e744a,network=Network(f95aee4a-5149-48bb-ab5d-356e48794bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaeb3775-21') {{(pid=75247) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6d76487-eeef-5e12-bcff-0442d92bad49', '_type': 'linux-noop'}}, row=False) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdaeb3775-21, may_exist=True, interface_attrs={}) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdaeb3775-21, col_values=(('qos', UUID('a12e0852-da08-498c-87b1-033e6382aaab')),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdaeb3775-21, col_values=(('external_ids', {'iface-id': 'daeb3775-21ed-4375-9510-e617331e744a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:b5:b8', 'vm-uuid': '78189385-2dd6-4b2b-82ca-ec776308ce06'}),), if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:48 user nova-compute[75247]: INFO os_vif [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:b5:b8,bridge_name='br-int',has_traffic_filtering=True,id=daeb3775-21ed-4375-9510-e617331e744a,network=Network(f95aee4a-5149-48bb-ab5d-356e48794bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaeb3775-21')
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:23:48 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] No VIF found with MAC fa:16:3e:48:b5:b8, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 13:23:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-e03a090f-df0a-4678-a7e6-a4e43a00c5a7 req-8c653505-df80-4294-a317-5fba593e5b4f service nova] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Received event network-vif-plugged-daeb3775-21ed-4375-9510-e617331e744a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:23:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e03a090f-df0a-4678-a7e6-a4e43a00c5a7 req-8c653505-df80-4294-a317-5fba593e5b4f service nova] Acquiring lock "78189385-2dd6-4b2b-82ca-ec776308ce06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:23:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e03a090f-df0a-4678-a7e6-a4e43a00c5a7 req-8c653505-df80-4294-a317-5fba593e5b4f service nova] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:23:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-e03a090f-df0a-4678-a7e6-a4e43a00c5a7 req-8c653505-df80-4294-a317-5fba593e5b4f service nova] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:23:49 user nova-compute[75247]: DEBUG nova.compute.manager [req-e03a090f-df0a-4678-a7e6-a4e43a00c5a7 req-8c653505-df80-4294-a317-5fba593e5b4f service nova] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] No waiting events found dispatching network-vif-plugged-daeb3775-21ed-4375-9510-e617331e744a {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:23:49 user nova-compute[75247]: WARNING nova.compute.manager [req-e03a090f-df0a-4678-a7e6-a4e43a00c5a7 req-8c653505-df80-4294-a317-5fba593e5b4f service nova] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Received unexpected event network-vif-plugged-daeb3775-21ed-4375-9510-e617331e744a for instance with vm_state building and task_state spawning.
Dec 06 13:23:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:50 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:50 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:23:50 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:23:50 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 13:23:50 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Skipping network cache update for instance because it is Building. {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Dec 06 13:23:50 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Didn't find any instances for network info cache update. {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 13:23:51 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Instance event wait completed in 0 seconds for  {{(pid=75247) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 13:23:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Guest created on hypervisor {{(pid=75247) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 13:23:51 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Instance spawned successfully.
Dec 06 13:23:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 13:23:51 user nova-compute[75247]: DEBUG nova.compute.manager [req-bd4077f2-f61f-4e2c-a5de-4da8048eefb1 req-24211157-30ab-4f57-be1d-dc72425ada2a service nova] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Received event network-vif-plugged-daeb3775-21ed-4375-9510-e617331e744a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:23:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bd4077f2-f61f-4e2c-a5de-4da8048eefb1 req-24211157-30ab-4f57-be1d-dc72425ada2a service nova] Acquiring lock "78189385-2dd6-4b2b-82ca-ec776308ce06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:23:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bd4077f2-f61f-4e2c-a5de-4da8048eefb1 req-24211157-30ab-4f57-be1d-dc72425ada2a service nova] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:23:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-bd4077f2-f61f-4e2c-a5de-4da8048eefb1 req-24211157-30ab-4f57-be1d-dc72425ada2a service nova] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:23:51 user nova-compute[75247]: DEBUG nova.compute.manager [req-bd4077f2-f61f-4e2c-a5de-4da8048eefb1 req-24211157-30ab-4f57-be1d-dc72425ada2a service nova] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] No waiting events found dispatching network-vif-plugged-daeb3775-21ed-4375-9510-e617331e744a {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:23:51 user nova-compute[75247]: WARNING nova.compute.manager [req-bd4077f2-f61f-4e2c-a5de-4da8048eefb1 req-24211157-30ab-4f57-be1d-dc72425ada2a service nova] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Received unexpected event network-vif-plugged-daeb3775-21ed-4375-9510-e617331e744a for instance with vm_state building and task_state spawning.
Dec 06 13:23:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Found default for hw_cdrom_bus of ide {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:23:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Found default for hw_disk_bus of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:23:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Found default for hw_input_bus of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:23:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Found default for hw_pointer_model of None {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:23:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Found default for hw_video_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:23:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Found default for hw_vif_model of virtio {{(pid=75247) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 13:23:52 user nova-compute[75247]: INFO nova.compute.manager [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Took 6.20 seconds to spawn the instance on the hypervisor.
Dec 06 13:23:52 user nova-compute[75247]: DEBUG nova.compute.manager [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Checking state {{(pid=75247) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 13:23:52 user nova-compute[75247]: INFO nova.compute.manager [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Took 6.84 seconds to build instance.
Dec 06 13:23:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-6bba3afd-ef1c-40be-9cf7-36fb362380c1 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.981s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:23:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:23:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:24:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:24:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:24:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:24:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:24:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:24:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:24:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:24:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:24:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:24:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:24:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:24:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:24:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:24:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:24:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:24:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:24:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:24:36 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:24:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:24:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:24:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:24:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:24:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:24:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:24:40 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:24:41 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:24:41 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:24:42 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:24:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:24:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:24:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:24:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:24:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:24:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:24:45 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:24:46 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:24:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:24:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:24:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:24:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:24:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:24:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:24:48 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:24:48 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:24:48 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:24:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:24:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:24:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:24:48 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:24:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:24:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:24:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:24:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:24:49 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:24:49 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:24:49 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=8972MB free_disk=24.961353302001953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:24:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:24:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:24:49 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 78189385-2dd6-4b2b-82ca-ec776308ce06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:24:49 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:24:49 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:24:49 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:24:49 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:24:49 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:24:49 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:24:51 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:24:51 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:24:51 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 13:24:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:24:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:24:52 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 13:24:52 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lazy-loading 'info_cache' on Instance uuid 78189385-2dd6-4b2b-82ca-ec776308ce06 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:24:52 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Updating instance_info_cache with network_info: [{"id": "daeb3775-21ed-4375-9510-e617331e744a", "address": "fa:16:3e:48:b5:b8", "network": {"id": "f95aee4a-5149-48bb-ab5d-356e48794bd9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-861632372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ccfc3a405224228b91f6f38dbb6c6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb3775-21", "ovs_interfaceid": "daeb3775-21ed-4375-9510-e617331e744a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:24:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:24:52 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 13:24:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:24:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:24:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:24:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:24:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:24:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:24:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:24:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:24:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:24:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:24:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:24:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:25:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:25:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:25:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:25:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:25:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:25:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:25:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:25:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:25:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:25:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:25:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:25:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:25:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:25:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:25:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:25:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:25:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:25:36 user nova-compute[75247]: DEBUG nova.compute.manager [req-746743c8-ae81-4be8-a706-b53e2ac5cd70 req-c4c444b5-c6ab-4d8b-8e6e-eeb45d412af3 service nova] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Received event network-changed-daeb3775-21ed-4375-9510-e617331e744a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:25:36 user nova-compute[75247]: DEBUG nova.compute.manager [req-746743c8-ae81-4be8-a706-b53e2ac5cd70 req-c4c444b5-c6ab-4d8b-8e6e-eeb45d412af3 service nova] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Refreshing instance network info cache due to event network-changed-daeb3775-21ed-4375-9510-e617331e744a. {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 13:25:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-746743c8-ae81-4be8-a706-b53e2ac5cd70 req-c4c444b5-c6ab-4d8b-8e6e-eeb45d412af3 service nova] Acquiring lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:25:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-746743c8-ae81-4be8-a706-b53e2ac5cd70 req-c4c444b5-c6ab-4d8b-8e6e-eeb45d412af3 service nova] Acquired lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:25:36 user nova-compute[75247]: DEBUG nova.network.neutron [req-746743c8-ae81-4be8-a706-b53e2ac5cd70 req-c4c444b5-c6ab-4d8b-8e6e-eeb45d412af3 service nova] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Refreshing network info cache for port daeb3775-21ed-4375-9510-e617331e744a {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 13:25:36 user nova-compute[75247]: DEBUG nova.network.neutron [req-746743c8-ae81-4be8-a706-b53e2ac5cd70 req-c4c444b5-c6ab-4d8b-8e6e-eeb45d412af3 service nova] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Updated VIF entry in instance network info cache for port daeb3775-21ed-4375-9510-e617331e744a. {{(pid=75247) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 13:25:36 user nova-compute[75247]: DEBUG nova.network.neutron [req-746743c8-ae81-4be8-a706-b53e2ac5cd70 req-c4c444b5-c6ab-4d8b-8e6e-eeb45d412af3 service nova] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Updating instance_info_cache with network_info: [{"id": "daeb3775-21ed-4375-9510-e617331e744a", "address": "fa:16:3e:48:b5:b8", "network": {"id": "f95aee4a-5149-48bb-ab5d-356e48794bd9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-861632372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ccfc3a405224228b91f6f38dbb6c6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb3775-21", "ovs_interfaceid": "daeb3775-21ed-4375-9510-e617331e744a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:25:36 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-746743c8-ae81-4be8-a706-b53e2ac5cd70 req-c4c444b5-c6ab-4d8b-8e6e-eeb45d412af3 service nova] Releasing lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:25:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:25:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:25:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:25:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:25:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:25:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:25:38 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:25:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "78189385-2dd6-4b2b-82ca-ec776308ce06" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:25:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:25:39 user nova-compute[75247]: DEBUG nova.objects.instance [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lazy-loading 'flavor' on Instance uuid 78189385-2dd6-4b2b-82ca-ec776308ce06 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:25:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:25:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "78189385-2dd6-4b2b-82ca-ec776308ce06" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:25:39 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:25:39 user nova-compute[75247]: INFO nova.compute.manager [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Attaching volume ef208af8-9247-4f01-baa8-2f2c47229b25 to /dev/vdb
Dec 06 13:25:39 user nova-compute[75247]: DEBUG os_brick.utils [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:25:39 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:25:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:25:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e49a298-3beb-4071-ae72-cc7997e6e49a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:25:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:25:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:25:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c70e0b-194e-494f-8fa5-59f94a37cec2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:25:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:25:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:25:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d8f5f7-cc6f-4dde-b377-01f777102424]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:25:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0f6135-fe7d-442e-8122-f49eda0bd7ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:25:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:25:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:25:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 13:25:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:25:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:25:40 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 13:25:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acc1910-e50e-4579-8637-937f94bbaf8d]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:25:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 13:25:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 13:25:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 13:25:40 user nova-compute[75247]: DEBUG os_brick.utils [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:25:40 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Updating existing volume attachment record: 1575533c-005f-440b-9623-d5180340d171 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 13:25:40 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:25:41 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:25:41 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:25:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:25:43 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:25:45 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:25:45 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:25:46 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:25:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:25:48 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:25:48 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQCEyqOz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:25:49 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:25:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:25:49 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:25:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:25:49 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3d12a2-1716-4d17-a2b5-9c3599111a08]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 13:25:49 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad2eff9-37b7-4999-bd3a-56690e397caa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25] added
Dec 06 13:25:49 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[109234d6-dcde-4991-99e8-b47baf15430b]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4d6cf9-8662-46ce-82e2-78f6c3365131]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iQCEyqOz {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iQCEyqOz" returned: 0 in 0.024s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d1361f-fc76-408e-9a55-17d44f1b4a86]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iQCEyqOz'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd1d566-b7bf-415d-9813-4d318bb98e0c]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7e4299-8ffb-4d43-bbb0-afc909976dcb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 13:25:49 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 13:25:49 user nova-compute[75247]:  {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:25:49 user nova-compute[75247]: WARNING os_brick.initiator.connectors.iscsi [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 13:25:49 user nova-compute[75247]: 
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[858bcb8b-6069-4cd9-ba4f-c608184c7dd2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25, portal: 172.16.0.220,3260]
Dec 06 13:25:49 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25, portal: 172.16.0.220,3260] successful.
Dec 06 13:25:49 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7a3a8b-d97e-4e32-9bd9-9f94a31cecf7]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bd6cb4-ba3f-44b5-b2b1-01d8b8b3537f]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 (non-flash)
Dec 06 13:25:49 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 (non-flash)
Dec 06 13:25:49 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d660813-6a50-42a4-bf91-386b72341bbf]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:25:49 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 13:25:50 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 13:25:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQCEyqOz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 13:25:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:25:50 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23634353863326637', 'path': '/dev/sdb'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:25:50 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634353863326637', 'path': '/dev/sdb'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 13:25:50 user nova-compute[75247]: DEBUG nova.objects.instance [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lazy-loading 'flavor' on Instance uuid 78189385-2dd6-4b2b-82ca-ec776308ce06 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:25:50 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 13:25:50 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:25:50 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 13:25:50 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 13:25:50 user nova-compute[75247]:   <serial>ef208af8-9247-4f01-baa8-2f2c47229b25</serial>
Dec 06 13:25:50 user nova-compute[75247]: </disk>
Dec 06 13:25:50 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 13:25:50 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:25:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:25:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:25:50 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:25:50 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:25:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:25:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:25:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:25:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] No VIF found with MAC fa:16:3e:48:b5:b8, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 13:25:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:25:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:25:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-8bf3a022-d897-4eb2-986b-4b511a9fec0c tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.382s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:25:51 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:25:51 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75247) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 13:25:51 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:25:51 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:25:51 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=9009MB free_disk=24.960079193115234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:25:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:25:51 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:25:51 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 78189385-2dd6-4b2b-82ca-ec776308ce06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:25:51 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:25:51 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:25:51 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:25:51 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:25:52 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:25:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:25:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:25:54 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:25:54 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:25:54 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 13:25:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:25:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:25:54 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 13:25:54 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lazy-loading 'info_cache' on Instance uuid 78189385-2dd6-4b2b-82ca-ec776308ce06 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:25:54 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Updating instance_info_cache with network_info: [{"id": "daeb3775-21ed-4375-9510-e617331e744a", "address": "fa:16:3e:48:b5:b8", "network": {"id": "f95aee4a-5149-48bb-ab5d-356e48794bd9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-861632372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ccfc3a405224228b91f6f38dbb6c6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb3775-21", "ovs_interfaceid": "daeb3775-21ed-4375-9510-e617331e744a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:25:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:25:54 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 13:25:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:25:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:26:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:26:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:26:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:26:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:26:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "78189385-2dd6-4b2b-82ca-ec776308ce06" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:26:08 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:26:08 user nova-compute[75247]: INFO nova.compute.manager [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Detaching volume ef208af8-9247-4f01-baa8-2f2c47229b25
Dec 06 13:26:09 user nova-compute[75247]: INFO nova.virt.block_device [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Attempting to driver detach volume ef208af8-9247-4f01-baa8-2f2c47229b25 from mountpoint /dev/vdb
Dec 06 13:26:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Attempting to detach device vdb from instance 78189385-2dd6-4b2b-82ca-ec776308ce06 from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 13:26:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 13:26:09 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:26:09 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 13:26:09 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 13:26:09 user nova-compute[75247]:   <serial>ef208af8-9247-4f01-baa8-2f2c47229b25</serial>
Dec 06 13:26:09 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 13:26:09 user nova-compute[75247]: </disk>
Dec 06 13:26:09 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 13:26:09 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Successfully detached device vdb from instance 78189385-2dd6-4b2b-82ca-ec776308ce06 from the persistent domain config.
Dec 06 13:26:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 78189385-2dd6-4b2b-82ca-ec776308ce06 from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 13:26:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 13:26:09 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:26:09 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 13:26:09 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 13:26:09 user nova-compute[75247]:   <serial>ef208af8-9247-4f01-baa8-2f2c47229b25</serial>
Dec 06 13:26:09 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 13:26:09 user nova-compute[75247]: </disk>
Dec 06 13:26:09 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 13:26:09 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 78189385-2dd6-4b2b-82ca-ec776308ce06 {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 13:26:10 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:26:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:26:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:26:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:26:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:26:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:26:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:26:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:26:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:26:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:26:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:26:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:26:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:26:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:26:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:26:29 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 78189385-2dd6-4b2b-82ca-ec776308ce06 is timed out.
Dec 06 13:26:29 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Successfully detached device vdb from instance 78189385-2dd6-4b2b-82ca-ec776308ce06 from the live domain config.
Dec 06 13:26:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQCEyqOz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:26:29 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:26:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[be24c7c9-9e4e-433c-9a28-cbd15adae46c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 13:26:29 user nova-compute[75247]: No targets found.
Dec 06 13:26:29 user nova-compute[75247]: iSNS:
Dec 06 13:26:29 user nova-compute[75247]: No targets found.
Dec 06 13:26:29 user nova-compute[75247]: STATIC:
Dec 06 13:26:29 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25
Dec 06 13:26:29 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:26:29 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:26:29 user nova-compute[75247]: FIRMWARE:
Dec 06 13:26:29 user nova-compute[75247]: No targets found.
Dec 06 13:26:29 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 13:26:29 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 13:26:29 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c54a39f-57bd-41c3-b6a7-bdf1388aeac4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[34eaafb1-3252-4bea-933f-a1dd47731f28]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 (non-flash)
Dec 06 13:26:29 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 (non-flash)
Dec 06 13:26:29 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd730462c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25'): ({'sdb'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Removing single pathed devices sdb {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ffb55b-bbae-4112-9616-66010572cff6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd8a59f-29aa-44a0-b86d-9faa3092b951]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Flushing IO for device /dev/sdb {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f41c91-0d03-4425-8d73-cc4fb7009c00]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd56f573-ecbd-4c30-a8ca-604401c0964a]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f12fdf8-71fc-4b17-b368-da8991d5fb8c]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9aa3c7-860e-4afe-902e-3376fcaa2c8f]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25, portal: 172.16.0.220,3260]
Dec 06 13:26:29 user nova-compute[75247]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25, portal: 172.16.0.220,3260] successful.
Dec 06 13:26:29 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef208af8-9247-4f01-baa8-2f2c47229b25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefa6a18-c9c5-4e2d-9a5a-3272c3218a7f]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] <== disconnect_volume: return (294ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:26:29 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 13:26:30 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lazy-loading 'flavor' on Instance uuid 78189385-2dd6-4b2b-82ca-ec776308ce06 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:26:30 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c0b9514d-44fd-46ae-8e84-415f4661d9fa tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.758s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:26:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:26:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:26:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:26:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:26:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:26:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:26:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:26:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:26:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:26:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:26:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:26:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:26:39 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:26:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:26:43 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:26:43 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:26:44 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:26:45 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:26:45 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:26:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:26:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:26:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:26:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:26:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:26:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:26:48 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:26:49 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:26:49 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:26:51 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:26:51 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75247) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 13:26:52 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:26:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:26:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:26:52 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:26:52 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:26:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:26:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:26:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:26:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:26:53 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:26:53 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:26:53 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:26:53 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=9051MB free_disk=24.959117889404297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:26:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:26:53 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:26:54 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 78189385-2dd6-4b2b-82ca-ec776308ce06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:26:54 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:26:54 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:26:54 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Refreshing inventories for resource provider d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 13:26:54 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Updating ProviderTree inventory for provider d326b140-3450-4409-964c-9eafc6cc025d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 13:26:54 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Updating inventory in ProviderTree for provider d326b140-3450-4409-964c-9eafc6cc025d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 13:26:54 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Refreshing aggregate associations for resource provider d326b140-3450-4409-964c-9eafc6cc025d, aggregates: None {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 13:26:54 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Refreshing trait associations for resource provider d326b140-3450-4409-964c-9eafc6cc025d, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 13:26:54 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:26:54 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:26:54 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:26:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.453s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:26:55 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:26:55 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:26:55 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 13:26:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:26:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:26:55 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 13:26:55 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lazy-loading 'info_cache' on Instance uuid 78189385-2dd6-4b2b-82ca-ec776308ce06 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:26:55 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Updating instance_info_cache with network_info: [{"id": "daeb3775-21ed-4375-9510-e617331e744a", "address": "fa:16:3e:48:b5:b8", "network": {"id": "f95aee4a-5149-48bb-ab5d-356e48794bd9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-861632372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ccfc3a405224228b91f6f38dbb6c6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb3775-21", "ovs_interfaceid": "daeb3775-21ed-4375-9510-e617331e744a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:26:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:26:55 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 13:26:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:27:00 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:27:00 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Cleaning up deleted instances {{(pid=75247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 13:27:00 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] There are 0 instances to clean {{(pid=75247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 13:27:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "78189385-2dd6-4b2b-82ca-ec776308ce06" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:27:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:27:02 user nova-compute[75247]: DEBUG nova.objects.instance [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lazy-loading 'flavor' on Instance uuid 78189385-2dd6-4b2b-82ca-ec776308ce06 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:27:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:27:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "78189385-2dd6-4b2b-82ca-ec776308ce06" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:27:02 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:27:02 user nova-compute[75247]: INFO nova.compute.manager [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Attaching volume 386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 to /dev/vdb
Dec 06 13:27:02 user nova-compute[75247]: DEBUG os_brick.utils [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:27:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:27:02 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8487c0dd-19b1-4466-aaa3-cba0d1ed383c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:27:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:27:02 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa3457b-b89a-4a4f-9067-ff4e8de27e48]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:27:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:27:02 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf7f615-fcfe-45b1-b17b-baff82427390]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:27:02 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f187e3-cf7f-4ef0-8364-addd1605eee0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:27:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:27:02 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 13:27:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:02 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:27:02 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 13:27:02 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae26ff1-78eb-4a08-91f9-0dee5e5a98cd]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:27:02 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 13:27:02 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 13:27:02 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 13:27:02 user nova-compute[75247]: DEBUG os_brick.utils [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:27:02 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Updating existing volume attachment record: b64fa308-3d8b-44f8-b4a1-f1f278e2c40b {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 13:27:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:27:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:27:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:27:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:27:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:27:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:27:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:27:07 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:27:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:27:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jNFRpsKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:27:15 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:27:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:27:15 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:27:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:27:15 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c82c4a-db1e-454c-aa62-e44e3c339d59]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 13:27:15 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d56675-d52f-4aa7-a89e-36f6d91f8ed5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9] added
Dec 06 13:27:15 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37f9979-305a-4c8e-ba9d-fe43109da219]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[106879cd-c440-40b9-9309-4f4d0c690e1a]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jNFRpsKU {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jNFRpsKU" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc704d71-d394-49da-822e-3d81db6e7cff]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jNFRpsKU'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c77688-b6f5-45f1-b7c2-a6b26d89243a]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfbb1cf-9ff0-43a4-836b-4224a92d9299]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 13:27:15 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 13:27:15 user nova-compute[75247]:  {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:27:15 user nova-compute[75247]: WARNING os_brick.initiator.connectors.iscsi [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 13:27:15 user nova-compute[75247]: 
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4562b3e4-944d-425c-be34-1ec149b16fda]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9, portal: 172.16.0.220,3260]
Dec 06 13:27:15 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9, portal: 172.16.0.220,3260] successful.
Dec 06 13:27:15 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[731644ad-ebf9-4884-b79f-1c08b548faa1]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[27657a79-be8c-48b5-aa63-368bf82faec9]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 (non-flash)
Dec 06 13:27:15 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 (non-flash)
Dec 06 13:27:15 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[11dcd3db-7911-4b36-9bb2-f12b0dd5b5cc]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:27:15 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 13:27:16 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 13:27:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jNFRpsKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 13:27:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:27:16 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23632386563666131', 'path': '/dev/sdb'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:27:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632386563666131', 'path': '/dev/sdb'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 13:27:16 user nova-compute[75247]: DEBUG nova.objects.instance [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lazy-loading 'flavor' on Instance uuid 78189385-2dd6-4b2b-82ca-ec776308ce06 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:27:16 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 13:27:16 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:27:16 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 13:27:16 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 13:27:16 user nova-compute[75247]:   <serial>386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9</serial>
Dec 06 13:27:16 user nova-compute[75247]: </disk>
Dec 06 13:27:16 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 13:27:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:27:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:27:17 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] No VIF found with MAC fa:16:3e:48:b5:b8, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 13:27:17 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-28ee42f5-d9cf-4b6c-a0b9-e82d4c6e2a04 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.981s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:27:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:27:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:27:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:27:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:27:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:27:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:27:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "78189385-2dd6-4b2b-82ca-ec776308ce06" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:27:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:27:19 user nova-compute[75247]: INFO nova.compute.manager [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Detaching volume 386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9
Dec 06 13:27:20 user nova-compute[75247]: INFO nova.virt.block_device [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Attempting to driver detach volume 386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 from mountpoint /dev/vdb
Dec 06 13:27:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Attempting to detach device vdb from instance 78189385-2dd6-4b2b-82ca-ec776308ce06 from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 13:27:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 13:27:20 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:27:20 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 13:27:20 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 13:27:20 user nova-compute[75247]:   <serial>386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9</serial>
Dec 06 13:27:20 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 13:27:20 user nova-compute[75247]: </disk>
Dec 06 13:27:20 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 13:27:20 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Successfully detached device vdb from instance 78189385-2dd6-4b2b-82ca-ec776308ce06 from the persistent domain config.
Dec 06 13:27:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 78189385-2dd6-4b2b-82ca-ec776308ce06 from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 13:27:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 13:27:20 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:27:20 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 13:27:20 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 13:27:20 user nova-compute[75247]:   <serial>386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9</serial>
Dec 06 13:27:20 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 13:27:20 user nova-compute[75247]: </disk>
Dec 06 13:27:20 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 13:27:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:27:20 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 78189385-2dd6-4b2b-82ca-ec776308ce06 {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 13:27:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:27:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:27:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:27:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:27:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:27:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:27:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:27:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:27:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:27:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:27:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:27:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:27:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:27:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:27:39 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:27:40 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 78189385-2dd6-4b2b-82ca-ec776308ce06 is timed out.
Dec 06 13:27:40 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Successfully detached device vdb from instance 78189385-2dd6-4b2b-82ca-ec776308ce06 from the live domain config.
Dec 06 13:27:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jNFRpsKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:27:40 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:27:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c455a6-33f9-49ab-bbfb-2bdeb760d9e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 13:27:40 user nova-compute[75247]: No targets found.
Dec 06 13:27:40 user nova-compute[75247]: iSNS:
Dec 06 13:27:40 user nova-compute[75247]: No targets found.
Dec 06 13:27:40 user nova-compute[75247]: STATIC:
Dec 06 13:27:40 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9
Dec 06 13:27:40 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:27:40 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:27:40 user nova-compute[75247]: FIRMWARE:
Dec 06 13:27:40 user nova-compute[75247]: No targets found.
Dec 06 13:27:40 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 13:27:40 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 13:27:40 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[404aa9a6-03a4-43f3-bf2e-4ba142d69afe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3c3818-745a-4073-b53c-eb4df3295d79]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 (non-flash)
Dec 06 13:27:40 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 (non-flash)
Dec 06 13:27:40 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd7304ced40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9'): ({'sdb'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Removing single pathed devices sdb {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f983f300-ea23-4bcb-8945-0260ba7f8eb4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e86550-3576-4528-9db1-104c43c3395f]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Flushing IO for device /dev/sdb {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc136838-c4ae-4f13-b069-783d59e40c39]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f275372-374f-4d0e-b268-845c486a860e]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a06f984-1695-4173-a9bb-60131df15f52]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cc2ee8-1ce3-4ea3-a2e3-6c77211fe751]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9, portal: 172.16.0.220,3260]
Dec 06 13:27:40 user nova-compute[75247]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9, portal: 172.16.0.220,3260] successful.
Dec 06 13:27:40 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:386b5ddb-d3bf-43f6-9eee-a9da85c9b9e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a41c63c-b2cd-4460-8283-367bd49f1b75]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] <== disconnect_volume: return (280ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:27:40 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 13:27:41 user nova-compute[75247]: DEBUG nova.objects.instance [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lazy-loading 'flavor' on Instance uuid 78189385-2dd6-4b2b-82ca-ec776308ce06 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:27:41 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-bf3fcf6e-40bc-4980-9f34-fca4ae211717 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.684s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:27:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:27:43 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:27:45 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:27:45 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:27:46 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:27:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:27:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:27:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:27:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:27:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:27:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:27:49 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:27:51 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:27:51 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:27:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:27:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:27:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:27:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:27:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:27:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:27:54 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:27:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:27:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:27:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:27:54 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:27:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:27:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:27:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:27:55 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:27:55 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:27:55 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=9041MB free_disk=24.95806121826172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:27:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:27:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:27:55 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 78189385-2dd6-4b2b-82ca-ec776308ce06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:27:55 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:27:55 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:27:55 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:27:55 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:27:55 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:27:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:27:56 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:27:56 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:27:56 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 13:27:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:27:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:27:57 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 13:27:57 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lazy-loading 'info_cache' on Instance uuid 78189385-2dd6-4b2b-82ca-ec776308ce06 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:27:57 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Updating instance_info_cache with network_info: [{"id": "daeb3775-21ed-4375-9510-e617331e744a", "address": "fa:16:3e:48:b5:b8", "network": {"id": "f95aee4a-5149-48bb-ab5d-356e48794bd9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-861632372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ccfc3a405224228b91f6f38dbb6c6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb3775-21", "ovs_interfaceid": "daeb3775-21ed-4375-9510-e617331e744a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:27:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:27:57 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 13:27:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:27:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:27:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:27:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:27:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:27:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:28:00 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:28:00 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Triggering sync for uuid 78189385-2dd6-4b2b-82ca-ec776308ce06 {{(pid=75247) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 13:28:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "78189385-2dd6-4b2b-82ca-ec776308ce06" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:28:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:28:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:28:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:28:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:28:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:28:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:28:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:28:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:28:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:28:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:28:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:28:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:28:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:28:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "78189385-2dd6-4b2b-82ca-ec776308ce06" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG nova.objects.instance [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lazy-loading 'flavor' on Instance uuid 78189385-2dd6-4b2b-82ca-ec776308ce06 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "78189385-2dd6-4b2b-82ca-ec776308ce06" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:28:13 user nova-compute[75247]: INFO nova.compute.manager [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Attaching volume 83d774be-02dc-4336-9228-71e59e1a257d to /dev/vdb
Dec 06 13:28:13 user nova-compute[75247]: DEBUG os_brick.utils [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa704bf8-850b-4a37-9274-145cab5e15ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4a39e1-04d7-4b98-942a-694a083ce440]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e64c507-db4c-4ff5-9a00-95e340c3ea09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b3af88-f267-4115-92dc-513b43bbf0e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:28:13 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 13:28:13 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8076404-4215-43e7-a035-e6ad4b450b5c]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG os_brick.utils [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:28:13 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Updating existing volume attachment record: b18469a4-9d92-46ff-b6cd-164105970576 {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 13:28:15 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:28:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqnNukhv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:28:22 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:28:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:28:22 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:28:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:28:22 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[19013c6d-cf95-45f5-b157-7e6377252594]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 13:28:22 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[699950ea-5a7e-4836-9120-98ff53d567ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d] added
Dec 06 13:28:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc19c46-ad82-46b9-9b09-9da52c76b2ea]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dce529-1959-43b6-8ea7-6130656eb1c9]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PqnNukhv {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PqnNukhv" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd49b88-049a-4984-9912-60e5a49fe6f9]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PqnNukhv'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[69faecf8-a666-4b00-9750-3e937fef03a9]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb59b976-9844-48b3-8af6-489382cbaedd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 13:28:22 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 13:28:22 user nova-compute[75247]:  {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:28:22 user nova-compute[75247]: WARNING os_brick.initiator.connectors.iscsi [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 13:28:22 user nova-compute[75247]: 
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ebb817-82dd-4727-9c1d-911efba3f51c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d, portal: 172.16.0.220,3260]
Dec 06 13:28:22 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d, portal: 172.16.0.220,3260] successful.
Dec 06 13:28:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[978e4b01-8aad-4892-80cb-ba84f34f88d2]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5925659c-d164-4bb6-84ff-9f636ac9bf3b]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d (non-flash)
Dec 06 13:28:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d (non-flash)
Dec 06 13:28:22 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b59083-8efc-446b-afee-e0e2156e6db4]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:28:22 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 13:28:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:28:23 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 13:28:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqnNukhv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 13:28:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:28:23 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23066623434343836', 'path': '/dev/sdb'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:28:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066623434343836', 'path': '/dev/sdb'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 13:28:23 user nova-compute[75247]: DEBUG nova.objects.instance [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lazy-loading 'flavor' on Instance uuid 78189385-2dd6-4b2b-82ca-ec776308ce06 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:28:23 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 13:28:23 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:28:23 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 13:28:23 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 13:28:23 user nova-compute[75247]:   <serial>83d774be-02dc-4336-9228-71e59e1a257d</serial>
Dec 06 13:28:23 user nova-compute[75247]: </disk>
Dec 06 13:28:23 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 13:28:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:28:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:28:24 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] No VIF found with MAC fa:16:3e:48:b5:b8, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 13:28:24 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-0b2596ff-01c3-415a-9b22-7a7f50fa9696 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.004s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:28:25 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:28:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "78189385-2dd6-4b2b-82ca-ec776308ce06" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:28:26 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:28:26 user nova-compute[75247]: INFO nova.compute.manager [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Detaching volume 83d774be-02dc-4336-9228-71e59e1a257d
Dec 06 13:28:26 user nova-compute[75247]: INFO nova.virt.block_device [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Attempting to driver detach volume 83d774be-02dc-4336-9228-71e59e1a257d from mountpoint /dev/vdb
Dec 06 13:28:26 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Attempting to detach device vdb from instance 78189385-2dd6-4b2b-82ca-ec776308ce06 from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 13:28:26 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 13:28:26 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:28:26 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 13:28:26 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 13:28:26 user nova-compute[75247]:   <serial>83d774be-02dc-4336-9228-71e59e1a257d</serial>
Dec 06 13:28:26 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 13:28:26 user nova-compute[75247]: </disk>
Dec 06 13:28:26 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 13:28:26 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Successfully detached device vdb from instance 78189385-2dd6-4b2b-82ca-ec776308ce06 from the persistent domain config.
Dec 06 13:28:26 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 78189385-2dd6-4b2b-82ca-ec776308ce06 from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 13:28:26 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 13:28:26 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:28:26 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 13:28:26 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 13:28:26 user nova-compute[75247]:   <serial>83d774be-02dc-4336-9228-71e59e1a257d</serial>
Dec 06 13:28:26 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 13:28:26 user nova-compute[75247]: </disk>
Dec 06 13:28:26 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 13:28:27 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 78189385-2dd6-4b2b-82ca-ec776308ce06 {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 13:28:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:28:30 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:28:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:28:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:28:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:28:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:28:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:28:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:28:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:28:39 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:28:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:28:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:28:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:28:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:28:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:28:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:28:45 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:28:45 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:28:46 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:28:46 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:28:46 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:28:47 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 78189385-2dd6-4b2b-82ca-ec776308ce06 is timed out.
Dec 06 13:28:47 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Successfully detached device vdb from instance 78189385-2dd6-4b2b-82ca-ec776308ce06 from the live domain config.
Dec 06 13:28:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqnNukhv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:28:47 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:28:47 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fdb0a0-2ae6-4f22-b6a8-83fbbe42b547]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 13:28:47 user nova-compute[75247]: No targets found.
Dec 06 13:28:47 user nova-compute[75247]: iSNS:
Dec 06 13:28:47 user nova-compute[75247]: No targets found.
Dec 06 13:28:47 user nova-compute[75247]: STATIC:
Dec 06 13:28:47 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d
Dec 06 13:28:47 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:28:47 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:28:47 user nova-compute[75247]: FIRMWARE:
Dec 06 13:28:47 user nova-compute[75247]: No targets found.
Dec 06 13:28:47 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 13:28:47 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 13:28:47 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b064ca5-f660-49a5-b735-c401b62eaab1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6572163-d2a1-43fd-8c52-224763cb4292]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d (non-flash)
Dec 06 13:28:47 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d (non-flash)
Dec 06 13:28:47 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd70c50d090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d'): ({'sdb'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Removing single pathed devices sdb {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b7e715-0b53-42aa-8f61-5234d05b7aa2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98c0b54-0f91-4112-8893-9ae9be6dfd7e]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Flushing IO for device /dev/sdb {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e71befe-cf4f-408a-8333-70370dbe2437]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeeb3ba3-eba1-4612-a440-4671da93bebd]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[015cd5b6-fe9b-4bc3-ac81-bfec1bd4f645]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dee39d-03d9-4c8b-b595-b258adc14ce3]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d, portal: 172.16.0.220,3260]
Dec 06 13:28:47 user nova-compute[75247]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d, portal: 172.16.0.220,3260] successful.
Dec 06 13:28:47 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d774be-02dc-4336-9228-71e59e1a257d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edfa931-00ee-4533-b437-4ae0c52c3fb7]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] <== disconnect_volume: return (295ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:28:47 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 13:28:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:28:48 user nova-compute[75247]: DEBUG nova.objects.instance [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lazy-loading 'flavor' on Instance uuid 78189385-2dd6-4b2b-82ca-ec776308ce06 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:28:48 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-69642668-93a1-47b8-9755-af726020f9c5 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.250s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:28:51 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:28:51 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:28:51 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:28:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:28:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:28:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:28:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:28:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:28:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:28:54 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:28:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:28:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:28:54 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:28:54 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:28:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:28:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:28:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:28:55 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:28:55 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:28:55 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=9025MB free_disk=24.957111358642578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:28:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:28:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:28:55 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 78189385-2dd6-4b2b-82ca-ec776308ce06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:28:55 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:28:55 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:28:55 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:28:55 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:28:55 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:28:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:28:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:28:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:28:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:28:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:28:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:28:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:28:58 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:28:58 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:28:58 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 13:28:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:28:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:28:59 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 13:28:59 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lazy-loading 'info_cache' on Instance uuid 78189385-2dd6-4b2b-82ca-ec776308ce06 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:28:59 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Updating instance_info_cache with network_info: [{"id": "daeb3775-21ed-4375-9510-e617331e744a", "address": "fa:16:3e:48:b5:b8", "network": {"id": "f95aee4a-5149-48bb-ab5d-356e48794bd9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-861632372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ccfc3a405224228b91f6f38dbb6c6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb3775-21", "ovs_interfaceid": "daeb3775-21ed-4375-9510-e617331e744a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:28:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:28:59 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 13:29:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:29:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:29:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:29:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:29:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:29:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:29:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:29:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:29:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:29:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:29:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:29:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:29:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:29:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:29:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "78189385-2dd6-4b2b-82ca-ec776308ce06" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:29:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:29:19 user nova-compute[75247]: DEBUG nova.objects.instance [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lazy-loading 'flavor' on Instance uuid 78189385-2dd6-4b2b-82ca-ec776308ce06 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:29:19 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:29:20 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:29:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "78189385-2dd6-4b2b-82ca-ec776308ce06" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:29:20 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:29:20 user nova-compute[75247]: INFO nova.compute.manager [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Attaching volume 25d3f596-9d32-4e93-9107-b5f3db4ded9a to /dev/vdb
Dec 06 13:29:20 user nova-compute[75247]: DEBUG os_brick.utils [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:29:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:29:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[787deb5d-3c45-4bce-b8dc-34e66518ca35]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3488ac1b72ab\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:29:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:29:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0649f0c-f396-40a3-acb2-b018959dad47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:29:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:29:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c667cb-a7ac-441a-88a4-d1adab34f897]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:29:20 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2225107-759a-47f6-9383-196b51eae617]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:29:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Running cmd (subprocess): nvme version {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:20 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] 'nvme version' failed. Not Retrying. {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:29:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] nvme not present on system {{(pid=75247) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 13:29:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:21 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 13:29:21 user nova-compute[75247]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 13:29:21 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95b5495-4870-4317-b8f6-3cb5e9c6034f]: (4, '') {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:29:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75247) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 13:29:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 13:29:21 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.lightos [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] LIGHTOS: no hostnqn found. {{(pid=75247) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 13:29:21 user nova-compute[75247]: DEBUG os_brick.utils [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3488ac1b72ab', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:29:21 user nova-compute[75247]: DEBUG nova.virt.block_device [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Updating existing volume attachment record: 0d05cc67-a85c-429f-b190-30673debbaff {{(pid=75247) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 13:29:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:29:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Calling os-brick to attach iSCSI Volume {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'liSgPQWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:29:30 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:29:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:29:30 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:29:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:29:30 user nova-compute[75247]: INFO os_brick.initiator.connectors.iscsi [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a -p 172.16.0.220:3260 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d45023a-ddf5-4821-9cce-7b0ac3c8a8fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 13:29:30 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a -p 172.16.0.220:3260 --interface default --op new {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b60b74-7ee6-45fd-902c-dae062ef07e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a] added\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a] added
Dec 06 13:29:30 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddd8d2f-f4f9-4144-88ba-c7a52f454e1c]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c71bff-7d6b-4998-b326-51c6cd34cead]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v liSgPQWK {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v liSgPQWK" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8479bb-97bd-44f7-b1bb-fb8a45eb192c]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'liSgPQWK'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1551e6-c716-48d2-92d8-e698e4b600b6]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[91601084-ef66-4d5d-b6cd-6efcf11710ac]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 13:29:30 user nova-compute[75247]:  {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 13:29:30 user nova-compute[75247]:  {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:29:30 user nova-compute[75247]: WARNING os_brick.initiator.connectors.iscsi [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 13:29:30 user nova-compute[75247]: 
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a -p 172.16.0.220:3260 --login {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a0b786-2021-4dae-b5fd-a9d0d938e2b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a, portal: 172.16.0.220,3260]
Dec 06 13:29:30 user nova-compute[75247]: Login to [iface: default, target: iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a, portal: 172.16.0.220,3260] successful.
Dec 06 13:29:30 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c74f4e-3afa-40ed-b87d-f1fd95295333]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b773f2b-faae-4c73-bcc4-75bf2b5aeefd]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a (non-flash)
Dec 06 13:29:30 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a (non-flash)
Dec 06 13:29:30 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Connected to 172.16.0.220:3260 {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75247) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75247) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[534765b2-cec3-40d1-b501-2103647d679a]: (4, ('- - 0', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75247) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 13:29:30 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'liSgPQWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75247) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 13:29:31 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.270s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:29:31 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '23731353636646362', 'path': '/dev/sdb'} {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:29:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731353636646362', 'path': '/dev/sdb'} {{(pid=75247) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 13:29:31 user nova-compute[75247]: DEBUG nova.objects.instance [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lazy-loading 'flavor' on Instance uuid 78189385-2dd6-4b2b-82ca-ec776308ce06 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:29:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 13:29:31 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:29:31 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 13:29:31 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 13:29:31 user nova-compute[75247]:   <serial>25d3f596-9d32-4e93-9107-b5f3db4ded9a</serial>
Dec 06 13:29:31 user nova-compute[75247]: </disk>
Dec 06 13:29:31 user nova-compute[75247]:  {{(pid=75247) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 13:29:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] No BDM found with device name vda, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:29:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75247) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 13:29:31 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] No VIF found with MAC fa:16:3e:48:b5:b8, not building metadata {{(pid=75247) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 13:29:31 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-d7da393b-f226-4b5c-b030-cb5320d4b3e3 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.041s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:29:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:29:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "78189385-2dd6-4b2b-82ca-ec776308ce06" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:29:34 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:29:34 user nova-compute[75247]: INFO nova.compute.manager [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Detaching volume 25d3f596-9d32-4e93-9107-b5f3db4ded9a
Dec 06 13:29:34 user nova-compute[75247]: INFO nova.virt.block_device [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Attempting to driver detach volume 25d3f596-9d32-4e93-9107-b5f3db4ded9a from mountpoint /dev/vdb
Dec 06 13:29:34 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Attempting to detach device vdb from instance 78189385-2dd6-4b2b-82ca-ec776308ce06 from the persistent domain config. {{(pid=75247) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 13:29:34 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 13:29:34 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:29:34 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 13:29:34 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 13:29:34 user nova-compute[75247]:   <serial>25d3f596-9d32-4e93-9107-b5f3db4ded9a</serial>
Dec 06 13:29:34 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 13:29:34 user nova-compute[75247]: </disk>
Dec 06 13:29:34 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 13:29:34 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Successfully detached device vdb from instance 78189385-2dd6-4b2b-82ca-ec776308ce06 from the persistent domain config.
Dec 06 13:29:34 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 78189385-2dd6-4b2b-82ca-ec776308ce06 from the live domain config. {{(pid=75247) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 13:29:34 user nova-compute[75247]: DEBUG nova.virt.libvirt.guest [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 13:29:34 user nova-compute[75247]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 13:29:34 user nova-compute[75247]:   <source dev="/dev/sdb"/>
Dec 06 13:29:34 user nova-compute[75247]:   <target dev="vdb" bus="virtio"/>
Dec 06 13:29:34 user nova-compute[75247]:   <serial>25d3f596-9d32-4e93-9107-b5f3db4ded9a</serial>
Dec 06 13:29:34 user nova-compute[75247]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 13:29:34 user nova-compute[75247]: </disk>
Dec 06 13:29:34 user nova-compute[75247]:  {{(pid=75247) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 13:29:34 user nova-compute[75247]: DEBUG nova.virt.libvirt.driver [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 78189385-2dd6-4b2b-82ca-ec776308ce06 {{(pid=75247) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 13:29:35 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:29:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:29:40 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:29:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:29:45 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:29:47 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:29:47 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:29:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:29:48 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:29:51 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:29:51 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:29:52 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:29:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:29:54 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 78189385-2dd6-4b2b-82ca-ec776308ce06 is timed out.
Dec 06 13:29:54 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Successfully detached device vdb from instance 78189385-2dd6-4b2b-82ca-ec776308ce06 from the live domain config.
Dec 06 13:29:54 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] calling os-brick to detach iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 13:29:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd74816e410>, {'target_iqn': 'iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'liSgPQWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 13:29:54 user nova-compute[75247]: WARNING os_brick.initiator.connectors.base [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 13:29:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 13:29:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 13:29:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:29:54 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ae0c2f-3b1a-4c38-ada1-cc713b179b9a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:29:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 13:29:54 user nova-compute[75247]: No targets found.
Dec 06 13:29:54 user nova-compute[75247]: iSNS:
Dec 06 13:29:54 user nova-compute[75247]: No targets found.
Dec 06 13:29:54 user nova-compute[75247]: STATIC:
Dec 06 13:29:54 user nova-compute[75247]: Target: iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a
Dec 06 13:29:54 user nova-compute[75247]:         Portal: 172.16.0.220:3260,-1
Dec 06 13:29:54 user nova-compute[75247]:                 Iface Name: default
Dec 06 13:29:54 user nova-compute[75247]: FIRMWARE:
Dec 06 13:29:54 user nova-compute[75247]: No targets found.
Dec 06 13:29:54 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:29:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 13:29:54 user nova-compute[75247]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 13:29:54 user nova-compute[75247]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75247) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 13:29:54 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a', 0)] {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 13:29:54 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd7be04-7f01-46b7-80c5-39f076b49eb8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42b021d-3599-43d1-a27b-ae19b0017caa]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a (non-flash)\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a (non-flash)
Dec 06 13:29:55 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a (non-flash)
Dec 06 13:29:55 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd74b1dfd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a'): ({'sdb'}, set())}) {{(pid=75247) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Removing single pathed devices sdb {{(pid=75247) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72c45c8-0e52-43c7-bb15-851c16ed6115]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[b612de1c-5094-4394-8e08-0d9e79d11c96]: (4, ('ok\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Flushing IO for device /dev/sdb {{(pid=75247) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4507f76-cf87-4bfb-9322-4a1c6331cace]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75247) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e941860-6dd9-4c58-b5d9-09eb536f688a]: (4, ('1', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG os_brick.initiator.linuxscsi [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] SCSI volumes sdb have been removed. {{(pid=75247) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a')] {{(pid=75247) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a07ef1f-9a83-48ee-91d9-84b682a61a93]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a -p 172.16.0.220:3260 --logout {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8378b25-9713-45b5-8cb7-b70e7cedc487]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a, portal: 172.16.0.220,3260]
Dec 06 13:29:55 user nova-compute[75247]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a, portal: 172.16.0.220,3260] successful.
Dec 06 13:29:55 user nova-compute[75247]:  stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a -p 172.16.0.220:3260 --op delete {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25d3f596-9d32-4e93-9107-b5f3db4ded9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86354) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo.privsep.daemon [-] privsep: reply[00368409-6084-495b-be6b-6d3e15fea4ed]: (4, ('', '')) {{(pid=86354) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75247) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.base [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] <== disconnect_volume: return (266ms) None {{(pid=75247) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Disconnected iSCSI Volume {{(pid=75247) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:29:55 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:29:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:29:56 user nova-compute[75247]: DEBUG nova.objects.instance [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lazy-loading 'flavor' on Instance uuid 78189385-2dd6-4b2b-82ca-ec776308ce06 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:29:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk --force-share --output=json {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 13:29:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-b2c5faea-4e91-4413-8ce8-4439b2ff452e tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.889s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:29:56 user nova-compute[75247]: DEBUG oslo_concurrency.processutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75247) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 13:29:56 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:29:56 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:29:56 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=9054MB free_disk=24.956096649169922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:29:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:29:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:29:56 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 78189385-2dd6-4b2b-82ca-ec776308ce06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:29:56 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:29:56 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:29:56 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:29:56 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:29:56 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:29:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:29:58 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:29:59 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:29:59 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:29:59 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 13:30:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 13:30:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquired lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 13:30:00 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Forcefully refreshing network info cache for instance {{(pid=75247) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 13:30:00 user nova-compute[75247]: DEBUG nova.objects.instance [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lazy-loading 'info_cache' on Instance uuid 78189385-2dd6-4b2b-82ca-ec776308ce06 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:30:00 user nova-compute[75247]: DEBUG nova.network.neutron [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Updating instance_info_cache with network_info: [{"id": "daeb3775-21ed-4375-9510-e617331e744a", "address": "fa:16:3e:48:b5:b8", "network": {"id": "f95aee4a-5149-48bb-ab5d-356e48794bd9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-861632372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ccfc3a405224228b91f6f38dbb6c6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb3775-21", "ovs_interfaceid": "daeb3775-21ed-4375-9510-e617331e744a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:30:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Releasing lock "refresh_cache-78189385-2dd6-4b2b-82ca-ec776308ce06" {{(pid=75247) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 13:30:00 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Updated the network info_cache for instance {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 13:30:03 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:30:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:30:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:30:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:30:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:30:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:30:08 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:30:13 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:30:18 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:30:23 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:30:28 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:30:33 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:30:38 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:30:41 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:30:43 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:30:47 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:30:47 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:30:48 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:30:48 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:30:49 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:30:49 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:30:52 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:30:53 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:30:53 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:30:53 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-604f8ddd-f4a7-439d-9fe4-566a0c5527c6 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "78189385-2dd6-4b2b-82ca-ec776308ce06" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-604f8ddd-f4a7-439d-9fe4-566a0c5527c6 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-604f8ddd-f4a7-439d-9fe4-566a0c5527c6 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "78189385-2dd6-4b2b-82ca-ec776308ce06-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-604f8ddd-f4a7-439d-9fe4-566a0c5527c6 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-604f8ddd-f4a7-439d-9fe4-566a0c5527c6 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:30:55 user nova-compute[75247]: INFO nova.compute.manager [None req-604f8ddd-f4a7-439d-9fe4-566a0c5527c6 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Terminating instance
Dec 06 13:30:55 user nova-compute[75247]: DEBUG nova.compute.manager [None req-604f8ddd-f4a7-439d-9fe4-566a0c5527c6 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Start destroying the instance on the hypervisor. {{(pid=75247) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG nova.compute.manager [req-a50d50f9-d06f-4ca3-9153-dd154996839c req-1ec34a55-4a6b-4929-933c-face4eb3c464 service nova] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Received event network-vif-unplugged-daeb3775-21ed-4375-9510-e617331e744a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a50d50f9-d06f-4ca3-9153-dd154996839c req-1ec34a55-4a6b-4929-933c-face4eb3c464 service nova] Acquiring lock "78189385-2dd6-4b2b-82ca-ec776308ce06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a50d50f9-d06f-4ca3-9153-dd154996839c req-1ec34a55-4a6b-4929-933c-face4eb3c464 service nova] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-a50d50f9-d06f-4ca3-9153-dd154996839c req-1ec34a55-4a6b-4929-933c-face4eb3c464 service nova] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG nova.compute.manager [req-a50d50f9-d06f-4ca3-9153-dd154996839c req-1ec34a55-4a6b-4929-933c-face4eb3c464 service nova] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] No waiting events found dispatching network-vif-unplugged-daeb3775-21ed-4375-9510-e617331e744a {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG nova.compute.manager [req-a50d50f9-d06f-4ca3-9153-dd154996839c req-1ec34a55-4a6b-4929-933c-face4eb3c464 service nova] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Received event network-vif-unplugged-daeb3775-21ed-4375-9510-e617331e744a for instance with task_state deleting. {{(pid=75247) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:30:55 user nova-compute[75247]: INFO nova.virt.libvirt.driver [-] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Instance destroyed successfully.
Dec 06 13:30:55 user nova-compute[75247]: DEBUG nova.objects.instance [None req-604f8ddd-f4a7-439d-9fe4-566a0c5527c6 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lazy-loading 'resources' on Instance uuid 78189385-2dd6-4b2b-82ca-ec776308ce06 {{(pid=75247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG nova.virt.libvirt.vif [None req-604f8ddd-f4a7-439d-9fe4-566a0c5527c6 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T13:23:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-338472318',display_name='tempest-SnapshotDataIntegrityTests-server-338472318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-338472318',id=53,image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSPHIipmQPAjSnzkIjbBNUd0iQxVHIhXcOseodYCCgKuhrGIQpN8j3qnK/mV8v0CqO+KLx5RcFU4qTTK6blFNjyiW3jZToYhUjCd+psBIRuBZMnjNyVlVJ2B72J82fXAw==',key_name='tempest-keypair-1614072218',keypairs=<?>,launch_index=0,launched_at=2023-12-06T13:23:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ccfc3a405224228b91f6f38dbb6c6c5',ramdisk_id='',reservation_id='r-3kyflhen',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8242af4f-c2f6-4990-9385-f1348e8ff114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1305509829',owner_user_name='tempest-SnapshotDataIntegrityTests-1305509829-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T13:23:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8d20096e03c4dfd8ddb044d1db84ff4',uuid=78189385-2dd6-4b2b-82ca-ec776308ce06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daeb3775-21ed-4375-9510-e617331e744a", "address": "fa:16:3e:48:b5:b8", "network": {"id": "f95aee4a-5149-48bb-ab5d-356e48794bd9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-861632372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ccfc3a405224228b91f6f38dbb6c6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb3775-21", "ovs_interfaceid": "daeb3775-21ed-4375-9510-e617331e744a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-604f8ddd-f4a7-439d-9fe4-566a0c5527c6 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Converting VIF {"id": "daeb3775-21ed-4375-9510-e617331e744a", "address": "fa:16:3e:48:b5:b8", "network": {"id": "f95aee4a-5149-48bb-ab5d-356e48794bd9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-861632372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ccfc3a405224228b91f6f38dbb6c6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb3775-21", "ovs_interfaceid": "daeb3775-21ed-4375-9510-e617331e744a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG nova.network.os_vif_util [None req-604f8ddd-f4a7-439d-9fe4-566a0c5527c6 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:b5:b8,bridge_name='br-int',has_traffic_filtering=True,id=daeb3775-21ed-4375-9510-e617331e744a,network=Network(f95aee4a-5149-48bb-ab5d-356e48794bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaeb3775-21') {{(pid=75247) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG os_vif [None req-604f8ddd-f4a7-439d-9fe4-566a0c5527c6 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:b5:b8,bridge_name='br-int',has_traffic_filtering=True,id=daeb3775-21ed-4375-9510-e617331e744a,network=Network(f95aee4a-5149-48bb-ab5d-356e48794bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaeb3775-21') {{(pid=75247) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdaeb3775-21, bridge=br-int, if_exists=True) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a12e0852-da08-498c-87b1-033e6382aaab) {{(pid=75247) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:30:55 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:30:56 user nova-compute[75247]: INFO os_vif [None req-604f8ddd-f4a7-439d-9fe4-566a0c5527c6 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:b5:b8,bridge_name='br-int',has_traffic_filtering=True,id=daeb3775-21ed-4375-9510-e617331e744a,network=Network(f95aee4a-5149-48bb-ab5d-356e48794bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaeb3775-21')
Dec 06 13:30:56 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-604f8ddd-f4a7-439d-9fe4-566a0c5527c6 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Deleting instance files /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06_del
Dec 06 13:30:56 user nova-compute[75247]: INFO nova.virt.libvirt.driver [None req-604f8ddd-f4a7-439d-9fe4-566a0c5527c6 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Deletion of /opt/stack/data/nova/instances/78189385-2dd6-4b2b-82ca-ec776308ce06_del complete
Dec 06 13:30:56 user nova-compute[75247]: INFO nova.compute.manager [None req-604f8ddd-f4a7-439d-9fe4-566a0c5527c6 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Took 0.88 seconds to destroy the instance on the hypervisor.
Dec 06 13:30:56 user nova-compute[75247]: DEBUG oslo.service.loopingcall [None req-604f8ddd-f4a7-439d-9fe4-566a0c5527c6 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75247) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 13:30:56 user nova-compute[75247]: DEBUG nova.compute.manager [-] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Deallocating network for instance {{(pid=75247) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 13:30:56 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] deallocate_for_instance() {{(pid=75247) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 13:30:56 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Error from libvirt while getting description of instance-00000035: [Error Code 42] Domain not found: no domain with matching uuid '78189385-2dd6-4b2b-82ca-ec776308ce06' (instance-00000035): libvirt.libvirtError: Domain not found: no domain with matching uuid '78189385-2dd6-4b2b-82ca-ec776308ce06' (instance-00000035)
Dec 06 13:30:56 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:30:56 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:30:56 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=9181MB free_disk=24.95507049560547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:30:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:30:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:30:56 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Instance 78189385-2dd6-4b2b-82ca-ec776308ce06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75247) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 13:30:56 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:30:56 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:30:56 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:30:56 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:30:56 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:30:56 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:30:57 user nova-compute[75247]: DEBUG nova.network.neutron [-] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Updating instance_info_cache with network_info: [] {{(pid=75247) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 13:30:57 user nova-compute[75247]: INFO nova.compute.manager [-] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Took 0.99 seconds to deallocate network for instance.
Dec 06 13:30:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-604f8ddd-f4a7-439d-9fe4-566a0c5527c6 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:30:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-604f8ddd-f4a7-439d-9fe4-566a0c5527c6 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:30:57 user nova-compute[75247]: DEBUG nova.compute.manager [req-cc0c5168-5f46-445b-b4b5-df9e69ff5c24 req-8a22ddbd-e461-42da-ba99-402b835eb732 service nova] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Received event network-vif-deleted-daeb3775-21ed-4375-9510-e617331e744a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:30:57 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-604f8ddd-f4a7-439d-9fe4-566a0c5527c6 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:30:57 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-604f8ddd-f4a7-439d-9fe4-566a0c5527c6 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:30:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-604f8ddd-f4a7-439d-9fe4-566a0c5527c6 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.118s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:30:57 user nova-compute[75247]: INFO nova.scheduler.client.report [None req-604f8ddd-f4a7-439d-9fe4-566a0c5527c6 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Deleted allocations for instance 78189385-2dd6-4b2b-82ca-ec776308ce06
Dec 06 13:30:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-604f8ddd-f4a7-439d-9fe4-566a0c5527c6 tempest-SnapshotDataIntegrityTests-1305509829 tempest-SnapshotDataIntegrityTests-1305509829-project-member] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.186s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:30:57 user nova-compute[75247]: DEBUG nova.compute.manager [req-286c1a82-1145-4ab1-a8b9-a28f5fc3fe1f req-5f09ab5c-fb8c-4c42-ad2e-402a719ec69b service nova] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Received event network-vif-plugged-daeb3775-21ed-4375-9510-e617331e744a {{(pid=75247) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 13:30:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-286c1a82-1145-4ab1-a8b9-a28f5fc3fe1f req-5f09ab5c-fb8c-4c42-ad2e-402a719ec69b service nova] Acquiring lock "78189385-2dd6-4b2b-82ca-ec776308ce06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:30:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-286c1a82-1145-4ab1-a8b9-a28f5fc3fe1f req-5f09ab5c-fb8c-4c42-ad2e-402a719ec69b service nova] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:30:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [req-286c1a82-1145-4ab1-a8b9-a28f5fc3fe1f req-5f09ab5c-fb8c-4c42-ad2e-402a719ec69b service nova] Lock "78189385-2dd6-4b2b-82ca-ec776308ce06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:30:57 user nova-compute[75247]: DEBUG nova.compute.manager [req-286c1a82-1145-4ab1-a8b9-a28f5fc3fe1f req-5f09ab5c-fb8c-4c42-ad2e-402a719ec69b service nova] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] No waiting events found dispatching network-vif-plugged-daeb3775-21ed-4375-9510-e617331e744a {{(pid=75247) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 13:30:57 user nova-compute[75247]: WARNING nova.compute.manager [req-286c1a82-1145-4ab1-a8b9-a28f5fc3fe1f req-5f09ab5c-fb8c-4c42-ad2e-402a719ec69b service nova] [instance: 78189385-2dd6-4b2b-82ca-ec776308ce06] Received unexpected event network-vif-plugged-daeb3775-21ed-4375-9510-e617331e744a for instance with vm_state deleted and task_state None.
Dec 06 13:31:00 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:31:00 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:31:00 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 13:31:00 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Didn't find any instances for network info cache update. {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 13:31:00 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:31:05 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:31:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:31:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:31:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:31:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:31:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:31:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:31:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:31:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:31:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:31:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:31:36 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:31:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:31:41 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:31:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:31:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:31:47 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:31:47 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:31:49 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:31:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:31:51 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:31:51 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:31:52 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:31:53 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:31:55 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:31:55 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:31:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:31:57 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:31:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:31:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:31:57 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:31:57 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:31:58 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:31:58 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:31:58 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=9283MB free_disk=24.98200225830078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:31:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:31:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:31:58 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:31:58 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:31:58 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Refreshing inventories for resource provider d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 13:31:58 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Updating ProviderTree inventory for provider d326b140-3450-4409-964c-9eafc6cc025d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 13:31:58 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Updating inventory in ProviderTree for provider d326b140-3450-4409-964c-9eafc6cc025d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 13:31:58 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Refreshing aggregate associations for resource provider d326b140-3450-4409-964c-9eafc6cc025d, aggregates: None {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 13:31:58 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Refreshing trait associations for resource provider d326b140-3450-4409-964c-9eafc6cc025d, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=75247) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 13:31:58 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:31:58 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:31:58 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:31:58 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.468s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:31:58 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:31:58 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75247) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 13:32:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:32:01 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:32:01 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:32:01 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 13:32:01 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Didn't find any instances for network info cache update. {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 13:32:05 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:32:05 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Cleaning up deleted instances {{(pid=75247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 13:32:05 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] There are 0 instances to clean {{(pid=75247) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 13:32:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:32:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:32:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:32:17 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:32:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:32:26 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:32:31 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:32:36 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:32:41 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:32:41 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:32:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:32:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:32:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75247) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 13:32:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:32:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:32:46 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75247) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 13:32:47 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:32:47 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:32:49 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:32:51 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:32:51 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:32:53 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:32:53 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:32:56 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:32:56 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:32:56 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75247) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 13:32:59 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:32:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:32:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:32:59 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:32:59 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75247) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 13:33:00 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:33:00 user nova-compute[75247]: WARNING nova.virt.libvirt.driver [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 13:33:00 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Hypervisor/Node resource view: name=user free_ram=9290MB free_disk=24.97441864013672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75247) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 13:33:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 13:33:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 13:33:00 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 13:33:00 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75247) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 13:33:00 user nova-compute[75247]: DEBUG nova.compute.provider_tree [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed in ProviderTree for provider: d326b140-3450-4409-964c-9eafc6cc025d {{(pid=75247) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 13:33:00 user nova-compute[75247]: DEBUG nova.scheduler.client.report [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Inventory has not changed for provider d326b140-3450-4409-964c-9eafc6cc025d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75247) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 13:33:00 user nova-compute[75247]: DEBUG nova.compute.resource_tracker [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Compute_service record updated for user:user {{(pid=75247) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 13:33:00 user nova-compute[75247]: DEBUG oslo_concurrency.lockutils [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=75247) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 13:33:01 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 13:33:03 user nova-compute[75247]: DEBUG oslo_service.periodic_task [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75247) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 13:33:03 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Starting heal instance info cache {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 13:33:03 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Rebuilding the list of instances to heal {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 13:33:03 user nova-compute[75247]: DEBUG nova.compute.manager [None req-c4b4f819-c49d-4651-8b68-26de7deb59c5 None None] Didn't find any instances for network info cache update. {{(pid=75247) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 13:33:06 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:33:11 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:33:16 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 13:33:21 user nova-compute[75247]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=75247) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}